May 27 17:03:44.195047 ip-10-0-134-95 systemd[1]: Starting Kubernetes Kubelet...
May 27 17:03:44.705273 ip-10-0-134-95 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:03:44.705273 ip-10-0-134-95 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 17:03:44.705273 ip-10-0-134-95 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:03:44.705273 ip-10-0-134-95 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 17:03:44.705273 ip-10-0-134-95 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 17:03:44.707271 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.707171    2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 17:03:44.710478 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710455    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:03:44.710478 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710474    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:03:44.710478 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710479    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:03:44.710478 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710483    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710488    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710492    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710497    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710501    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710507    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710511    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710514    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710518    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710523    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710529    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710543    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710547    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710551    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710555    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710558    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710562    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710566    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710570    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:03:44.710796 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710574    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710578    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710581    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710585    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710590    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710593    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710597    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710601    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710605    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710609    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710613    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710618    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710623    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710627    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710631    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710636    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710640    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710644    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710648    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:03:44.711555 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710654    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710660    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710665    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710668    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710673    2574 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710677    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710683    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710687    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710693    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710698    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710703    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710707    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710711    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710715    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710720    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710724    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710728    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710733    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710737    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710742    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:03:44.712280 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710746    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710750    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710754    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710777    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710781    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710786    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710791    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710795    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710799    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710803    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710808    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710812    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710817    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710821    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710825    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710829    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710833    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710837    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710841    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:03:44.712780 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710846    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710850    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710855    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710859    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710863    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.710867    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711590    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711600    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711606    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711611    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711615    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711619    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711624    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711628    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711633    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711637    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711641    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711645    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711650    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:03:44.713255 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711655    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711659    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711664    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711668    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711672    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711676    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711680    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711684    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711689    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711693    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711697    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711701    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711705    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711709    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711713    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711718    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711722    2574 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711726    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711730    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711734    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:03:44.713877 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711738    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711742    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711746    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711750    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711754    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711776    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711780    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711784    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711788    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711792    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711796    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711800    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711805    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711809    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711814    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711818    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711822    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711826    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711830    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711834    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:03:44.714783 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711838    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711842    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711867    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711876    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711880    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711884    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711888    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711893    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711897    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711901    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711905    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711909    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711913    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711919    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711923    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711927    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711931    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711935    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711940    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:03:44.715430 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711944    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711948    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711952    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711958    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711964    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711969    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711979    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711985    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711990    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711994    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.711998    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.712002    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.712006    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.712011    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713679    2574 flags.go:64] FLAG: --address="0.0.0.0"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713698    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713709    2574 flags.go:64] FLAG: --anonymous-auth="true"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713717    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713725    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713730    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713737    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 17:03:44.716671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713744    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713750    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713770    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713777    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713783    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713787    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713792    2574 flags.go:64] FLAG: --cgroup-root=""
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713797    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713801    2574 flags.go:64] FLAG: --client-ca-file=""
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713806    2574 flags.go:64] FLAG: --cloud-config=""
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713811    2574 flags.go:64] FLAG: --cloud-provider="external"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713815    2574 flags.go:64] FLAG: --cluster-dns="[]"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713821    2574 flags.go:64] FLAG: --cluster-domain=""
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713826    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713831    2574 flags.go:64] FLAG: --config-dir=""
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713836    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713842    2574 flags.go:64] FLAG: --container-log-max-files="5"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713848    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713855    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713860    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713865    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713870    2574 flags.go:64] FLAG: --contention-profiling="false"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713874    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713879    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713884    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 17:03:44.717379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713889    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713896    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713900    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713906    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713911    2574 flags.go:64] FLAG: --enable-load-reader="false"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713917    2574 flags.go:64] FLAG: --enable-server="true"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713922    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713930    2574 flags.go:64] FLAG: --event-burst="100"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713935    2574 flags.go:64] FLAG: --event-qps="50"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713939    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713944    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713949    2574 flags.go:64] FLAG: --eviction-hard=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713956    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713961    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713966    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713971    2574 flags.go:64] FLAG: --eviction-soft=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713976    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713981    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713985    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713990    2574 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713995    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.713999    2574 flags.go:64] FLAG: --fail-swap-on="true"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714005    2574 flags.go:64] FLAG: --feature-gates=""
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714012    2574 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714017    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 17:03:44.718009 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714022    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714036    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714042    2574 flags.go:64] FLAG: --healthz-port="10248"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714047    2574 flags.go:64] FLAG: --help="false"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714052    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-95.ec2.internal"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714058    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714063    2574 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714067    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714073    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714079    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714085    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714090    2574 flags.go:64] FLAG: --image-service-endpoint=""
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714095    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714100    2574 flags.go:64] FLAG: --kube-api-burst="100"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714105    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714111    2574 flags.go:64] FLAG: --kube-api-qps="50"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714116    2574 flags.go:64] FLAG: --kube-reserved=""
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714121    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714126    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714131    2574 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714136    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714141    2574 flags.go:64] FLAG: --lock-file=""
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714146    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714151    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 17:03:44.718695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714156    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714165    2574 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714170    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714175    2574 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714180    2574 flags.go:64] FLAG: --logging-format="text"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714185    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714191    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714196    2574 flags.go:64] FLAG: --manifest-url=""
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714201    2574 flags.go:64] FLAG: --manifest-url-header=""
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714208    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714214    2574 flags.go:64] FLAG: --max-open-files="1000000"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714221    2574 flags.go:64] FLAG: --max-pods="110"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714226    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714231    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714236    2574 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714241    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714246    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714251    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714256    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714270    2574 flags.go:64] FLAG: --node-status-max-images="50"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714276    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714281    2574 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714285    2574 flags.go:64] FLAG: --pod-cidr=""
May 27 17:03:44.719291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714290    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714299    2574 flags.go:64] FLAG: --pod-manifest-path=""
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714304    2574 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714310    2574 flags.go:64] FLAG: --pods-per-core="0"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714315    2574 flags.go:64] FLAG: --port="10250"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714321    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714326    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b207b61894aae4d"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714332    2574 flags.go:64] FLAG: --qos-reserved=""
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714336    2574 flags.go:64] FLAG: --read-only-port="10255"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714341    2574 flags.go:64] FLAG: --register-node="true"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714346    2574 flags.go:64] FLAG: --register-schedulable="true"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714351    2574 flags.go:64] FLAG: --register-with-taints=""
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714364    2574 flags.go:64] FLAG: --registry-burst="10"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714369    2574 flags.go:64] FLAG: --registry-qps="5"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714374    2574 flags.go:64] FLAG: --reserved-cpus=""
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714379    2574 flags.go:64] FLAG: --reserved-memory=""
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714385    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714390    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714395    2574 flags.go:64] FLAG: --rotate-certificates="false"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714400    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714407    2574 flags.go:64] FLAG: --runonce="false"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714413    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714420    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714425    2574 flags.go:64] FLAG: --seccomp-default="false"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714430    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714435    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 17:03:44.719877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714441    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714446    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714451    2574 flags.go:64] FLAG: --storage-driver-password="root"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714457    2574 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714462    2574 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714467    2574 flags.go:64] FLAG: --storage-driver-user="root"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714472    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714477    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714482    2574 flags.go:64] FLAG: --system-cgroups=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714486    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714496    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714501    2574 flags.go:64] FLAG: --tls-cert-file=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714506    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714512    2574 flags.go:64] FLAG: --tls-min-version=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714516    2574 flags.go:64] FLAG: --tls-private-key-file=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714521    2574 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714526    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714531    2574 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714536    2574 flags.go:64] FLAG: --v="2"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714543    2574 flags.go:64] FLAG: --version="false"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714549    2574 flags.go:64] FLAG: --vmodule=""
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714556    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.714562    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714718    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:03:44.720489 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714724    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714731    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714735    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714740    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714744    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714749    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714753    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714773    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714778    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714782    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714786    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714790    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714793    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714798    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714801    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714805    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714809    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714813    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714818    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714821    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:03:44.721118 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714825    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714829    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714833    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714837    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714841    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714845    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714849    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714853    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714858    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714862    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714866    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714870    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714874    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714878    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714883    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714887    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714892    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714897    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714901    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:03:44.721748 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714908    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714914    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714920    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714925    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714930    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714934    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714938    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714942    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714946    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714950    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714954    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714958    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714962    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714966    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714971    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714975    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714979    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714983    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714987    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714992    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:03:44.722580 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.714996    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715004    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715011    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715015    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715019    2574 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715024    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715028    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715032    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715036    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715040    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715045    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715049    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715054    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715059    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715063    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715067    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715071    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715075    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715079    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715083    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:03:44.723454 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715087    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715091    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715095    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715099    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715104    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.715110    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:03:44.724103 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.715860    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:03:44.725338 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.725319    2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 17:03:44.725392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.725342    2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725416    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725426    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725432    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725437    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725442    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:03:44.725444 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725447    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725451    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725455    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725459    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725463    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725467    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725471    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725475    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725479    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725483    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725487    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725491    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725496    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725501    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725505    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725509    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725513    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725517    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725521    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725526    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:03:44.725711 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725530    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725534    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725538    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725541    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725545    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725550    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725556    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725560    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725564    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725568    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725572    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725576    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725580    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725584    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725589    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725594    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725599    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725603    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725607    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725611    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:03:44.726565 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725616    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725620    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725624    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725628    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725634    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725641    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725646    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725651    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725655    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725660    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725666    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725672    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725676    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725681    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725685    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725689    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725693    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725697    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:03:44.727102 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725701    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725706    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725711    2574 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725715    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725719    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725723    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725727    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725731    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725736    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725740    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725745    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725749    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725753    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725771    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725775    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725779    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725783    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725787    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725792    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725796    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:03:44.727610 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725799    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725803    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725807    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.725816    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725978    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725986    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725990    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725995    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.725999    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726004    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726008    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726012    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726017    2574 feature_gate.go:328] unrecognized feature gate: Example
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726022    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726027    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 17:03:44.728233 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726032    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726037    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726043    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726048    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726053    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726057    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726062    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726066    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726071    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726075    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726079    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726084    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726088    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726092    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726096    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726100    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726104    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726108    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726112    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726116    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 17:03:44.728873 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726121    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726125    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726129    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726133    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726137    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726141    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726145    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726149    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726153    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726158    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726162    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726166    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726173    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726177    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726181    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726185    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726189    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726194    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726198    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726202    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 17:03:44.729355 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726206    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726210    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726214    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726218    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726222    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726227    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726231    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726235    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726239    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726243    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726247    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726251    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726255    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726259    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726263    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726267    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726271    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726275    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726279    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726283    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 17:03:44.729912 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726288    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726292    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726296    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726301    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726304    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726309    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726314    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726318    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726323    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726327    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726331    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726335    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726341    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726347    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:44.726351    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 17:03:44.730699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.726359    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 17:03:44.731340 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.727295    2574 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 17:03:44.732868 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.732849    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 17:03:44.734038 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.734026    2574 server.go:1019] "Starting client certificate rotation"
May 27 17:03:44.734141 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.734124    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:03:44.734209 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.734167    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 17:03:44.763464 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.763436    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:03:44.765342 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.765324    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 17:03:44.786884 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.786865    2574 log.go:25] "Validated CRI v1 runtime API"
May 27 17:03:44.793306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.793292    2574 log.go:25] "Validated CRI v1 image API"
May 27 17:03:44.794708 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.794693    2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 17:03:44.798707 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.798687    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82b4d2cb-d5f0-4fdd-b470-3e42f3acea0c:/dev/nvme0n1p4 bdacdd0a-9066-4c50-a9e4-eaf8535d0418:/dev/nvme0n1p3]
May 27 17:03:44.798788 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.798706    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 17:03:44.800138 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.800117    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:03:44.804016 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.803903    2574 manager.go:217] Machine: {Timestamp:2026-05-27 17:03:44.80338716 +0000 UTC m=+0.477812319 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100075 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c029a97fc1f547feab5f5f9438eca SystemUUID:ec2c029a-97fc-1f54-7fea-b5f5f9438eca BootID:a90bebfd-4a4b-438c-965f-3103d7abb0bf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:5c:07:54:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:5c:07:54:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:91:96:e2:28:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 17:03:44.804016 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.804007    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 17:03:44.804153 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.804120    2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 17:03:44.806201 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.806150    2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 17:03:44.806341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.806204    2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 17:03:44.806391 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.806352    2574 topology_manager.go:138] "Creating topology manager with none policy"
May 27 17:03:44.806391 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.806360    2574 container_manager_linux.go:306] "Creating device plugin manager"
May 27 17:03:44.806391 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.806367    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:03:44.807234 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.807223    2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 17:03:44.809732 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.809721    2574 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:03:44.809858 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.809848    2574 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 17:03:44.812467 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.812457    2574 kubelet.go:491] "Attempting to sync node with API server"
May 27 17:03:44.812514 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.812473    2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 17:03:44.812514 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.812484    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 17:03:44.812514 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.812493    2574 kubelet.go:397] "Adding apiserver pod source"
May 27 17:03:44.812514 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.812504    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 17:03:44.814910 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.814897    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:03:44.814981 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.814916    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 17:03:44.819597 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.819579    2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 17:03:44.822025 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822009    2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 17:03:44.822928 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822914    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822933    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822939    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822945    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822953    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822959    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822965    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822970    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822977    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822984    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 17:03:44.822997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.822993    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 17:03:44.823447 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.823438    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 17:03:44.823798 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.823752    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 17:03:44.823798 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.823752    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 17:03:44.824490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.824480    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 17:03:44.824523 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.824494    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 17:03:44.827557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.827543    2574 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 17:03:44.827612 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.827578    2574 server.go:1295] "Started kubelet"
May 27 17:03:44.827665 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.827631    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 17:03:44.827709 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.827661    2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 17:03:44.827752 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.827729    2574 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 17:03:44.828304 ip-10-0-134-95 systemd[1]: Started Kubernetes Kubelet.
May 27 17:03:44.829210 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.829139    2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 17:03:44.829992 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.829980    2574 server.go:317] "Adding debug handlers to kubelet server"
May 27 17:03:44.835643 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.835611    2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 17:03:44.836896 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.835753    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-95.ec2.internal.18b37aea620eddc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-95.ec2.internal,UID:ip-10-0-134-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-95.ec2.internal,},FirstTimestamp:2026-05-27 17:03:44.827555264 +0000 UTC m=+0.501980348,LastTimestamp:2026-05-27 17:03:44.827555264 +0000 UTC m=+0.501980348,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-95.ec2.internal,}"
May 27 17:03:44.837783 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.837755    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 17:03:44.837845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.837783    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 17:03:44.837985 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.837965    2574 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 17:03:44.837985 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.837981    2574 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 17:03:44.840230 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.839969    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:44.840332 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.839950    2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 17:03:44.840478 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.840462    2574 reconstruct.go:97] "Volume reconstruction finished"
May 27 17:03:44.840535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.840480    2574 reconciler.go:26] "Reconciler: start to sync state"
May 27 17:03:44.840940 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.840919    2574 factory.go:55] Registering systemd factory
May 27 17:03:44.841016 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.840943    2574 factory.go:223] Registration of the systemd container factory successfully
May 27 17:03:44.841348 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.841328    2574 factory.go:153] Registering CRI-O factory
May 27 17:03:44.841348 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.841349    2574 factory.go:223] Registration of the crio container factory successfully
May 27 17:03:44.841479 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.841465    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 17:03:44.841531 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.841496    2574 factory.go:103] Registering Raw factory
May 27 17:03:44.841531 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.841515    2574 manager.go:1196] Started watching for new ooms in manager
May 27 17:03:44.841910 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.841889    2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 17:03:44.842058 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.842040    2574 manager.go:319] Starting recovery of all containers
May 27 17:03:44.843229 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.843200    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 17:03:44.843377 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.843354    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 17:03:44.854694 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.854679    2574 manager.go:324] Recovery completed
May 27 17:03:44.858700 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.858687    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:44.861168 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861144    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:44.861240 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861181    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:44.861240 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861192    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:44.861665 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861649    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 17:03:44.861665 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861664    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 17:03:44.861776 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.861683    2574 state_mem.go:36] "Initialized new in-memory state store"
May 27 17:03:44.863631 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.863568    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-95.ec2.internal.18b37aea640fbf65  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-95.ec2.internal,UID:ip-10-0-134-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-95.ec2.internal,},FirstTimestamp:2026-05-27 17:03:44.861167461 +0000 UTC m=+0.535592545,LastTimestamp:2026-05-27 17:03:44.861167461 +0000 UTC m=+0.535592545,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-95.ec2.internal,}"
May 27 17:03:44.865677 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.865664    2574 policy_none.go:49] "None policy: Start"
May 27 17:03:44.865742 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.865680    2574 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 17:03:44.865742 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.865691    2574 state_mem.go:35] "Initializing new in-memory state store"
May 27 17:03:44.874814 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.874715    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-95.ec2.internal.18b37aea64100a4b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-95.ec2.internal,UID:ip-10-0-134-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-95.ec2.internal,},FirstTimestamp:2026-05-27 17:03:44.861186635 +0000 UTC m=+0.535611718,LastTimestamp:2026-05-27 17:03:44.861186635 +0000 UTC m=+0.535611718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-95.ec2.internal,}"
May 27 17:03:44.883289 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.883271    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldl5l"
May 27 17:03:44.889859 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.889841    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldl5l"
May 27 17:03:44.901393 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.901377    2574 manager.go:341] "Starting Device Plugin manager"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.901464    2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.901515    2574 server.go:85] "Starting device plugin registration server"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.901794    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.901810    2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.901953    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.902035    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.902043    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.902474    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 17:03:44.922616 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.902511    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:44.934164 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.934133    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 17:03:44.935381 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.935358    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 17:03:44.935457 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.935386    2574 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 17:03:44.935457 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.935409    2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 17:03:44.935457 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.935419    2574 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 17:03:44.935577 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:44.935463    2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 17:03:44.941796 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:44.941777    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:03:45.002627 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.002557    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:45.003775 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.003747    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:45.003873 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.003805    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:45.003873 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.003817    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:45.003873 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.003840    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-95.ec2.internal"
May 27 17:03:45.010244 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.010227    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-95.ec2.internal"
May 27 17:03:45.010325 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.010253    2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-95.ec2.internal\": node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.036116 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.036090    2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"]
May 27 17:03:45.036211 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.036158    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:45.036995 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.036981    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:45.037070 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.037007    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:45.037070 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.037016    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:45.038154 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038142    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:45.038313 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038300    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.038394 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038328    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:45.038849 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038833    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:45.038849 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038842    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:45.038968 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038867    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:45.038968 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038881    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:45.039054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.038868    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:45.039054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.039017    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:45.040026 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.040011    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.040093 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.040037    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 17:03:45.040684 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.040666    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
May 27 17:03:45.040684 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.040685    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
May 27 17:03:45.040823 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.040696    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
May 27 17:03:45.041072 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.041055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.041119 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.041089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.041119 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.041113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/804d458f95fa96a745eb8f8ad795da87-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"804d458f95fa96a745eb8f8ad795da87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.041494 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.041479    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.061524 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.061496    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-95.ec2.internal\" not found" node="ip-10-0-134-95.ec2.internal"
May 27 17:03:45.065785 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.065750    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-95.ec2.internal\" not found" node="ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141291    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141321    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/804d458f95fa96a745eb8f8ad795da87-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"804d458f95fa96a745eb8f8ad795da87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141339    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141384    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/804d458f95fa96a745eb8f8ad795da87-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"804d458f95fa96a745eb8f8ad795da87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.141535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.141403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2561c553d5ea81b843382ff9ea80f2da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"2561c553d5ea81b843382ff9ea80f2da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.142318 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.142303    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.243352 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.243310    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.344058 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.344006    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.364193 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.364168    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.368948 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.368927    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:45.444891 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.444857    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.545313 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.545283    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.645788 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.645709    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.733971 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.733933    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 17:03:45.734601 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.734108    2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 17:03:45.746305 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.746278    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.813679 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.813652    2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:03:45.838287 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.838267    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 17:03:45.846380 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.846358    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.860240 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.860217    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 17:03:45.892526 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.892493    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 16:58:44 +0000 UTC" deadline="2027-12-18 05:29:59.653212547 +0000 UTC"
May 27 17:03:45.892526 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.892523    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13668h26m13.760692368s"
May 27 17:03:45.898849 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.898804    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cgz4g"
May 27 17:03:45.906686 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.906665    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cgz4g"
May 27 17:03:45.946714 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:45.946678    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
May 27 17:03:45.959403 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:45.959374    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804d458f95fa96a745eb8f8ad795da87.slice/crio-f3ee96dbf18d5f8bba3d33abcda8b56ce7f73c8d27d2a2404830306185ba7f68 WatchSource:0}: Error finding container f3ee96dbf18d5f8bba3d33abcda8b56ce7f73c8d27d2a2404830306185ba7f68: Status 404 returned error can't find the container with id f3ee96dbf18d5f8bba3d33abcda8b56ce7f73c8d27d2a2404830306185ba7f68
May 27 17:03:45.959590 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:45.959570    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2561c553d5ea81b843382ff9ea80f2da.slice/crio-c0b4a7decedde48499c12f2441a5e8dbcaebff221c6aee8cc94ccd9cb93ffed1 WatchSource:0}: Error finding container c0b4a7decedde48499c12f2441a5e8dbcaebff221c6aee8cc94ccd9cb93ffed1: Status 404 returned error can't find the container with id c0b4a7decedde48499c12f2441a5e8dbcaebff221c6aee8cc94ccd9cb93ffed1
May 27 17:03:45.964364 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.963906    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:03:45.993233 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:45.993206    2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:03:46.041205 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.041177    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
May 27 17:03:46.051589 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.051571    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:03:46.052688 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.052668    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
May 27 17:03:46.063347 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.063328    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 17:03:46.233772 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.233736    2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:03:46.813470 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.813177    2574 apiserver.go:52] "Watching apiserver"
May 27 17:03:46.821752 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.821725    2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 17:03:46.824121 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.824091    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-m6s5t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal","openshift-multus/multus-kpj7d","openshift-multus/network-metrics-daemon-2bpp6","openshift-network-operator/iptables-alerter-6c6p4","openshift-ovn-kubernetes/ovnkube-node-2qpf5","kube-system/konnectivity-agent-whzk4","kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl","openshift-cluster-node-tuning-operator/tuned-6mzqw","openshift-dns/node-resolver-5kckj","openshift-multus/multus-additional-cni-plugins-7qv9m","openshift-network-diagnostics/network-check-target-flg2c"]
May 27 17:03:46.827596 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.827569    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.830136 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.830115    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 17:03:46.830266 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.830183    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 17:03:46.830702 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.830679    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlthx\""
May 27 17:03:46.833740 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.833720    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.834196 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.834056    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.834196 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:46.834154    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:46.836520 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.836502    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 17:03:46.836700 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.836641    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 17:03:46.836807 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.836716    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8wx8h\""
May 27 17:03:46.836871 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.836809    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 17:03:46.836871 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.836856    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 17:03:46.838739 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.838717    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.840943 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.840924    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.841061 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.841044    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.843023 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.842973    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 17:03:46.843145 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.843126    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ws592\""
May 27 17:03:46.843339 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.843321    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 17:03:46.843546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.843530    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 17:03:46.845667 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.845645    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.845980 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.845963    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.847629 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.847608    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9m4tt\""
May 27 17:03:46.847711 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.847681    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 17:03:46.847989 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.847971    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 17:03:46.848071 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848002    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:46.848330 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848308    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 17:03:46.848578 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-netd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.848657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-conf-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.848657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-etc-kubernetes\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.848657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1a34c0a-2993-4426-a340-a3e837e7bd65-agent-certs\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.848829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-system-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.848829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-hostroot\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.848829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848717    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-netns\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.848829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-ovn\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.848829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-env-overrides\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovn-node-metrics-cert\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-cnibin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-socket-dir-parent\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmx9v\" (UniqueName: \"kubernetes.io/projected/045a1e65-3426-4a6c-8824-9759a86b2f41-kube-api-access-xmx9v\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17c06fd9-ba01-4fa1-8107-d56419f7540a-iptables-alerter-script\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.848999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-systemd-units\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-k8s-cni-cncf-io\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-multus\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsb6\" (UniqueName: \"kubernetes.io/projected/17c06fd9-ba01-4fa1-8107-d56419f7540a-kube-api-access-dcsb6\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-slash\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-var-lib-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-etc-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-node-log\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849283    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-log-socket\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-bin\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-config\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1a34c0a-2993-4426-a340-a3e837e7bd65-konnectivity-ca\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-kubelet\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849520    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-systemd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849522    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvkq\" (UniqueName: \"kubernetes.io/projected/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-kube-api-access-4qvkq\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-serviceca\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-os-release\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.849828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849838    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzgp\" (UniqueName: \"kubernetes.io/projected/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-kube-api-access-pmzgp\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-cni-binary-copy\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-netns\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-bin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-kubelet\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-multus-daemon-config\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.849986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-multus-certs\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-script-lib\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-host\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850106    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh4h8\" (UniqueName: \"kubernetes.io/projected/757b3253-9e62-409a-9521-6763b37ac0fd-kube-api-access-lh4h8\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.850341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17c06fd9-ba01-4fa1-8107-d56419f7540a-host-slash\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.850862 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850350    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 17:03:46.850862 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850671    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 17:03:46.850862 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850796    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drgq7\""
May 27 17:03:46.851001 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.850905    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 17:03:46.851049 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851000    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 17:03:46.851160 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851146    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 17:03:46.851221 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851163    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 17:03:46.851221 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851216    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g57pr\""
May 27 17:03:46.851325 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851310    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k9h8t\""
May 27 17:03:46.851325 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851319    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 17:03:46.851414 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851380    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 17:03:46.851482 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851431    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 17:03:46.851482 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851453    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 17:03:46.851602 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.851584    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 17:03:46.852307 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.852287    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8t9d9\""
May 27 17:03:46.853339 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.853321    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:46.853339 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.853338    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.853480 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:46.853407    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:46.856091 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.856063    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 17:03:46.856091 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.856080    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qmqqj\""
May 27 17:03:46.856250 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.856069    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 17:03:46.908114 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.908082    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 16:58:45 +0000 UTC" deadline="2028-02-16 05:45:40.085466698 +0000 UTC"
May 27 17:03:46.908114 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.908115    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15108h41m53.177355342s"
May 27 17:03:46.939922 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.939879    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"2561c553d5ea81b843382ff9ea80f2da","Type":"ContainerStarted","Data":"c0b4a7decedde48499c12f2441a5e8dbcaebff221c6aee8cc94ccd9cb93ffed1"}
May 27 17:03:46.940844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.940818    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" event={"ID":"804d458f95fa96a745eb8f8ad795da87","Type":"ContainerStarted","Data":"f3ee96dbf18d5f8bba3d33abcda8b56ce7f73c8d27d2a2404830306185ba7f68"}
May 27 17:03:46.941356 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.941339    2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 17:03:46.950781 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950742    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-systemd-units\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.950891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950800    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.950891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950833    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-systemd-units\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.950891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-modprobe-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysconfig\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950928    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:46.950937    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950952    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17c06fd9-ba01-4fa1-8107-d56419f7540a-host-slash\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.950994    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-slash\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951019    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-var-lib-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951041    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-config\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951035    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17c06fd9-ba01-4fa1-8107-d56419f7540a-host-slash\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951064    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951088    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-os-release\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-run\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951112    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-slash\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhd6z\" (UniqueName: \"kubernetes.io/projected/8c50871b-0a8b-4252-98c7-8f65b052c082-kube-api-access-zhd6z\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951165    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-bin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951183    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-var-lib-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951189    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-kubelet\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951198    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951221    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-systemd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951228    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-kubelet\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951265    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-systemd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:46.951306    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:47.451259225 +0000 UTC m=+3.125684308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951317    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-bin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951328    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951354    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvkq\" (UniqueName: \"kubernetes.io/projected/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-kube-api-access-4qvkq\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.951438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951379    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-os-release\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951392    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzgp\" (UniqueName: \"kubernetes.io/projected/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-kube-api-access-pmzgp\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951416    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-kubelet\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951453    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-multus-daemon-config\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951488    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh4h8\" (UniqueName: \"kubernetes.io/projected/757b3253-9e62-409a-9521-6763b37ac0fd-kube-api-access-lh4h8\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49ms\" (UniqueName: \"kubernetes.io/projected/079358c4-a393-44f9-b9fa-1fc102d3406b-kube-api-access-z49ms\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951627    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951652    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-script-lib\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-tuned\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6m4l\" (UniqueName: \"kubernetes.io/projected/6f2ad909-a1f7-4238-acfe-211e3e614c8a-kube-api-access-z6m4l\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951733    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-netd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-kubernetes\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951819    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-netd\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-sys\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-tmp\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.952285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951874    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-kubelet\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/079358c4-a393-44f9-b9fa-1fc102d3406b-hosts-file\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951893    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-config\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951906    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951939    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951964    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-system-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.951987    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-hostroot\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952067    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-system-cni-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952108    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-netns\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952148    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-ovn\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952175    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-cnibin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952212    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmx9v\" (UniqueName: \"kubernetes.io/projected/045a1e65-3426-4a6c-8824-9759a86b2f41-kube-api-access-xmx9v\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-var-lib-kubelet\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952335    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-k8s-cni-cncf-io\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952362    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-multus\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952387    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsb6\" (UniqueName: \"kubernetes.io/projected/17c06fd9-ba01-4fa1-8107-d56419f7540a-kube-api-access-dcsb6\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqwgg\" (UniqueName: \"kubernetes.io/projected/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kube-api-access-gqwgg\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-conf\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952448    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-multus-daemon-config\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952501    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-run-ovn\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952549    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-system-cni-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952577    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovnkube-script-lib\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952592    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-hostroot\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952596    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-run-netns\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952623    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-var-lib-cni-multus\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952636    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-k8s-cni-cncf-io\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952640    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-cnibin\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952746    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-etc-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952816    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-etc-openvswitch\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952828    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-node-log\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.953791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952864    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-log-socket\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952889    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-bin\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-node-log\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952949    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-cni-binary-copy\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952950    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-cni-bin\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952921    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-log-socket\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.952984    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-netns\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953017    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-etc-kubernetes\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953125    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-netns\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953130    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1a34c0a-2993-4426-a340-a3e837e7bd65-konnectivity-ca\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953166    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-etc-kubernetes\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953219    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-serviceca\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953314    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-cnibin\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953352    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-os-release\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953398    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953431    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-multus-certs\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.954557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953478    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-host-run-multus-certs\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953482    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953484    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757b3253-9e62-409a-9521-6763b37ac0fd-cni-binary-copy\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-systemd\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-lib-modules\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953634    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-host\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953684    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-host\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953688    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-conf-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953723    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-conf-dir\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-device-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/079358c4-a393-44f9-b9fa-1fc102d3406b-tmp-dir\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953799    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1a34c0a-2993-4426-a340-a3e837e7bd65-agent-certs\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953801    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-serviceca\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-host\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:46.955248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953844    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-env-overrides\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953888    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovn-node-metrics-cert\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953980    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1a34c0a-2993-4426-a340-a3e837e7bd65-konnectivity-ca\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.953996    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-socket-dir-parent\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.954029    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17c06fd9-ba01-4fa1-8107-d56419f7540a-iptables-alerter-script\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.954126    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757b3253-9e62-409a-9521-6763b37ac0fd-multus-socket-dir-parent\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.954243    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.954337    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-env-overrides\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.955959 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.954520    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17c06fd9-ba01-4fa1-8107-d56419f7540a-iptables-alerter-script\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.958260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.958237    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-ovn-node-metrics-cert\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.958438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.958419    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1a34c0a-2993-4426-a340-a3e837e7bd65-agent-certs\") pod \"konnectivity-agent-whzk4\" (UID: \"f1a34c0a-2993-4426-a340-a3e837e7bd65\") " pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:46.961013 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.960992    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvkq\" (UniqueName: \"kubernetes.io/projected/a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc-kube-api-access-4qvkq\") pod \"ovnkube-node-2qpf5\" (UID: \"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:46.961228 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.961207    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzgp\" (UniqueName: \"kubernetes.io/projected/527d9373-6319-4a5a-a6cb-5f8939d5ebaa-kube-api-access-pmzgp\") pod \"node-ca-m6s5t\" (UID: \"527d9373-6319-4a5a-a6cb-5f8939d5ebaa\") " pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:46.962324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.962301    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmx9v\" (UniqueName: \"kubernetes.io/projected/045a1e65-3426-4a6c-8824-9759a86b2f41-kube-api-access-xmx9v\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:46.964061 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.964034    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsb6\" (UniqueName: \"kubernetes.io/projected/17c06fd9-ba01-4fa1-8107-d56419f7540a-kube-api-access-dcsb6\") pod \"iptables-alerter-6c6p4\" (UID: \"17c06fd9-ba01-4fa1-8107-d56419f7540a\") " pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:46.964663 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:46.964636    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh4h8\" (UniqueName: \"kubernetes.io/projected/757b3253-9e62-409a-9521-6763b37ac0fd-kube-api-access-lh4h8\") pod \"multus-kpj7d\" (UID: \"757b3253-9e62-409a-9521-6763b37ac0fd\") " pod="openshift-multus/multus-kpj7d"
May 27 17:03:47.054639 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054596    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.054639 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054642    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-cnibin\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054697    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-cnibin\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054718    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-os-release\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054738    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054752    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-systemd\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054787    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-lib-modules\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054804    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054829    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054856    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-device-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054880    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/079358c4-a393-44f9-b9fa-1fc102d3406b-tmp-dir\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.054923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054904    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-host\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054937    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-modprobe-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054960    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysconfig\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.054983    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055012    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-run\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055037    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhd6z\" (UniqueName: \"kubernetes.io/projected/8c50871b-0a8b-4252-98c7-8f65b052c082-kube-api-access-zhd6z\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055063    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055086    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055108    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z49ms\" (UniqueName: \"kubernetes.io/projected/079358c4-a393-44f9-b9fa-1fc102d3406b-kube-api-access-z49ms\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055135    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-tuned\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055161    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6m4l\" (UniqueName: \"kubernetes.io/projected/6f2ad909-a1f7-4238-acfe-211e3e614c8a-kube-api-access-z6m4l\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055190    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-kubernetes\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055210    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-sys\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055207    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055231    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-tmp\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055271    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/079358c4-a393-44f9-b9fa-1fc102d3406b-hosts-file\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysconfig\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.055385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055307    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055361    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-run\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055348    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-os-release\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055420    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055422    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055439    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055474    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055478    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-systemd\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055572    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/079358c4-a393-44f9-b9fa-1fc102d3406b-tmp-dir\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055624    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-lib-modules\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055651    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055674    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-host\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055734    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-modprobe-d\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055792    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055803    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-kubernetes\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055846    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/079358c4-a393-44f9-b9fa-1fc102d3406b-hosts-file\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055864    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-device-dir\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055901    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-sys\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056159 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055934    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055966    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-system-cni-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.055999    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-var-lib-kubelet\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056000    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b03cbec1-da38-40a2-8b5c-2890a7abf19e-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056039    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-system-cni-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056051    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqwgg\" (UniqueName: \"kubernetes.io/projected/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kube-api-access-gqwgg\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056080    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-conf\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056105    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056054    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-var-lib-kubelet\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056149    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056273    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-sysctl-conf\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c50871b-0a8b-4252-98c7-8f65b052c082-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.056914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.056886    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 17:03:47.057480 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.057304    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c50871b-0a8b-4252-98c7-8f65b052c082-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.058110 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.058084    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-tmp\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.058219 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.058202    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f2ad909-a1f7-4238-acfe-211e3e614c8a-etc-tuned\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.061341 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.061320    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:03:47.061442 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.061346    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:03:47.061442 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.061359    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:47.061442 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.061422    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:47.561405238 +0000 UTC m=+3.235830325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:47.063717 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.063668    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqwgg\" (UniqueName: \"kubernetes.io/projected/b03cbec1-da38-40a2-8b5c-2890a7abf19e-kube-api-access-gqwgg\") pod \"aws-ebs-csi-driver-node-hkjvl\" (UID: \"b03cbec1-da38-40a2-8b5c-2890a7abf19e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.064493 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.064470    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhd6z\" (UniqueName: \"kubernetes.io/projected/8c50871b-0a8b-4252-98c7-8f65b052c082-kube-api-access-zhd6z\") pod \"multus-additional-cni-plugins-7qv9m\" (UID: \"8c50871b-0a8b-4252-98c7-8f65b052c082\") " pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.064953 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.064937    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49ms\" (UniqueName: \"kubernetes.io/projected/079358c4-a393-44f9-b9fa-1fc102d3406b-kube-api-access-z49ms\") pod \"node-resolver-5kckj\" (UID: \"079358c4-a393-44f9-b9fa-1fc102d3406b\") " pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.065133 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.065113    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6m4l\" (UniqueName: \"kubernetes.io/projected/6f2ad909-a1f7-4238-acfe-211e3e614c8a-kube-api-access-z6m4l\") pod \"tuned-6mzqw\" (UID: \"6f2ad909-a1f7-4238-acfe-211e3e614c8a\") " pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.138151 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.138109    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:03:47.149117 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.149089    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpj7d"
May 27 17:03:47.160933 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.160903    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6c6p4"
May 27 17:03:47.166477 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.166460    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:03:47.175020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.174997    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6s5t"
May 27 17:03:47.182615 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.182597    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl"
May 27 17:03:47.191188 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.191166    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mzqw"
May 27 17:03:47.197739 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.197720    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kckj"
May 27 17:03:47.204249 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.204229    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qv9m"
May 27 17:03:47.459156 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.459125    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:47.459293 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.459242    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:47.459334 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.459300    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:48.459284365 +0000 UTC m=+4.133709436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:47.640532 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.640377    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757b3253_9e62_409a_9521_6763b37ac0fd.slice/crio-41576273d781b74e09ba4f75342fff59ba91fb5d5830578851e913549983fcb1 WatchSource:0}: Error finding container 41576273d781b74e09ba4f75342fff59ba91fb5d5830578851e913549983fcb1: Status 404 returned error can't find the container with id 41576273d781b74e09ba4f75342fff59ba91fb5d5830578851e913549983fcb1
May 27 17:03:47.641704 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.641678    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2ad909_a1f7_4238_acfe_211e3e614c8a.slice/crio-3709f53a7b5a1cf864e8c6d3dc7d59294ece5a20561a68f10841693c5059e3b1 WatchSource:0}: Error finding container 3709f53a7b5a1cf864e8c6d3dc7d59294ece5a20561a68f10841693c5059e3b1: Status 404 returned error can't find the container with id 3709f53a7b5a1cf864e8c6d3dc7d59294ece5a20561a68f10841693c5059e3b1
May 27 17:03:47.642961 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.642915    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a34c0a_2993_4426_a340_a3e837e7bd65.slice/crio-90f89a3532febf5864e59dc8577c6cca2181d3a9098132f5ee54df903f9a1d45 WatchSource:0}: Error finding container 90f89a3532febf5864e59dc8577c6cca2181d3a9098132f5ee54df903f9a1d45: Status 404 returned error can't find the container with id 90f89a3532febf5864e59dc8577c6cca2181d3a9098132f5ee54df903f9a1d45
May 27 17:03:47.648115 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.648077    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c8eb69_a1b9_4e29_89fb_5f9acd5ce0cc.slice/crio-908fbec74d41d3a3293ac1150e7a1f773b6f664976096f641125ec18b6d96cf5 WatchSource:0}: Error finding container 908fbec74d41d3a3293ac1150e7a1f773b6f664976096f641125ec18b6d96cf5: Status 404 returned error can't find the container with id 908fbec74d41d3a3293ac1150e7a1f773b6f664976096f641125ec18b6d96cf5
May 27 17:03:47.649278 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.649260    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527d9373_6319_4a5a_a6cb_5f8939d5ebaa.slice/crio-a8239bd56baf259b53e8e093adffa5ec0a41f394a9c7a1c7fae608a525b76dde WatchSource:0}: Error finding container a8239bd56baf259b53e8e093adffa5ec0a41f394a9c7a1c7fae608a525b76dde: Status 404 returned error can't find the container with id a8239bd56baf259b53e8e093adffa5ec0a41f394a9c7a1c7fae608a525b76dde
May 27 17:03:47.650008 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.649987    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c06fd9_ba01_4fa1_8107_d56419f7540a.slice/crio-89f05e5f8e8b485e03c4cd18339be53de791da8cd29ced642d675f23aae18d5c WatchSource:0}: Error finding container 89f05e5f8e8b485e03c4cd18339be53de791da8cd29ced642d675f23aae18d5c: Status 404 returned error can't find the container with id 89f05e5f8e8b485e03c4cd18339be53de791da8cd29ced642d675f23aae18d5c
May 27 17:03:47.660579 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.660557    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:47.660684 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.660673    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:03:47.660718 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.660689    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:03:47.660718 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.660698    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:47.660798 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.660737    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:48.66072547 +0000 UTC m=+4.335150540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:47.670888 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.670866    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03cbec1_da38_40a2_8b5c_2890a7abf19e.slice/crio-048d4464748a5d03182f1ce560d758c59960de8360bd42213e3001026a341898 WatchSource:0}: Error finding container 048d4464748a5d03182f1ce560d758c59960de8360bd42213e3001026a341898: Status 404 returned error can't find the container with id 048d4464748a5d03182f1ce560d758c59960de8360bd42213e3001026a341898
May 27 17:03:47.671531 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.671503    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c50871b_0a8b_4252_98c7_8f65b052c082.slice/crio-689af9addb0c48fd8c67608aa238cb715be12eebf7ece91b90bdee2d0b684bcb WatchSource:0}: Error finding container 689af9addb0c48fd8c67608aa238cb715be12eebf7ece91b90bdee2d0b684bcb: Status 404 returned error can't find the container with id 689af9addb0c48fd8c67608aa238cb715be12eebf7ece91b90bdee2d0b684bcb
May 27 17:03:47.672535 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:03:47.672459    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079358c4_a393_44f9_b9fa_1fc102d3406b.slice/crio-6b412f20c06da0e870968c91b342656989d2a16b566b28683ed292ee986bdb97 WatchSource:0}: Error finding container 6b412f20c06da0e870968c91b342656989d2a16b566b28683ed292ee986bdb97: Status 404 returned error can't find the container with id 6b412f20c06da0e870968c91b342656989d2a16b566b28683ed292ee986bdb97
May 27 17:03:47.908844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.908809    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 16:58:45 +0000 UTC" deadline="2028-03-05 09:01:06.502282396 +0000 UTC"
May 27 17:03:47.908844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.908838    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15543h57m18.593446314s"
May 27 17:03:47.936143 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.936119    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:47.936232 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:47.936212    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:47.943113 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.943088    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6c6p4" event={"ID":"17c06fd9-ba01-4fa1-8107-d56419f7540a","Type":"ContainerStarted","Data":"89f05e5f8e8b485e03c4cd18339be53de791da8cd29ced642d675f23aae18d5c"}
May 27 17:03:47.944185 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.944147    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mzqw" event={"ID":"6f2ad909-a1f7-4238-acfe-211e3e614c8a","Type":"ContainerStarted","Data":"3709f53a7b5a1cf864e8c6d3dc7d59294ece5a20561a68f10841693c5059e3b1"}
May 27 17:03:47.948210 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.948180    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpj7d" event={"ID":"757b3253-9e62-409a-9521-6763b37ac0fd","Type":"ContainerStarted","Data":"41576273d781b74e09ba4f75342fff59ba91fb5d5830578851e913549983fcb1"}
May 27 17:03:47.950943 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.950901    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" event={"ID":"804d458f95fa96a745eb8f8ad795da87","Type":"ContainerStarted","Data":"ec1e400559eb8622e13f84bbcf6cdd01698ec275725c5c2e561adbac4817af99"}
May 27 17:03:47.952239 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.952218    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kckj" event={"ID":"079358c4-a393-44f9-b9fa-1fc102d3406b","Type":"ContainerStarted","Data":"6b412f20c06da0e870968c91b342656989d2a16b566b28683ed292ee986bdb97"}
May 27 17:03:47.953059 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.953042    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerStarted","Data":"689af9addb0c48fd8c67608aa238cb715be12eebf7ece91b90bdee2d0b684bcb"}
May 27 17:03:47.953774 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.953745    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6s5t" event={"ID":"527d9373-6319-4a5a-a6cb-5f8939d5ebaa","Type":"ContainerStarted","Data":"a8239bd56baf259b53e8e093adffa5ec0a41f394a9c7a1c7fae608a525b76dde"}
May 27 17:03:47.954580 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.954563    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"908fbec74d41d3a3293ac1150e7a1f773b6f664976096f641125ec18b6d96cf5"}
May 27 17:03:47.955440 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.955408    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whzk4" event={"ID":"f1a34c0a-2993-4426-a340-a3e837e7bd65","Type":"ContainerStarted","Data":"90f89a3532febf5864e59dc8577c6cca2181d3a9098132f5ee54df903f9a1d45"}
May 27 17:03:47.956220 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.956203    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl" event={"ID":"b03cbec1-da38-40a2-8b5c-2890a7abf19e","Type":"ContainerStarted","Data":"048d4464748a5d03182f1ce560d758c59960de8360bd42213e3001026a341898"}
May 27 17:03:47.965173 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:47.965138    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" podStartSLOduration=1.965129103 podStartE2EDuration="1.965129103s" podCreationTimestamp="2026-05-27 17:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:03:47.964745 +0000 UTC m=+3.639170093" watchObservedRunningTime="2026-05-27 17:03:47.965129103 +0000 UTC m=+3.639554243"
May 27 17:03:48.466357 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:48.466318    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:48.466534 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.466475    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:48.466591 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.466541    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:50.466520474 +0000 UTC m=+6.140945545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:48.667613 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:48.666964    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:48.667613 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.667159    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:03:48.667613 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.667179    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:03:48.667613 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.667192    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:48.667613 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.667261    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:50.667241902 +0000 UTC m=+6.341666976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:48.939316 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:48.938824    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:48.939316 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:48.938953    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:48.968259 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:48.967137    2574 generic.go:358] "Generic (PLEG): container finished" podID="2561c553d5ea81b843382ff9ea80f2da" containerID="032a1d9cf56df086c225158ef50d051997ff427f5d0ba39c49e12d55d662e5f2" exitCode=0
May 27 17:03:48.968259 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:48.968033    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"2561c553d5ea81b843382ff9ea80f2da","Type":"ContainerDied","Data":"032a1d9cf56df086c225158ef50d051997ff427f5d0ba39c49e12d55d662e5f2"}
May 27 17:03:49.936379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:49.936342    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:49.936551 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:49.936487    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:49.984220 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:49.982728    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"2561c553d5ea81b843382ff9ea80f2da","Type":"ContainerStarted","Data":"bdb2074932136f5d57623cb17f77629921122717d154c6e1bbdae55e9aba03cd"}
May 27 17:03:50.480918 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:50.480818    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:50.481115 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.481038    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:50.481115 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.481104    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:54.481086257 +0000 UTC m=+10.155511332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:50.682657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:50.682621    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:50.682873 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.682853    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:03:50.682933 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.682880    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:03:50.682933 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.682893    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:50.683026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.682959    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:54.682933629 +0000 UTC m=+10.357358714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:50.936489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:50.936451    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:50.936667 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:50.936616    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:51.935645 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:51.935605    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:51.936117 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:51.935745    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:52.936297 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:52.936265    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:52.936746 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:52.936408    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:53.936179 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:53.936141    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:53.936352 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:53.936279    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:54.514164 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:54.514091    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:54.514342 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.514232    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:54.514342 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.514312    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:02.514291952 +0000 UTC m=+18.188717037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:03:54.715938 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:54.715876    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:54.716109 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.716054    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:03:54.716109 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.716072    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:03:54.716109 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.716083    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:54.716272 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.716143    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:02.716122097 +0000 UTC m=+18.390547170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:03:54.937295 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:54.937262    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:54.937754 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:54.937391    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:55.936152 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:55.936055    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:55.936313 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:55.936156    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:56.935941 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:56.935904    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:56.936357 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:56.936049    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:57.935664 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:57.935632    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:57.935865 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:57.935741    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:03:58.847402 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.847349    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" podStartSLOduration=12.847333409 podStartE2EDuration="12.847333409s" podCreationTimestamp="2026-05-27 17:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:03:49.999153379 +0000 UTC m=+5.673578473" watchObservedRunningTime="2026-05-27 17:03:58.847333409 +0000 UTC m=+14.521758504"
May 27 17:03:58.848008 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.847991    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kmrbw"]
May 27 17:03:58.851064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.851043    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:58.851143 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:58.851110    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:03:58.935731 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.935698    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:03:58.935905 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:58.935857    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:03:58.950015 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.949977    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:58.950208 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.950049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-dbus\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:58.950208 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:58.950086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-kubelet-config\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051178 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.051143    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051178 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.051179    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-dbus\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051383 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.051201    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-kubelet-config\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051383 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.051282    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-kubelet-config\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051496 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.051379    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b4b21f-be65-420b-99f5-d8e862bd5f19-dbus\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.051496 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:59.051433    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:03:59.051582 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:59.051497    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:03:59.551483624 +0000 UTC m=+15.225908695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:03:59.555312 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.555274    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:03:59.555482 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:59.555435    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:03:59.555533 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:59.555512    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:00.555493091 +0000 UTC m=+16.229918171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:03:59.935978 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:03:59.935943    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:03:59.936407 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:03:59.936062    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:00.561430 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:00.561399    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:00.561601 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:00.561574    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:04:00.561654 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:00.561644    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:02.561624999 +0000 UTC m=+18.236050083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:04:00.936094 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:00.936053    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:00.936515 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:00.936199    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:00.936515 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:00.936239    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:00.936515 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:00.936383    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:01.935999 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:01.935963    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:01.936253 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:01.936082    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:02.574432 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:02.574392    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:02.574596 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:02.574459    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:02.574596 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.574547    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:04:02.574694 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.574611    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:06.574597325 +0000 UTC m=+22.249022397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:04:02.574694 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.574547    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:04:02.574694 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.574644    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:18.574636693 +0000 UTC m=+34.249061763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:04:02.776083 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:02.776042    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:02.776268 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.776248    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:04:02.776317 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.776276    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:04:02.776317 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.776290    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:04:02.776401 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.776354    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:18.776336047 +0000 UTC m=+34.450761126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:04:02.938779 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:02.938739    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:02.939167 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.938867    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:02.939167 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:02.938949    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:02.939167 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:02.939051    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:03.935903 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:03.935867    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:03.936057 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:03.935989    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:04.937213 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:04.937187    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:04.937660 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:04.937289    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:04.937660 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:04.937371    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:04.937660 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:04.937465    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:05.935994 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:05.935710    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:05.936087 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:05.936069    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:06.013382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.013355    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mzqw" event={"ID":"6f2ad909-a1f7-4238-acfe-211e3e614c8a","Type":"ContainerStarted","Data":"665fbb59b9630aef009ba4e6bde0ba2d2c5afcc5e006a3beb8da3162a659456e"}
May 27 17:04:06.014669 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.014633    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpj7d" event={"ID":"757b3253-9e62-409a-9521-6763b37ac0fd","Type":"ContainerStarted","Data":"4db906ab152e9ffa191e73c00d524002e719389ae0958bbdb47c1a81c47b6bf0"}
May 27 17:04:06.015859 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.015838    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kckj" event={"ID":"079358c4-a393-44f9-b9fa-1fc102d3406b","Type":"ContainerStarted","Data":"a6d2070e0cb9983a1cbf1e7bdeb7865a0ad4be43c6796762c0e732776bc5a58f"}
May 27 17:04:06.017187 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.017165    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="551f7986c79ff851d3608ed68386a291441d38a59544ae47c2681454ebad7ce1" exitCode=0
May 27 17:04:06.017265 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.017193    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"551f7986c79ff851d3608ed68386a291441d38a59544ae47c2681454ebad7ce1"}
May 27 17:04:06.018504 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.018428    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6s5t" event={"ID":"527d9373-6319-4a5a-a6cb-5f8939d5ebaa","Type":"ContainerStarted","Data":"6fe262802751a6b6354a45095d6522ac791fc4d29a4eb80647b23689121d7073"}
May 27 17:04:06.020595 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020577    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:04:06.020861 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020841    2574 generic.go:358] "Generic (PLEG): container finished" podID="a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc" containerID="f580351b342efcd0db0274f8429258641de810192a274473ba96c26c965384ca" exitCode=1
May 27 17:04:06.020906 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020895    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"941a4be9a9a1b2a5360146480286f9e574e7bbb26d5b2647c5b0c44218ebd443"}
May 27 17:04:06.020954 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020913    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"482528db0e1b519dba76ba5140a16f9de45563db51eb2384af046fd6220d9758"}
May 27 17:04:06.020954 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020923    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"65299af6dd6d0b6db78bd3f56ee5c097f6889c7ae38898a65101f0eabbc50289"}
May 27 17:04:06.020954 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020932    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerDied","Data":"f580351b342efcd0db0274f8429258641de810192a274473ba96c26c965384ca"}
May 27 17:04:06.020954 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.020940    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"15b780a9a0e1622c04478d0f70fc5710c37ef306da4cbb66fcc64c62ffc88494"}
May 27 17:04:06.022003 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.021979    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whzk4" event={"ID":"f1a34c0a-2993-4426-a340-a3e837e7bd65","Type":"ContainerStarted","Data":"d0feaebc549ccb08577ff4e1eaeb5e619c1e4e0755957b737f05020dd8f1d742"}
May 27 17:04:06.023222 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.023206    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl" event={"ID":"b03cbec1-da38-40a2-8b5c-2890a7abf19e","Type":"ContainerStarted","Data":"62b2150f5619d3f158f630a9c0f36651410dd596a2516c2576358e1d6abba76b"}
May 27 17:04:06.029025 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.028990    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6mzqw" podStartSLOduration=3.451196224 podStartE2EDuration="21.028979889s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.6458762 +0000 UTC m=+3.320301275" lastFinishedPulling="2026-05-27 17:04:05.223659855 +0000 UTC m=+20.898084940" observedRunningTime="2026-05-27 17:04:06.028823342 +0000 UTC m=+21.703248436" watchObservedRunningTime="2026-05-27 17:04:06.028979889 +0000 UTC m=+21.703405013"
May 27 17:04:06.062509 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.062471    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5kckj" podStartSLOduration=3.509003844 podStartE2EDuration="21.062457746s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.674674024 +0000 UTC m=+3.349099111" lastFinishedPulling="2026-05-27 17:04:05.228127925 +0000 UTC m=+20.902553013" observedRunningTime="2026-05-27 17:04:06.04293942 +0000 UTC m=+21.717364514" watchObservedRunningTime="2026-05-27 17:04:06.062457746 +0000 UTC m=+21.736882839"
May 27 17:04:06.062716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.062696    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kpj7d" podStartSLOduration=3.483074544 podStartE2EDuration="21.062690854s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.644577352 +0000 UTC m=+3.319002436" lastFinishedPulling="2026-05-27 17:04:05.224193662 +0000 UTC m=+20.898618746" observedRunningTime="2026-05-27 17:04:06.062293054 +0000 UTC m=+21.736718147" watchObservedRunningTime="2026-05-27 17:04:06.062690854 +0000 UTC m=+21.737115947"
May 27 17:04:06.079895 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.079849    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m6s5t" podStartSLOduration=3.55966317 podStartE2EDuration="21.079835815s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.669925974 +0000 UTC m=+3.344351059" lastFinishedPulling="2026-05-27 17:04:05.190098625 +0000 UTC m=+20.864523704" observedRunningTime="2026-05-27 17:04:06.079348515 +0000 UTC m=+21.753773608" watchObservedRunningTime="2026-05-27 17:04:06.079835815 +0000 UTC m=+21.754260908"
May 27 17:04:06.115333 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.115260    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-whzk4" podStartSLOduration=3.5381588280000003 podStartE2EDuration="21.115241595s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.646575639 +0000 UTC m=+3.321000720" lastFinishedPulling="2026-05-27 17:04:05.223658406 +0000 UTC m=+20.898083487" observedRunningTime="2026-05-27 17:04:06.114917423 +0000 UTC m=+21.789342517" watchObservedRunningTime="2026-05-27 17:04:06.115241595 +0000 UTC m=+21.789666688"
May 27 17:04:06.605685 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.605602    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:06.605883 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:06.605746    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:04:06.605883 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:06.605827    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:14.605812225 +0000 UTC m=+30.280237297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:04:06.835681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.835511    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 17:04:06.915251 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.915142    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T17:04:06.835677789Z","UUID":"b77fc88a-6035-4434-beb8-9d0a32409864","Handler":null,"Name":"","Endpoint":""}
May 27 17:04:06.916889 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.916866    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 17:04:06.917008 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.916896    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 17:04:06.935828 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.935804    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:06.935941 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:06.935916    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:06.935998 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:06.935984    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:06.936089 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:06.936071    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:07.028529 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:07.028501    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:04:07.028994 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:07.028886    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"bc9514d5a1f1fff43bdd827d8aae643e475103d0fb2186941a877b64f7aa7ac9"}
May 27 17:04:07.030556 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:07.030523    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl" event={"ID":"b03cbec1-da38-40a2-8b5c-2890a7abf19e","Type":"ContainerStarted","Data":"6377a42f9e2c68a1773455d6961100e47b22c5e3a71a3a1f4200a77c4722b6f8"}
May 27 17:04:07.935813 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:07.935755    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:07.935994 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:07.935888    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:08.034420 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.034334    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl" event={"ID":"b03cbec1-da38-40a2-8b5c-2890a7abf19e","Type":"ContainerStarted","Data":"e2c61df593ddaec51fa208efd87b966ba16b04df3896d3b7b9892ad79c084fa5"}
May 27 17:04:08.036010 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.035979    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6c6p4" event={"ID":"17c06fd9-ba01-4fa1-8107-d56419f7540a","Type":"ContainerStarted","Data":"29bf03daefd7efddd9e623eb149a4eff0e3ac995d7da4eeeaaa9cf2a788703f4"}
May 27 17:04:08.053663 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.053621    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjvl" podStartSLOduration=2.976068027 podStartE2EDuration="23.053609049s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.674451777 +0000 UTC m=+3.348876863" lastFinishedPulling="2026-05-27 17:04:07.751992813 +0000 UTC m=+23.426417885" observedRunningTime="2026-05-27 17:04:08.052949755 +0000 UTC m=+23.727374850" watchObservedRunningTime="2026-05-27 17:04:08.053609049 +0000 UTC m=+23.728034142"
May 27 17:04:08.071114 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.071076    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6c6p4" podStartSLOduration=5.517371633 podStartE2EDuration="23.071063684s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.669979337 +0000 UTC m=+3.344404420" lastFinishedPulling="2026-05-27 17:04:05.223671385 +0000 UTC m=+20.898096471" observedRunningTime="2026-05-27 17:04:08.070989055 +0000 UTC m=+23.745414148" watchObservedRunningTime="2026-05-27 17:04:08.071063684 +0000 UTC m=+23.745488776"
May 27 17:04:08.936196 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.936163    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:08.936383 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:08.936163    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:08.936383 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:08.936347    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:08.936497 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:08.936474    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:09.041487 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:09.041460    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:04:09.042035 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:09.041838    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"60f57b22d7274cd13d0fd8ce15d9195382b2894539770fb73ed2a3d91ade8802"}
May 27 17:04:09.756044 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:09.756005    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:04:09.756818 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:09.756792    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:04:09.936228 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:09.936199    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:09.936384 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:09.936312    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:10.936607 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:10.936375    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:10.937249 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:10.936446    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:10.937249 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:10.936716    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:10.937249 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:10.936826    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:11.048900 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.048734    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"ea0433add2485929d3b828ef9536801814486076ec8a9f7f3ca6f872f4ff61c4"}
May 27 17:04:11.048900 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.048692    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="ea0433add2485929d3b828ef9536801814486076ec8a9f7f3ca6f872f4ff61c4" exitCode=0
May 27 17:04:11.052235 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.052220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:04:11.052535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.052515    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"e044d918dc001ab7ce98d15e7c22c8ac91da77505feaf8d4f1e3918d4fd17f67"}
May 27 17:04:11.052803 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.052786    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:11.052887 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.052809    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:11.052950 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.052934    2574 scope.go:117] "RemoveContainer" containerID="f580351b342efcd0db0274f8429258641de810192a274473ba96c26c965384ca"
May 27 17:04:11.067920 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.067898    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:11.936513 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:11.936483    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:11.936713 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:11.936592    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:12.003869 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.003841    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:04:12.009438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.009410    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 17:04:12.011284 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.011259    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-whzk4"
May 27 17:04:12.073777 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.073738    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:04:12.075035 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.074930    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" event={"ID":"a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc","Type":"ContainerStarted","Data":"890ac97e95ef35e1f04093b8da7c38cadf8b3670d614b15580d68e922ace8c12"}
May 27 17:04:12.075035 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.074994    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:12.100509 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.100483    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:12.103224 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.103186    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5" podStartSLOduration=9.25153965 podStartE2EDuration="27.103170564s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.669977867 +0000 UTC m=+3.344402952" lastFinishedPulling="2026-05-27 17:04:05.521608781 +0000 UTC m=+21.196033866" observedRunningTime="2026-05-27 17:04:12.101462852 +0000 UTC m=+27.775887947" watchObservedRunningTime="2026-05-27 17:04:12.103170564 +0000 UTC m=+27.777595656"
May 27 17:04:12.754388 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.754354    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-flg2c"]
May 27 17:04:12.754570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.754485    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:12.754636 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:12.754583    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:12.758532 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.758510    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmrbw"]
May 27 17:04:12.758619 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.758599    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:12.758682 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:12.758665    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:12.761365 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.761345    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2bpp6"]
May 27 17:04:12.761463 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:12.761434    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:12.761522 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:12.761504    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:13.077668 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:13.077594    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="f4055f924f0dc5dd35c98fa0f2b40ef2812cd0601feec8086796f2c6951f2394" exitCode=0
May 27 17:04:13.078025 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:13.077688    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"f4055f924f0dc5dd35c98fa0f2b40ef2812cd0601feec8086796f2c6951f2394"}
May 27 17:04:14.080850 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.080740    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="8dcc15943fa5b4c7ad04aa09be7f509d8ef825919f8209355cafbfae397fdb6a" exitCode=0
May 27 17:04:14.080850 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.080826    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"8dcc15943fa5b4c7ad04aa09be7f509d8ef825919f8209355cafbfae397fdb6a"}
May 27 17:04:14.671006 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.670713    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:14.674654 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:14.670933    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 17:04:14.674654 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:14.671459    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret podName:e9b4b21f-be65-420b-99f5-d8e862bd5f19 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:30.671423328 +0000 UTC m=+46.345848418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret") pod "global-pull-secret-syncer-kmrbw" (UID: "e9b4b21f-be65-420b-99f5-d8e862bd5f19") : object "kube-system"/"original-pull-secret" not registered
May 27 17:04:14.936923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.936851    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:14.937064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.936958    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:14.937064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:14.937008    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:14.937162 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:14.937069    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:14.937162 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:14.937094    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:14.937269 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:14.937181    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:16.936264 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:16.936231    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:16.936827 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:16.936231    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:16.936827 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:16.936343    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmrbw" podUID="e9b4b21f-be65-420b-99f5-d8e862bd5f19"
May 27 17:04:16.936827 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:16.936442    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2bpp6" podUID="045a1e65-3426-4a6c-8824-9759a86b2f41"
May 27 17:04:16.936827 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:16.936230    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:16.936827 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:16.936532    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-flg2c" podUID="03864533-69f6-472f-aded-fadb6c434188"
May 27 17:04:18.130823 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.130793    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeReady"
May 27 17:04:18.131266 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.130948    2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 17:04:18.163982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.163861    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ccb6985db-bqnm5"]
May 27 17:04:18.169777 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.169739    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.172495 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.172467    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 17:04:18.172865 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.172842    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 17:04:18.172865 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.172857    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 17:04:18.173033 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.172846    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wxl9c\""
May 27 17:04:18.178382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.178365    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 17:04:18.178382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.178379    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fh2gk"]
May 27 17:04:18.180165 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.180142    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.181001 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.180954    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ccb6985db-bqnm5"]
May 27 17:04:18.182570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.182549    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 17:04:18.182971 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.182953    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 17:04:18.182971 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.182961    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 17:04:18.183228 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.183011    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m66z9\""
May 27 17:04:18.193415 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.193394    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fh2gk"]
May 27 17:04:18.275972 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.275941    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4jst8"]
May 27 17:04:18.277865 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.277843    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.280789 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.280769    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 17:04:18.280789 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.280785    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9xjp\""
May 27 17:04:18.280961 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.280816    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 17:04:18.288068 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.288046    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jst8"]
May 27 17:04:18.295785 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.295927 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.295927 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.295927 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295907    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295977    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.295998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbhc\" (UniqueName: \"kubernetes.io/projected/c714b343-7f2e-4206-888a-a4f51f806b26-kube-api-access-ppbhc\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.296033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.296053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.296089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.296069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzskr\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397407 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397377    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397407 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397412    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbhc\" (UniqueName: \"kubernetes.io/projected/c714b343-7f2e-4206-888a-a4f51f806b26-kube-api-access-ppbhc\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397441    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c054a79-8078-4a64-8e25-3465fd819536-config-volume\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397503    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397520    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzskr\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c054a79-8078-4a64-8e25-3465fd819536-tmp-dir\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpcm\" (UniqueName: \"kubernetes.io/projected/8c054a79-8078-4a64-8e25-3465fd819536-kube-api-access-grpcm\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397596    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.397652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397647    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397682    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397709    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397734    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.397778    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.397861    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.397879    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:18.398092 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.397940    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:18.897916907 +0000 UTC m=+34.572341992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:18.398466 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.398144    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.398466 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.398208    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:18.398466 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.398267    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:18.898251233 +0000 UTC m=+34.572676303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:18.398609 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.398482    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.398659 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.398608    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.402199 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.402175    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.402199 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.402194    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.407235 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.407207    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.407364 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.407272    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbhc\" (UniqueName: \"kubernetes.io/projected/c714b343-7f2e-4206-888a-a4f51f806b26-kube-api-access-ppbhc\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.407364 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.407324    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzskr\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.498929 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.498841    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.499095 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.498942    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c054a79-8078-4a64-8e25-3465fd819536-config-volume\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.499095 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.498972    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c054a79-8078-4a64-8e25-3465fd819536-tmp-dir\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.499095 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.498996    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grpcm\" (UniqueName: \"kubernetes.io/projected/8c054a79-8078-4a64-8e25-3465fd819536-kube-api-access-grpcm\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.499095 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.499008    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:18.499286 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.499098    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:18.999076805 +0000 UTC m=+34.673501893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:18.499438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.499403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c054a79-8078-4a64-8e25-3465fd819536-tmp-dir\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.499622 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.499606    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c054a79-8078-4a64-8e25-3465fd819536-config-volume\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.508882 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.508851    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpcm\" (UniqueName: \"kubernetes.io/projected/8c054a79-8078-4a64-8e25-3465fd819536-kube-api-access-grpcm\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:18.600363 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.600328    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:18.600514 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.600489    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:04:18.600577 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.600569    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:50.600550096 +0000 UTC m=+66.274975182 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 17:04:18.802110 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.802026    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:18.802247 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.802153    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 17:04:18.802247 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.802188    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 17:04:18.802247 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.802197    2574 projected.go:194] Error preparing data for projected volume kube-api-access-tw9wm for pod openshift-network-diagnostics/network-check-target-flg2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:04:18.802247 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.802246    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm podName:03864533-69f6-472f-aded-fadb6c434188 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:50.802232082 +0000 UTC m=+66.476657153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tw9wm" (UniqueName: "kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm") pod "network-check-target-flg2c" (UID: "03864533-69f6-472f-aded-fadb6c434188") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 17:04:18.902878 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.902831    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:18.902961 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.902906    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:18.903010 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.902981    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:18.903010 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.902999    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:18.903010 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.903009    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:18.903099 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.903041    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:19.90302588 +0000 UTC m=+35.577450951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:18.903099 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:18.903055    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:19.903049269 +0000 UTC m=+35.577474340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:18.936060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.936031    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:18.936220 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.936031    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:18.936220 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.936031    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:18.939285 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.939253    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 17:04:18.939445 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.939385    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxpwr\""
May 27 17:04:18.939565 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.939511    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 17:04:18.939565 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.939511    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 17:04:18.939690 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.939612    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:04:18.940177 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:18.940157    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck6cl\""
May 27 17:04:19.003844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:19.003812    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:19.004010 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.003969    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:19.004058 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.004053    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:20.004035618 +0000 UTC m=+35.678460689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:19.910969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:19.910932    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:19.911050    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.911097    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.911119    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.911176    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:21.911156808 +0000 UTC m=+37.585581879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.911211    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:19.911724 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:19.911274    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:21.911258274 +0000 UTC m=+37.585683352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:20.012312 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:20.012279    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:20.012504 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:20.012439    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:20.012555 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:20.012521    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:22.012505215 +0000 UTC m=+37.686930290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:21.927230 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:21.927015    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:21.927275    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:21.927163    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:21.927357    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:25.927338002 +0000 UTC m=+41.601763090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:21.927391    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:21.927403    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:21.927590 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:21.927446    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:25.927426925 +0000 UTC m=+41.601852000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:22.028148 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:22.028115    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:22.028302 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:22.028271    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:22.028348 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:22.028338    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:26.028323263 +0000 UTC m=+41.702748335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:22.098680 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:22.098590    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="444908238a08f194738d65b134aee47d1e94a9c86eef80e35be6b23ad83553c0" exitCode=0
May 27 17:04:22.098680 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:22.098648    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"444908238a08f194738d65b134aee47d1e94a9c86eef80e35be6b23ad83553c0"}
May 27 17:04:23.103127 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:23.103088    2574 generic.go:358] "Generic (PLEG): container finished" podID="8c50871b-0a8b-4252-98c7-8f65b052c082" containerID="f46e36af6482686d6eaf3a8f1a25ecff87fba0d9cfd8bdf68f27284c584dff87" exitCode=0
May 27 17:04:23.103493 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:23.103139    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerDied","Data":"f46e36af6482686d6eaf3a8f1a25ecff87fba0d9cfd8bdf68f27284c584dff87"}
May 27 17:04:24.107778 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:24.107732    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" event={"ID":"8c50871b-0a8b-4252-98c7-8f65b052c082","Type":"ContainerStarted","Data":"67d40c8ebf32ab4c0ec5117bb6d3f0d04fbcf5779dc8b92126f79f4e5d7286db"}
May 27 17:04:24.132270 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:24.132221    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7qv9m" podStartSLOduration=5.230886652 podStartE2EDuration="39.132206206s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:03:47.674408282 +0000 UTC m=+3.348833356" lastFinishedPulling="2026-05-27 17:04:21.575727834 +0000 UTC m=+37.250152910" observedRunningTime="2026-05-27 17:04:24.131586469 +0000 UTC m=+39.806011562" watchObservedRunningTime="2026-05-27 17:04:24.132206206 +0000 UTC m=+39.806631298"
May 27 17:04:25.960678 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:25.960633    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:25.960734    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:25.960818    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:25.960842    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:25.960877    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:25.960898    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:33.960883001 +0000 UTC m=+49.635308072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:25.961118 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:25.960926    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:33.960913906 +0000 UTC m=+49.635338977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:26.061998 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:26.061961    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:26.062148 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:26.062112    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:26.062196 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:26.062175    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:34.062157058 +0000 UTC m=+49.736582130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:30.699145 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:30.699103    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:30.702299 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:30.702264    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b4b21f-be65-420b-99f5-d8e862bd5f19-original-pull-secret\") pod \"global-pull-secret-syncer-kmrbw\" (UID: \"e9b4b21f-be65-420b-99f5-d8e862bd5f19\") " pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:30.949221 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:30.949134    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmrbw"
May 27 17:04:31.107822 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:31.107786    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmrbw"]
May 27 17:04:31.111466 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:04:31.111420    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b4b21f_be65_420b_99f5_d8e862bd5f19.slice/crio-d1589dc592d35e8469f77229be87e3eb13b44677ab7596d874ec874d0114523a WatchSource:0}: Error finding container d1589dc592d35e8469f77229be87e3eb13b44677ab7596d874ec874d0114523a: Status 404 returned error can't find the container with id d1589dc592d35e8469f77229be87e3eb13b44677ab7596d874ec874d0114523a
May 27 17:04:31.120193 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:31.120168    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmrbw" event={"ID":"e9b4b21f-be65-420b-99f5-d8e862bd5f19","Type":"ContainerStarted","Data":"d1589dc592d35e8469f77229be87e3eb13b44677ab7596d874ec874d0114523a"}
May 27 17:04:34.027451 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:34.027405    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:34.027481    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.027584    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.027622    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.027636    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.027666    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:50.027644703 +0000 UTC m=+65.702069776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:34.028030 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.027686    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:50.027676712 +0000 UTC m=+65.702101789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:34.128132 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:34.128105    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:34.128277 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.128242    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:34.128326 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:34.128297    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:04:50.128282851 +0000 UTC m=+65.802707921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:37.133146 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:37.133108    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmrbw" event={"ID":"e9b4b21f-be65-420b-99f5-d8e862bd5f19","Type":"ContainerStarted","Data":"ceb840e09b4fd1874e59e3a1186b74cca900bfe902c4e7767ab11dcfcf5b2685"}
May 27 17:04:37.149556 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:37.149503    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kmrbw" podStartSLOduration=34.096904438 podStartE2EDuration="39.149488305s" podCreationTimestamp="2026-05-27 17:03:58 +0000 UTC" firstStartedPulling="2026-05-27 17:04:31.113212307 +0000 UTC m=+46.787637377" lastFinishedPulling="2026-05-27 17:04:36.16579617 +0000 UTC m=+51.840221244" observedRunningTime="2026-05-27 17:04:37.148840663 +0000 UTC m=+52.823265755" watchObservedRunningTime="2026-05-27 17:04:37.149488305 +0000 UTC m=+52.823913398"
May 27 17:04:44.091548 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:44.091522    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qpf5"
May 27 17:04:45.461839 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.461803    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"]
May 27 17:04:45.465233 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.465217    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.468127 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.468107    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 17:04:45.469357 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.469340    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 17:04:45.469454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.469344    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 17:04:45.469454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.469373    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qh2vh\""
May 27 17:04:45.469454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.469361    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 17:04:45.473677 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.473657    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"]
May 27 17:04:45.483013 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.482993    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"]
May 27 17:04:45.485209 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.485197    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.487795 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.487776    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 27 17:04:45.500265 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.500243    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"]
May 27 17:04:45.509823 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.509806    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.509949 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.509874    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfjw\" (UniqueName: \"kubernetes.io/projected/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-kube-api-access-7kfjw\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.510013 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.509994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpw6\" (UniqueName: \"kubernetes.io/projected/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-kube-api-access-kbpw6\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.510068 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.510042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.510119 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.510091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-tmp\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.610916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.610881    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.611093 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.610952    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfjw\" (UniqueName: \"kubernetes.io/projected/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-kube-api-access-7kfjw\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.611156 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.611133    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpw6\" (UniqueName: \"kubernetes.io/projected/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-kube-api-access-kbpw6\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.611206 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.611191    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.611258 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.611244    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-tmp\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.611586 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.611567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-tmp\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.613369 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.613348    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.613486 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.613467    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.619529 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.619510    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfjw\" (UniqueName: \"kubernetes.io/projected/0b5469fe-4fce-49a6-86d4-1a194b66f6ec-kube-api-access-7kfjw\") pod \"klusterlet-addon-workmgr-5fdc9dd5b9-dgkch\" (UID: \"0b5469fe-4fce-49a6-86d4-1a194b66f6ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.619733 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.619716    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpw6\" (UniqueName: \"kubernetes.io/projected/8ddc0c3b-ec4a-475c-ade2-ca86447746a0-kube-api-access-kbpw6\") pod \"managed-serviceaccount-addon-agent-69b7d6f864-ltdlt\" (UID: \"8ddc0c3b-ec4a-475c-ade2-ca86447746a0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.786064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.785972    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"
May 27 17:04:45.793913 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.793876    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:45.914838 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.914788    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt"]
May 27 17:04:45.920849 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:04:45.918354    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddc0c3b_ec4a_475c_ade2_ca86447746a0.slice/crio-2a2589f449bc1432f4576c6dfec8ae47d332ebb1db910ae79487dc8008285868 WatchSource:0}: Error finding container 2a2589f449bc1432f4576c6dfec8ae47d332ebb1db910ae79487dc8008285868: Status 404 returned error can't find the container with id 2a2589f449bc1432f4576c6dfec8ae47d332ebb1db910ae79487dc8008285868
May 27 17:04:45.928050 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:45.928025    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"]
May 27 17:04:45.930599 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:04:45.930577    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5469fe_4fce_49a6_86d4_1a194b66f6ec.slice/crio-f4d6147f97b20897a5b616834e6f4b20d92b22d63595695328d288ed8aa2c70a WatchSource:0}: Error finding container f4d6147f97b20897a5b616834e6f4b20d92b22d63595695328d288ed8aa2c70a: Status 404 returned error can't find the container with id f4d6147f97b20897a5b616834e6f4b20d92b22d63595695328d288ed8aa2c70a
May 27 17:04:46.149158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:46.149073    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch" event={"ID":"0b5469fe-4fce-49a6-86d4-1a194b66f6ec","Type":"ContainerStarted","Data":"f4d6147f97b20897a5b616834e6f4b20d92b22d63595695328d288ed8aa2c70a"}
May 27 17:04:46.149958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:46.149935    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt" event={"ID":"8ddc0c3b-ec4a-475c-ade2-ca86447746a0","Type":"ContainerStarted","Data":"2a2589f449bc1432f4576c6dfec8ae47d332ebb1db910ae79487dc8008285868"}
May 27 17:04:50.045201 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.045157    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.045237    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.045327    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.045357    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.045373    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.045401    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:05:22.045381407 +0000 UTC m=+97.719806482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:04:50.045649 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.045429    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:05:22.045411386 +0000 UTC m=+97.719836457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:04:50.146172 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.146127    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:04:50.146316 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.146288    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:04:50.146369 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.146354    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:05:22.146338597 +0000 UTC m=+97.820763668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:04:50.650167 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.650131    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:04:50.652708 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.652688    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 17:04:50.661056 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.661036    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 17:04:50.661208 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:04:50.661121    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs podName:045a1e65-3426-4a6c-8824-9759a86b2f41 nodeName:}" failed. No retries permitted until 2026-05-27 17:05:54.661103197 +0000 UTC m=+130.335528273 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs") pod "network-metrics-daemon-2bpp6" (UID: "045a1e65-3426-4a6c-8824-9759a86b2f41") : secret "metrics-daemon-secret" not found
May 27 17:04:50.851914 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.851874    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:50.855062 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.855038    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 17:04:50.864528 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.864505    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 17:04:50.874974 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:50.874948    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw9wm\" (UniqueName: \"kubernetes.io/projected/03864533-69f6-472f-aded-fadb6c434188-kube-api-access-tw9wm\") pod \"network-check-target-flg2c\" (UID: \"03864533-69f6-472f-aded-fadb6c434188\") " pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:51.058561 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.058490    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck6cl\""
May 27 17:04:51.066724 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.066699    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:51.162094 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.162061    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt" event={"ID":"8ddc0c3b-ec4a-475c-ade2-ca86447746a0","Type":"ContainerStarted","Data":"339ec4df7f8413ea29532d90b237072ef6f8a488f7c02066b29d0bfbce8fe4db"}
May 27 17:04:51.163457 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.163429    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch" event={"ID":"0b5469fe-4fce-49a6-86d4-1a194b66f6ec","Type":"ContainerStarted","Data":"6111b5b327794821642ed8b3210f538f5031e5b8aed5947a3b3602f7f9ef9bec"}
May 27 17:04:51.163652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.163641    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:51.165219 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.165195    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch"
May 27 17:04:51.176633 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.176574    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b7d6f864-ltdlt" podStartSLOduration=1.693262577 podStartE2EDuration="6.176557242s" podCreationTimestamp="2026-05-27 17:04:45 +0000 UTC" firstStartedPulling="2026-05-27 17:04:45.92203631 +0000 UTC m=+61.596461384" lastFinishedPulling="2026-05-27 17:04:50.405330978 +0000 UTC m=+66.079756049" observedRunningTime="2026-05-27 17:04:51.176309423 +0000 UTC m=+66.850734517" watchObservedRunningTime="2026-05-27 17:04:51.176557242 +0000 UTC m=+66.850982335"
May 27 17:04:51.187477 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.187449    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-flg2c"]
May 27 17:04:51.190929 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:04:51.190902    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03864533_69f6_472f_aded_fadb6c434188.slice/crio-f8d0189ec3edbf9fa27ddd865db18668dcafe909f9c390f822dd08f10ef97854 WatchSource:0}: Error finding container f8d0189ec3edbf9fa27ddd865db18668dcafe909f9c390f822dd08f10ef97854: Status 404 returned error can't find the container with id f8d0189ec3edbf9fa27ddd865db18668dcafe909f9c390f822dd08f10ef97854
May 27 17:04:51.195130 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:51.195080    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fdc9dd5b9-dgkch" podStartSLOduration=1.665970449 podStartE2EDuration="6.19506286s" podCreationTimestamp="2026-05-27 17:04:45 +0000 UTC" firstStartedPulling="2026-05-27 17:04:45.93206099 +0000 UTC m=+61.606486062" lastFinishedPulling="2026-05-27 17:04:50.461153401 +0000 UTC m=+66.135578473" observedRunningTime="2026-05-27 17:04:51.193991148 +0000 UTC m=+66.868416235" watchObservedRunningTime="2026-05-27 17:04:51.19506286 +0000 UTC m=+66.869487953"
May 27 17:04:52.166811 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:52.166750    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-flg2c" event={"ID":"03864533-69f6-472f-aded-fadb6c434188","Type":"ContainerStarted","Data":"f8d0189ec3edbf9fa27ddd865db18668dcafe909f9c390f822dd08f10ef97854"}
May 27 17:04:55.173519 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:55.173482    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-flg2c" event={"ID":"03864533-69f6-472f-aded-fadb6c434188","Type":"ContainerStarted","Data":"22a9f9f4f0f4bcb2da89e2031e211dbcf8e236a2f3e851a7618838d176f90e69"}
May 27 17:04:55.173926 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:55.173599    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:04:55.189145 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:04:55.189090    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-flg2c" podStartSLOduration=66.937959203 podStartE2EDuration="1m10.189073722s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:04:51.192966115 +0000 UTC m=+66.867391186" lastFinishedPulling="2026-05-27 17:04:54.444080631 +0000 UTC m=+70.118505705" observedRunningTime="2026-05-27 17:04:55.188543333 +0000 UTC m=+70.862968420" watchObservedRunningTime="2026-05-27 17:04:55.189073722 +0000 UTC m=+70.863498815"
May 27 17:05:16.238701 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.238562    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"]
May 27 17:05:16.242896 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.242877    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"
May 27 17:05:16.245368 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.245349    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q6fs8\""
May 27 17:05:16.250950 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.250930    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"]
May 27 17:05:16.328742 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.328713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjcvt\" (UniqueName: \"kubernetes.io/projected/9a3d300a-986e-480e-9425-2c98a306c1bb-kube-api-access-tjcvt\") pod \"network-check-source-7f44b6dd87-pgxqf\" (UID: \"9a3d300a-986e-480e-9425-2c98a306c1bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"
May 27 17:05:16.429328 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.429282    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjcvt\" (UniqueName: \"kubernetes.io/projected/9a3d300a-986e-480e-9425-2c98a306c1bb-kube-api-access-tjcvt\") pod \"network-check-source-7f44b6dd87-pgxqf\" (UID: \"9a3d300a-986e-480e-9425-2c98a306c1bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"
May 27 17:05:16.437487 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.437456    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjcvt\" (UniqueName: \"kubernetes.io/projected/9a3d300a-986e-480e-9425-2c98a306c1bb-kube-api-access-tjcvt\") pod \"network-check-source-7f44b6dd87-pgxqf\" (UID: \"9a3d300a-986e-480e-9425-2c98a306c1bb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"
May 27 17:05:16.551654 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.551577    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"
May 27 17:05:16.669074 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:16.669042    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf"]
May 27 17:05:16.671982 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:16.671958    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3d300a_986e_480e_9425_2c98a306c1bb.slice/crio-a9e378bef7395a5cc204b93f3f5483bc72af70bc3721870f42a72b1437587417 WatchSource:0}: Error finding container a9e378bef7395a5cc204b93f3f5483bc72af70bc3721870f42a72b1437587417: Status 404 returned error can't find the container with id a9e378bef7395a5cc204b93f3f5483bc72af70bc3721870f42a72b1437587417
May 27 17:05:17.217362 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:17.217322    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf" event={"ID":"9a3d300a-986e-480e-9425-2c98a306c1bb","Type":"ContainerStarted","Data":"c7e39ee3a6eaeee54ea82b41666e6ad3a8e5faed35364176861eca7ef9659875"}
May 27 17:05:17.217545 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:17.217367    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf" event={"ID":"9a3d300a-986e-480e-9425-2c98a306c1bb","Type":"ContainerStarted","Data":"a9e378bef7395a5cc204b93f3f5483bc72af70bc3721870f42a72b1437587417"}
May 27 17:05:17.234843 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:17.234803    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-pgxqf" podStartSLOduration=1.234790158 podStartE2EDuration="1.234790158s" podCreationTimestamp="2026-05-27 17:05:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:05:17.233977964 +0000 UTC m=+92.908403057" watchObservedRunningTime="2026-05-27 17:05:17.234790158 +0000 UTC m=+92.909215251"
May 27 17:05:22.071588 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:22.071548    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") pod \"image-registry-6ccb6985db-bqnm5\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") " pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:22.071614    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.071708    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.071714    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.071740    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccb6985db-bqnm5: secret "image-registry-tls" not found
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.071794    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert podName:c714b343-7f2e-4206-888a-a4f51f806b26 nodeName:}" failed. No retries permitted until 2026-05-27 17:06:26.071751903 +0000 UTC m=+161.746176974 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert") pod "ingress-canary-fh2gk" (UID: "c714b343-7f2e-4206-888a-a4f51f806b26") : secret "canary-serving-cert" not found
May 27 17:05:22.072026 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.071819    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls podName:fda8c270-25a7-4125-a7f4-8a64fc14b5e0 nodeName:}" failed. No retries permitted until 2026-05-27 17:06:26.071804119 +0000 UTC m=+161.746229190 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls") pod "image-registry-6ccb6985db-bqnm5" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0") : secret "image-registry-tls" not found
May 27 17:05:22.172293 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:22.172239    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:05:22.172498 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.172405    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 17:05:22.172566 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:22.172501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls podName:8c054a79-8078-4a64-8e25-3465fd819536 nodeName:}" failed. No retries permitted until 2026-05-27 17:06:26.172481283 +0000 UTC m=+161.846906369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls") pod "dns-default-4jst8" (UID: "8c054a79-8078-4a64-8e25-3465fd819536") : secret "dns-default-metrics-tls" not found
May 27 17:05:23.022837 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:23.022808    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5kckj_079358c4-a393-44f9-b9fa-1fc102d3406b/dns-node-resolver/0.log"
May 27 17:05:24.222505 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:24.222476    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6s5t_527d9373-6319-4a5a-a6cb-5f8939d5ebaa/node-ca/0.log"
May 27 17:05:26.177736 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:26.177709    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-flg2c"
May 27 17:05:42.713960 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.713929    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lvcht"]
May 27 17:05:42.717042 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.717018    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.720060 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.720013    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 17:05:42.720187 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.720063    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 17:05:42.721225 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.721205    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gknjk\""
May 27 17:05:42.721330 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.721221    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 17:05:42.721829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.721806    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 17:05:42.740069 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.740050    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lvcht"]
May 27 17:05:42.804890 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.804865    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-cq2sd"]
May 27 17:05:42.807652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.807638    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:05:42.810378 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.810361    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 27 17:05:42.810484 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.810396    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 27 17:05:42.810484 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.810406    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-42mrq\""
May 27 17:05:42.825824 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.825805    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-cq2sd"]
May 27 17:05:42.832033 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.832016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fd838b8-b416-4bfa-8b25-599ab55c2311-data-volume\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.832163 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.832044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.832163 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.832090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fd838b8-b416-4bfa-8b25-599ab55c2311-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.832241 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.832172    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fd838b8-b416-4bfa-8b25-599ab55c2311-crio-socket\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.832241 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.832195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgxw\" (UniqueName: \"kubernetes.io/projected/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-api-access-rbgxw\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932768 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932741    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fd838b8-b416-4bfa-8b25-599ab55c2311-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932881 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932826    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fd838b8-b416-4bfa-8b25-599ab55c2311-crio-socket\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932881 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932855    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgxw\" (UniqueName: \"kubernetes.io/projected/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-api-access-rbgxw\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzwv\" (UniqueName: \"kubernetes.io/projected/7c750daf-aeba-4596-b397-8e992a931e81-kube-api-access-8bzwv\") pod \"downloads-57bd96b888-cq2sd\" (UID: \"7c750daf-aeba-4596-b397-8e992a931e81\") " pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:05:42.932969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932906    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fd838b8-b416-4bfa-8b25-599ab55c2311-crio-socket\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932936    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fd838b8-b416-4bfa-8b25-599ab55c2311-data-volume\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.932969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.932963    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.933256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.933238    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fd838b8-b416-4bfa-8b25-599ab55c2311-data-volume\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.933446 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.933430    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.934995 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.934978    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fd838b8-b416-4bfa-8b25-599ab55c2311-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:42.941983 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:42.941963    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgxw\" (UniqueName: \"kubernetes.io/projected/9fd838b8-b416-4bfa-8b25-599ab55c2311-kube-api-access-rbgxw\") pod \"insights-runtime-extractor-lvcht\" (UID: \"9fd838b8-b416-4bfa-8b25-599ab55c2311\") " pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:43.027428 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.027335    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lvcht"
May 27 17:05:43.034322 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.034294    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzwv\" (UniqueName: \"kubernetes.io/projected/7c750daf-aeba-4596-b397-8e992a931e81-kube-api-access-8bzwv\") pod \"downloads-57bd96b888-cq2sd\" (UID: \"7c750daf-aeba-4596-b397-8e992a931e81\") " pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:05:43.042731 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.042711    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzwv\" (UniqueName: \"kubernetes.io/projected/7c750daf-aeba-4596-b397-8e992a931e81-kube-api-access-8bzwv\") pod \"downloads-57bd96b888-cq2sd\" (UID: \"7c750daf-aeba-4596-b397-8e992a931e81\") " pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:05:43.116868 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.116472    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:05:43.151053 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.151025    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lvcht"]
May 27 17:05:43.155784 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:43.155742    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd838b8_b416_4bfa_8b25_599ab55c2311.slice/crio-b47d6cd06cd7264ad5417cb1d1db3b1b1cebcd0063ea7f3556351a8b2a216879 WatchSource:0}: Error finding container b47d6cd06cd7264ad5417cb1d1db3b1b1cebcd0063ea7f3556351a8b2a216879: Status 404 returned error can't find the container with id b47d6cd06cd7264ad5417cb1d1db3b1b1cebcd0063ea7f3556351a8b2a216879
May 27 17:05:43.243036 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.243009    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-cq2sd"]
May 27 17:05:43.248031 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:43.248006    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c750daf_aeba_4596_b397_8e992a931e81.slice/crio-7d1a410353cf4ccce53f88606e1f933bbf70faf7c5baaba5e676b98a46a6c4d0 WatchSource:0}: Error finding container 7d1a410353cf4ccce53f88606e1f933bbf70faf7c5baaba5e676b98a46a6c4d0: Status 404 returned error can't find the container with id 7d1a410353cf4ccce53f88606e1f933bbf70faf7c5baaba5e676b98a46a6c4d0
May 27 17:05:43.282548 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.282482    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvcht" event={"ID":"9fd838b8-b416-4bfa-8b25-599ab55c2311","Type":"ContainerStarted","Data":"9cb03f7532556955f4472b3a59965ff8885b1713fb5818999dbeb137f10f8187"}
May 27 17:05:43.282548 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.282531    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvcht" event={"ID":"9fd838b8-b416-4bfa-8b25-599ab55c2311","Type":"ContainerStarted","Data":"b47d6cd06cd7264ad5417cb1d1db3b1b1cebcd0063ea7f3556351a8b2a216879"}
May 27 17:05:43.283436 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:43.283414    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-cq2sd" event={"ID":"7c750daf-aeba-4596-b397-8e992a931e81","Type":"ContainerStarted","Data":"7d1a410353cf4ccce53f88606e1f933bbf70faf7c5baaba5e676b98a46a6c4d0"}
May 27 17:05:44.288465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:44.288426    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvcht" event={"ID":"9fd838b8-b416-4bfa-8b25-599ab55c2311","Type":"ContainerStarted","Data":"1615cb46c1513a395a5d6a310aac81abb91c0b5db4ca473db16d76b7d41fddfc"}
May 27 17:05:46.295521 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:46.295486    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvcht" event={"ID":"9fd838b8-b416-4bfa-8b25-599ab55c2311","Type":"ContainerStarted","Data":"c63c718d5bbc6ac4926da2ca72c67547d47189e23262e1ec2f5fd611c4304e3b"}
May 27 17:05:46.315431 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:46.315380    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lvcht" podStartSLOduration=1.979678192 podStartE2EDuration="4.315363883s" podCreationTimestamp="2026-05-27 17:05:42 +0000 UTC" firstStartedPulling="2026-05-27 17:05:43.222774839 +0000 UTC m=+118.897199929" lastFinishedPulling="2026-05-27 17:05:45.558460537 +0000 UTC m=+121.232885620" observedRunningTime="2026-05-27 17:05:46.314043456 +0000 UTC m=+121.988468549" watchObservedRunningTime="2026-05-27 17:05:46.315363883 +0000 UTC m=+121.989788977"
May 27 17:05:48.058002 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.057969    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"]
May 27 17:05:48.060884 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.060867    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:48.063655 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.063633    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 27 17:05:48.063784 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.063692    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p99hx\""
May 27 17:05:48.073131 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.073108    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"]
May 27 17:05:48.175983 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.175953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/490c6951-5abb-4453-b448-113fcab13582-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4d64h\" (UID: \"490c6951-5abb-4453-b448-113fcab13582\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:48.277119 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.277090    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/490c6951-5abb-4453-b448-113fcab13582-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4d64h\" (UID: \"490c6951-5abb-4453-b448-113fcab13582\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:48.279795 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.279745    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/490c6951-5abb-4453-b448-113fcab13582-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4d64h\" (UID: \"490c6951-5abb-4453-b448-113fcab13582\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:48.370659 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.370583    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:48.503011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:48.502980    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"]
May 27 17:05:48.506984 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:48.506954    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490c6951_5abb_4453_b448_113fcab13582.slice/crio-fe2995dda1cc24d03c0323a2fc085af8cdb4f601cb83e7b952bc0f65afc28b36 WatchSource:0}: Error finding container fe2995dda1cc24d03c0323a2fc085af8cdb4f601cb83e7b952bc0f65afc28b36: Status 404 returned error can't find the container with id fe2995dda1cc24d03c0323a2fc085af8cdb4f601cb83e7b952bc0f65afc28b36
May 27 17:05:49.247728 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.247691    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:05:49.250676 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.250653    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.253244 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.253219    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 27 17:05:49.254467 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.254432    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 27 17:05:49.254467 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.254438    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f2dwk\""
May 27 17:05:49.254621 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.254507    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 27 17:05:49.254621 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.254532    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 27 17:05:49.254897 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.254874    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 27 17:05:49.259896 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.259854    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:05:49.304294 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.304255    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h" event={"ID":"490c6951-5abb-4453-b448-113fcab13582","Type":"ContainerStarted","Data":"fe2995dda1cc24d03c0323a2fc085af8cdb4f601cb83e7b952bc0f65afc28b36"}
May 27 17:05:49.388006 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.387973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.388006 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.388014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.388256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.388101    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.388256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.388148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.388256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.388198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmld\" (UniqueName: \"kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.388256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.388227    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489553 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489520    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489561    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489607    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489628    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489653    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmld\" (UniqueName: \"kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.489716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.489681    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.490542 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.490486    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.490659 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.490634    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.491049 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.491026    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.492171 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.492148    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.492269 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.492242    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.505409 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.505358    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmld\" (UniqueName: \"kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld\") pod \"console-6b9d849d5-4hc6w\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") " pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.563364 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.563328    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:49.818972 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:49.818945    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:05:49.822080 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:49.822052    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53b520b_0817_4d49_83ce_d665c40a0cf3.slice/crio-3759b1b1aea2057536eb19bc4bcd8335d9896c44b826c7759a2e2c8098f1ccf8 WatchSource:0}: Error finding container 3759b1b1aea2057536eb19bc4bcd8335d9896c44b826c7759a2e2c8098f1ccf8: Status 404 returned error can't find the container with id 3759b1b1aea2057536eb19bc4bcd8335d9896c44b826c7759a2e2c8098f1ccf8
May 27 17:05:50.308722 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:50.308684    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d849d5-4hc6w" event={"ID":"c53b520b-0817-4d49-83ce-d665c40a0cf3","Type":"ContainerStarted","Data":"3759b1b1aea2057536eb19bc4bcd8335d9896c44b826c7759a2e2c8098f1ccf8"}
May 27 17:05:50.310490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:50.310459    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h" event={"ID":"490c6951-5abb-4453-b448-113fcab13582","Type":"ContainerStarted","Data":"0642f577774dd0df2f3d84e987082527f109793d7ac00ff3f51e81bbb46e8cec"}
May 27 17:05:50.310722 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:50.310702    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:50.317320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:50.317291    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h"
May 27 17:05:50.326279 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:50.326229    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4d64h" podStartSLOduration=1.091997528 podStartE2EDuration="2.3262141s" podCreationTimestamp="2026-05-27 17:05:48 +0000 UTC" firstStartedPulling="2026-05-27 17:05:48.509240245 +0000 UTC m=+124.183665328" lastFinishedPulling="2026-05-27 17:05:49.743456813 +0000 UTC m=+125.417881900" observedRunningTime="2026-05-27 17:05:50.325807885 +0000 UTC m=+126.000232978" watchObservedRunningTime="2026-05-27 17:05:50.3262141 +0000 UTC m=+126.000639193"
May 27 17:05:51.107334 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.107300    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"]
May 27 17:05:51.110667 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.110643    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.113320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.113298    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 17:05:51.114454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.114430    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 17:05:51.114562 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.114455    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 27 17:05:51.114622 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.114559    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 27 17:05:51.114677 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.114569    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 17:05:51.114791 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.114775    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t2lgn\""
May 27 17:05:51.120612 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.120582    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"]
May 27 17:05:51.203286 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.203254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.203474 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.203416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.203548 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.203470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a66ff-7f44-44b3-9d69-d711140747ce-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.203548 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.203528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk957\" (UniqueName: \"kubernetes.io/projected/942a66ff-7f44-44b3-9d69-d711140747ce-kube-api-access-lk957\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.304041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.304001    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk957\" (UniqueName: \"kubernetes.io/projected/942a66ff-7f44-44b3-9d69-d711140747ce-kube-api-access-lk957\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.304225 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.304065    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.304225 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.304163    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.304225 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.304195    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a66ff-7f44-44b3-9d69-d711140747ce-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.304407 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:51.304283    2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 27 17:05:51.304407 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:51.304351    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls podName:942a66ff-7f44-44b3-9d69-d711140747ce nodeName:}" failed. No retries permitted until 2026-05-27 17:05:51.804332098 +0000 UTC m=+127.478757168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-slzqn" (UID: "942a66ff-7f44-44b3-9d69-d711140747ce") : secret "prometheus-operator-tls" not found
May 27 17:05:51.304931 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.304904    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a66ff-7f44-44b3-9d69-d711140747ce-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.308373 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.308318    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.314339 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.314316    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk957\" (UniqueName: \"kubernetes.io/projected/942a66ff-7f44-44b3-9d69-d711140747ce-kube-api-access-lk957\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.809512 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.809431    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:51.812268 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:51.812244    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a66ff-7f44-44b3-9d69-d711140747ce-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-slzqn\" (UID: \"942a66ff-7f44-44b3-9d69-d711140747ce\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:52.023272 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:52.023238    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"
May 27 17:05:52.801319 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:52.801270    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-slzqn"]
May 27 17:05:52.804332 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:52.804305    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942a66ff_7f44_44b3_9d69_d711140747ce.slice/crio-27bd55fae2d9e00a765d2f4eee9658c3be384163ab656a9c5bd1d1a9f6f6bef7 WatchSource:0}: Error finding container 27bd55fae2d9e00a765d2f4eee9658c3be384163ab656a9c5bd1d1a9f6f6bef7: Status 404 returned error can't find the container with id 27bd55fae2d9e00a765d2f4eee9658c3be384163ab656a9c5bd1d1a9f6f6bef7
May 27 17:05:53.320405 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:53.320350    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d849d5-4hc6w" event={"ID":"c53b520b-0817-4d49-83ce-d665c40a0cf3","Type":"ContainerStarted","Data":"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"}
May 27 17:05:53.321605 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:53.321577    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn" event={"ID":"942a66ff-7f44-44b3-9d69-d711140747ce","Type":"ContainerStarted","Data":"27bd55fae2d9e00a765d2f4eee9658c3be384163ab656a9c5bd1d1a9f6f6bef7"}
May 27 17:05:53.340011 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:53.339966    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b9d849d5-4hc6w" podStartSLOduration=1.444470317 podStartE2EDuration="4.339950193s" podCreationTimestamp="2026-05-27 17:05:49 +0000 UTC" firstStartedPulling="2026-05-27 17:05:49.823934342 +0000 UTC m=+125.498359414" lastFinishedPulling="2026-05-27 17:05:52.719414214 +0000 UTC m=+128.393839290" observedRunningTime="2026-05-27 17:05:53.338632842 +0000 UTC m=+129.013057936" watchObservedRunningTime="2026-05-27 17:05:53.339950193 +0000 UTC m=+129.014375286"
May 27 17:05:54.736566 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:54.736527    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:05:54.738826 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:54.738808    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/045a1e65-3426-4a6c-8824-9759a86b2f41-metrics-certs\") pod \"network-metrics-daemon-2bpp6\" (UID: \"045a1e65-3426-4a6c-8824-9759a86b2f41\") " pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:05:54.964162 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:54.964130    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxpwr\""
May 27 17:05:54.972272 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:54.972253    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2bpp6"
May 27 17:05:55.094158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:55.094110    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2bpp6"]
May 27 17:05:55.098196 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:05:55.098164    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045a1e65_3426_4a6c_8824_9759a86b2f41.slice/crio-7e0d19bdfe739e82a0a46bba71d7ee415268cd43f1952b14af077fa8b40df1c0 WatchSource:0}: Error finding container 7e0d19bdfe739e82a0a46bba71d7ee415268cd43f1952b14af077fa8b40df1c0: Status 404 returned error can't find the container with id 7e0d19bdfe739e82a0a46bba71d7ee415268cd43f1952b14af077fa8b40df1c0
May 27 17:05:55.328625 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:55.328526    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn" event={"ID":"942a66ff-7f44-44b3-9d69-d711140747ce","Type":"ContainerStarted","Data":"3449d1b50fe6d19453dd87358a6ad6ba6b94455f28a79bf315a9c6fff110837e"}
May 27 17:05:55.328625 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:55.328578    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn" event={"ID":"942a66ff-7f44-44b3-9d69-d711140747ce","Type":"ContainerStarted","Data":"a2b31860e82ce4373941e2a47e7a6d48f66372958c2492ac078babee372d4e05"}
May 27 17:05:55.329656 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:55.329629    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2bpp6" event={"ID":"045a1e65-3426-4a6c-8824-9759a86b2f41","Type":"ContainerStarted","Data":"7e0d19bdfe739e82a0a46bba71d7ee415268cd43f1952b14af077fa8b40df1c0"}
May 27 17:05:55.347495 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:55.347449    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-slzqn" podStartSLOduration=2.853010822 podStartE2EDuration="4.34743704s" podCreationTimestamp="2026-05-27 17:05:51 +0000 UTC" firstStartedPulling="2026-05-27 17:05:52.806724992 +0000 UTC m=+128.481150078" lastFinishedPulling="2026-05-27 17:05:54.301151225 +0000 UTC m=+129.975576296" observedRunningTime="2026-05-27 17:05:55.346252348 +0000 UTC m=+131.020677444" watchObservedRunningTime="2026-05-27 17:05:55.34743704 +0000 UTC m=+131.021862133"
May 27 17:05:57.257394 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.257355    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:05:57.259457 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.259435    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.268568 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.268549    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 27 17:05:57.273054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.273028    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:05:57.360641 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzfw\" (UniqueName: \"kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360991 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360991 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.360991 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.360913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.438409 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.438376    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"]
May 27 17:05:57.440708 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.440684    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.443704 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.443508    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 27 17:05:57.443704 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.443584    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l27k8\""
May 27 17:05:57.443704 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.443661    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 27 17:05:57.452353 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.452324    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"]
May 27 17:05:57.455666 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.455645    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x2v5j"]
May 27 17:05:57.457867 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.457846    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.460570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.460388    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 17:05:57.460570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.460428    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tp4wq\""
May 27 17:05:57.460570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.460434    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 17:05:57.460982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.460962    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 17:05:57.461339 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461319    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461349    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glzfw\" (UniqueName: \"kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461387    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461428    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461660 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461463    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461660 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461493    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.461660 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.461577    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.462197 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.462138    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.462794 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.462740    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.462936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.462750    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.463276 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.463229    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.464876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.464853    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.464988 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.464945    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.475998 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.475973    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzfw\" (UniqueName: \"kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw\") pod \"console-5c456f9f56-xpsfn\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") " pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.562449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-metrics-client-ca\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nml9g\" (UniqueName: \"kubernetes.io/projected/057bfb2d-32f0-4029-936c-cd749511ae07-kube-api-access-nml9g\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.562449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2npm\" (UniqueName: \"kubernetes.io/projected/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-kube-api-access-q2npm\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562692 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057bfb2d-32f0-4029-936c-cd749511ae07-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.562692 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.562692 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-sys\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562692 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-textfile\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562814    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-wtmp\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.562958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.562940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-root\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.570216 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.570187    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:05:57.663506 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663467    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-metrics-client-ca\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663705 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663527    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nml9g\" (UniqueName: \"kubernetes.io/projected/057bfb2d-32f0-4029-936c-cd749511ae07-kube-api-access-nml9g\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.663705 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663563    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2npm\" (UniqueName: \"kubernetes.io/projected/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-kube-api-access-q2npm\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663705 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663595    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057bfb2d-32f0-4029-936c-cd749511ae07-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.663705 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663657    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.663705 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663685    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-sys\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663724    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663751    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-textfile\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663798    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663830    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-wtmp\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663857    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663902    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-sys\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663906    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.663996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.663966    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-root\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-root\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664071    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-wtmp\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664092    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-metrics-client-ca\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:57.663860    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:05:57.664176    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls podName:7cecf5af-7e17-4fc1-8f3c-5c025d0265dc nodeName:}" failed. No retries permitted until 2026-05-27 17:05:58.164156814 +0000 UTC m=+133.838581892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls") pod "node-exporter-x2v5j" (UID: "7cecf5af-7e17-4fc1-8f3c-5c025d0265dc") : secret "node-exporter-tls" not found
May 27 17:05:57.664382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664318    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-textfile\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.664698 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664475    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057bfb2d-32f0-4029-936c-cd749511ae07-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.664698 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.664551    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.666634 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.666596    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.666749 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.666699    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/057bfb2d-32f0-4029-936c-cd749511ae07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.666824 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.666787    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.677021 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.676994    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2npm\" (UniqueName: \"kubernetes.io/projected/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-kube-api-access-q2npm\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:57.677386 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.677337    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nml9g\" (UniqueName: \"kubernetes.io/projected/057bfb2d-32f0-4029-936c-cd749511ae07-kube-api-access-nml9g\") pod \"openshift-state-metrics-9c959559f-8kbws\" (UID: \"057bfb2d-32f0-4029-936c-cd749511ae07\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:57.751158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:57.751120    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"
May 27 17:05:58.169429 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:58.169400    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:58.171704 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:58.171678    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7cecf5af-7e17-4fc1-8f3c-5c025d0265dc-node-exporter-tls\") pod \"node-exporter-x2v5j\" (UID: \"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc\") " pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:58.375926 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:58.375895    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x2v5j"
May 27 17:05:59.563867 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:59.563831    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:59.563867 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:59.563886    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:05:59.569451 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:05:59.569429    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:06:00.347269 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:00.347235    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:06:02.287673 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.287640    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"]
May 27 17:06:02.290945 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.290925    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:02.293673 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.293652    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 27 17:06:02.293792 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.293714    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-q8wcz\""
May 27 17:06:02.299248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.298868    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"]
May 27 17:06:02.308653 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.308447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-bwbz7\" (UID: \"30096bae-d32a-4870-9ac5-cd4b82c786cc\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:02.409602 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.409558    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-bwbz7\" (UID: \"30096bae-d32a-4870-9ac5-cd4b82c786cc\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:02.409797 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:02.409734    2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 27 17:06:02.409890 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:02.409833    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert podName:30096bae-d32a-4870-9ac5-cd4b82c786cc nodeName:}" failed. No retries permitted until 2026-05-27 17:06:02.909810824 +0000 UTC m=+138.584235927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-bwbz7" (UID: "30096bae-d32a-4870-9ac5-cd4b82c786cc") : secret "monitoring-plugin-cert" not found
May 27 17:06:02.862311 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:02.862280    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cecf5af_7e17_4fc1_8f3c_5c025d0265dc.slice/crio-32b7b5a04692e71f425ed60a827fefe55adeab9f6eebe255318a7113a88b7fee WatchSource:0}: Error finding container 32b7b5a04692e71f425ed60a827fefe55adeab9f6eebe255318a7113a88b7fee: Status 404 returned error can't find the container with id 32b7b5a04692e71f425ed60a827fefe55adeab9f6eebe255318a7113a88b7fee
May 27 17:06:02.914856 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.913568    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-bwbz7\" (UID: \"30096bae-d32a-4870-9ac5-cd4b82c786cc\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:02.917734 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:02.917519    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30096bae-d32a-4870-9ac5-cd4b82c786cc-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-bwbz7\" (UID: \"30096bae-d32a-4870-9ac5-cd4b82c786cc\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:03.007058 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.007029    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kbws"]
May 27 17:06:03.012608 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:03.012513    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057bfb2d_32f0_4029_936c_cd749511ae07.slice/crio-9ef0379914555627a2634aabc54669ac7c3a70c6b1c8837fe8a31c8e37aa2967 WatchSource:0}: Error finding container 9ef0379914555627a2634aabc54669ac7c3a70c6b1c8837fe8a31c8e37aa2967: Status 404 returned error can't find the container with id 9ef0379914555627a2634aabc54669ac7c3a70c6b1c8837fe8a31c8e37aa2967
May 27 17:06:03.024628 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.024585    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:06:03.030613 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:03.030579    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0174cead_fdcb_4b1a_b03a_89113e162b88.slice/crio-b44f2fb60e82cecbe2a52c327fd4ba0f69a00362aa94b5e25efa3ba2d92d4c53 WatchSource:0}: Error finding container b44f2fb60e82cecbe2a52c327fd4ba0f69a00362aa94b5e25efa3ba2d92d4c53: Status 404 returned error can't find the container with id b44f2fb60e82cecbe2a52c327fd4ba0f69a00362aa94b5e25efa3ba2d92d4c53
May 27 17:06:03.202732 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.202695    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:03.347624 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.347570    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"]
May 27 17:06:03.353724 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:03.353686    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30096bae_d32a_4870_9ac5_cd4b82c786cc.slice/crio-b1a962204bce4cc1800149f9c39f9d16dd5d95966dc14441d1dec9e04239d656 WatchSource:0}: Error finding container b1a962204bce4cc1800149f9c39f9d16dd5d95966dc14441d1dec9e04239d656: Status 404 returned error can't find the container with id b1a962204bce4cc1800149f9c39f9d16dd5d95966dc14441d1dec9e04239d656
May 27 17:06:03.356792 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.356519    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2bpp6" event={"ID":"045a1e65-3426-4a6c-8824-9759a86b2f41","Type":"ContainerStarted","Data":"ed9ba38f9a6fc4d34ea1e66df0ff43d7f5e210266af9398783c82982d33922df"}
May 27 17:06:03.356792 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.356554    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2bpp6" event={"ID":"045a1e65-3426-4a6c-8824-9759a86b2f41","Type":"ContainerStarted","Data":"60435c51d052c780098750864a024a874ee80e9d5c9919e44983ecf58538bf3f"}
May 27 17:06:03.359018 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.358997    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c456f9f56-xpsfn" event={"ID":"0174cead-fdcb-4b1a-b03a-89113e162b88","Type":"ContainerStarted","Data":"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"}
May 27 17:06:03.359117 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.359028    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c456f9f56-xpsfn" event={"ID":"0174cead-fdcb-4b1a-b03a-89113e162b88","Type":"ContainerStarted","Data":"b44f2fb60e82cecbe2a52c327fd4ba0f69a00362aa94b5e25efa3ba2d92d4c53"}
May 27 17:06:03.360832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.360746    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2v5j" event={"ID":"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc","Type":"ContainerStarted","Data":"32b7b5a04692e71f425ed60a827fefe55adeab9f6eebe255318a7113a88b7fee"}
May 27 17:06:03.362838 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.362195    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-cq2sd" event={"ID":"7c750daf-aeba-4596-b397-8e992a931e81","Type":"ContainerStarted","Data":"8cb1efd9368a1aa3d585b20d1acc8887502df07bfbbbbd395df91170473863bd"}
May 27 17:06:03.362838 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.362804    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:06:03.365066 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.365044    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws" event={"ID":"057bfb2d-32f0-4029-936c-cd749511ae07","Type":"ContainerStarted","Data":"196f4c352480144ceee3439658e06e6663a436ed155bd0666cb6d083228d4d85"}
May 27 17:06:03.365174 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.365072    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws" event={"ID":"057bfb2d-32f0-4029-936c-cd749511ae07","Type":"ContainerStarted","Data":"5a07c36f4253b36bdcab2037dc2ca51407b0b85a92dc4e7935c049405bc238e7"}
May 27 17:06:03.365174 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.365085    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws" event={"ID":"057bfb2d-32f0-4029-936c-cd749511ae07","Type":"ContainerStarted","Data":"9ef0379914555627a2634aabc54669ac7c3a70c6b1c8837fe8a31c8e37aa2967"}
May 27 17:06:03.372595 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.372576    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-cq2sd"
May 27 17:06:03.409534 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.409483    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c456f9f56-xpsfn" podStartSLOduration=6.409466095 podStartE2EDuration="6.409466095s" podCreationTimestamp="2026-05-27 17:05:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:06:03.409008179 +0000 UTC m=+139.083433273" watchObservedRunningTime="2026-05-27 17:06:03.409466095 +0000 UTC m=+139.083891189"
May 27 17:06:03.410100 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.410057    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2bpp6" podStartSLOduration=130.649766152 podStartE2EDuration="2m18.410044085s" podCreationTimestamp="2026-05-27 17:03:45 +0000 UTC" firstStartedPulling="2026-05-27 17:05:55.101040658 +0000 UTC m=+130.775465734" lastFinishedPulling="2026-05-27 17:06:02.861318572 +0000 UTC m=+138.535743667" observedRunningTime="2026-05-27 17:06:03.382882176 +0000 UTC m=+139.057307273" watchObservedRunningTime="2026-05-27 17:06:03.410044085 +0000 UTC m=+139.084469179"
May 27 17:06:03.426337 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.426282    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-cq2sd" podStartSLOduration=1.780100027 podStartE2EDuration="21.426267356s" podCreationTimestamp="2026-05-27 17:05:42 +0000 UTC" firstStartedPulling="2026-05-27 17:05:43.250128102 +0000 UTC m=+118.924553173" lastFinishedPulling="2026-05-27 17:06:02.896295427 +0000 UTC m=+138.570720502" observedRunningTime="2026-05-27 17:06:03.425831931 +0000 UTC m=+139.100257026" watchObservedRunningTime="2026-05-27 17:06:03.426267356 +0000 UTC m=+139.100692450"
May 27 17:06:03.764809 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.763164    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:06:03.768439 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.768417    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.772073    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.772327    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.772537    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.772729    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.773273    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.773460    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.773644    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-324f17vkk666b\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.773838    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.774034    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rw5qm\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.775645    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.775843    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.776031    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.776206    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.776487    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 27 17:06:03.780054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.779997    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 27 17:06:03.781138 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.781108    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:06:03.822438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822481    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.822670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822660    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnmjh\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.822955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.823033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.823407 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.823117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.924471 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.924432    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.924698 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.924679    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnmjh\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.924866 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.924848    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925014 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.924996    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925146 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925132    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925265 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925251    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925382 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925367    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925497 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925483    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925629 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925614    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925743 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925729    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.925899 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925882    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926007 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.925993    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926129 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926114    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926235 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926219    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926354 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926336    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926466 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926452    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.926566 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926550    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.927372 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926651    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.927372 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.926660    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.927640 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.927614    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.928531 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.928508    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.929934 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.929910    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.930433 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.930295    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.933671 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.933648    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.938124 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.938080    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnmjh\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.940703 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.940355    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.940703 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.940570    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.940703 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.940644    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.942506 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.942460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.942604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.942577    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.943108 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.943014    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.943566 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.943533    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.943652 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.943606    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.944570 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.944079    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.944721 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.944102    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:03.946972 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:03.946948    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:04.101684 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.101650    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:04.296256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.296191    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:06:04.374052 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.373266    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"f40652c4153bc33ad7a207b0d4b57c17a71dd0b5b09433e85926436b814d50e4"}
May 27 17:06:04.375796 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.375060    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7" event={"ID":"30096bae-d32a-4870-9ac5-cd4b82c786cc","Type":"ContainerStarted","Data":"b1a962204bce4cc1800149f9c39f9d16dd5d95966dc14441d1dec9e04239d656"}
May 27 17:06:04.378718 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.378548    2574 generic.go:358] "Generic (PLEG): container finished" podID="7cecf5af-7e17-4fc1-8f3c-5c025d0265dc" containerID="8b6187b1170d7ac0470e264b321f9b834f9fe2a08e6ecbbb951b9cb6cbed309a" exitCode=0
May 27 17:06:04.378858 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:04.378838    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2v5j" event={"ID":"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc","Type":"ContainerDied","Data":"8b6187b1170d7ac0470e264b321f9b834f9fe2a08e6ecbbb951b9cb6cbed309a"}
May 27 17:06:05.200312 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.200273    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccb6985db-bqnm5"]
May 27 17:06:05.200605 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:05.200562    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5" podUID="fda8c270-25a7-4125-a7f4-8a64fc14b5e0"
May 27 17:06:05.385521 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.384579    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:06:05.385521 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.385330    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2v5j" event={"ID":"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc","Type":"ContainerStarted","Data":"6166884d3e1a40e30fd68d505be2c2e90178620c2f4c8980008a0ad6ecd9e3b3"}
May 27 17:06:05.385521 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.385386    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2v5j" event={"ID":"7cecf5af-7e17-4fc1-8f3c-5c025d0265dc","Type":"ContainerStarted","Data":"e451dbd9d8e18d21fdbb6e46f64e78c50e913988a2f6558a1223725d3eec9f8c"}
May 27 17:06:05.390646 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.390579    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:06:05.406565 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.406103    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x2v5j" podStartSLOduration=7.21468199 podStartE2EDuration="8.406086374s" podCreationTimestamp="2026-05-27 17:05:57 +0000 UTC" firstStartedPulling="2026-05-27 17:06:02.864537425 +0000 UTC m=+138.538962509" lastFinishedPulling="2026-05-27 17:06:04.055941822 +0000 UTC m=+139.730366893" observedRunningTime="2026-05-27 17:06:05.403271856 +0000 UTC m=+141.077696951" watchObservedRunningTime="2026-05-27 17:06:05.406086374 +0000 UTC m=+141.080511468"
May 27 17:06:05.446456 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446023    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzskr\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446456 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446093    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446456 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446128    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446816 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446651    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:06:05.446816 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446670    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446816 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446741    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446884    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.446969 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.446917    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets\") pod \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\" (UID: \"fda8c270-25a7-4125-a7f4-8a64fc14b5e0\") "
May 27 17:06:05.447126 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.447077    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:05.448269 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.447950    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:05.449146 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.448732    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-ca-trust-extracted\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.449146 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.448780    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-trusted-ca\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.449146 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.448796    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-certificates\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.451260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.451191    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:05.451260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.451212    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr" (OuterVolumeSpecName: "kube-api-access-lzskr") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "kube-api-access-lzskr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:06:05.451392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.451287    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:05.452064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.452042    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fda8c270-25a7-4125-a7f4-8a64fc14b5e0" (UID: "fda8c270-25a7-4125-a7f4-8a64fc14b5e0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:06:05.549547 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.549510    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-image-registry-private-configuration\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.549547 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.549546    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-bound-sa-token\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.549840 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.549564    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-installation-pull-secrets\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:05.549840 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:05.549580    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzskr\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-kube-api-access-lzskr\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:06.387982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.387950    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccb6985db-bqnm5"
May 27 17:06:06.421990 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.421962    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccb6985db-bqnm5"]
May 27 17:06:06.425333 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.425303    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ccb6985db-bqnm5"]
May 27 17:06:06.457067 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.457037    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda8c270-25a7-4125-a7f4-8a64fc14b5e0-registry-tls\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:06.681140 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.681110    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:06:06.941524 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:06.941314    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda8c270-25a7-4125-a7f4-8a64fc14b5e0" path="/var/lib/kubelet/pods/fda8c270-25a7-4125-a7f4-8a64fc14b5e0/volumes"
May 27 17:06:07.393048 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.392952    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7" event={"ID":"30096bae-d32a-4870-9ac5-cd4b82c786cc","Type":"ContainerStarted","Data":"a2afbc23b149bcd1651dac569b2af2f49c2022d18eedeb425db7ac2447d9ee3a"}
May 27 17:06:07.393462 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.393146    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:07.395171 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.395137    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws" event={"ID":"057bfb2d-32f0-4029-936c-cd749511ae07","Type":"ContainerStarted","Data":"381daa15749e77559c70a4702b6eb1b8c166372501ddff891287702a97ff00ba"}
May 27 17:06:07.400111 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.400089    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7"
May 27 17:06:07.401217 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.401191    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354" exitCode=0
May 27 17:06:07.401331 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.401241    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354"}
May 27 17:06:07.412963 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.412912    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-bwbz7" podStartSLOduration=1.93404726 podStartE2EDuration="5.412895369s" podCreationTimestamp="2026-05-27 17:06:02 +0000 UTC" firstStartedPulling="2026-05-27 17:06:03.355971707 +0000 UTC m=+139.030396784" lastFinishedPulling="2026-05-27 17:06:06.834819818 +0000 UTC m=+142.509244893" observedRunningTime="2026-05-27 17:06:07.412022867 +0000 UTC m=+143.086447957" watchObservedRunningTime="2026-05-27 17:06:07.412895369 +0000 UTC m=+143.087320464"
May 27 17:06:07.484162 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.483851    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kbws" podStartSLOduration=6.794041239 podStartE2EDuration="10.483831504s" podCreationTimestamp="2026-05-27 17:05:57 +0000 UTC" firstStartedPulling="2026-05-27 17:06:03.14504469 +0000 UTC m=+138.819469772" lastFinishedPulling="2026-05-27 17:06:06.834834959 +0000 UTC m=+142.509260037" observedRunningTime="2026-05-27 17:06:07.48251416 +0000 UTC m=+143.156939253" watchObservedRunningTime="2026-05-27 17:06:07.483831504 +0000 UTC m=+143.158256599"
May 27 17:06:07.571101 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:07.571063    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:06:11.419608 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:11.419577    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"}
May 27 17:06:12.423829 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:12.423796    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"}
May 27 17:06:14.431777 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:14.431740    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"}
May 27 17:06:14.432061 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:14.431783    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"}
May 27 17:06:15.437877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:15.437825    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"}
May 27 17:06:15.437877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:15.437877    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerStarted","Data":"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"}
May 27 17:06:15.465933 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:15.465842    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.577305943 podStartE2EDuration="12.465823947s" podCreationTimestamp="2026-05-27 17:06:03 +0000 UTC" firstStartedPulling="2026-05-27 17:06:04.30488107 +0000 UTC m=+139.979306141" lastFinishedPulling="2026-05-27 17:06:14.193399073 +0000 UTC m=+149.867824145" observedRunningTime="2026-05-27 17:06:15.465084565 +0000 UTC m=+151.139509692" watchObservedRunningTime="2026-05-27 17:06:15.465823947 +0000 UTC m=+151.140249044"
May 27 17:06:17.102010 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:17.101968    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:06:19.102345 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:19.102313    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:06:21.190141 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:21.190097    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fh2gk" podUID="c714b343-7f2e-4206-888a-a4f51f806b26"
May 27 17:06:21.288441 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:21.288398    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4jst8" podUID="8c054a79-8078-4a64-8e25-3465fd819536"
May 27 17:06:21.454353 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:21.454276    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:06:21.454353 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:21.454339    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jst8"
May 27 17:06:26.138990 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.138957    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:06:26.141236 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.141216    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c714b343-7f2e-4206-888a-a4f51f806b26-cert\") pod \"ingress-canary-fh2gk\" (UID: \"c714b343-7f2e-4206-888a-a4f51f806b26\") " pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:06:26.240085 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.240054    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:06:26.242044 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.242026    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c054a79-8078-4a64-8e25-3465fd819536-metrics-tls\") pod \"dns-default-4jst8\" (UID: \"8c054a79-8078-4a64-8e25-3465fd819536\") " pod="openshift-dns/dns-default-4jst8"
May 27 17:06:26.257905 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.257881    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9xjp\""
May 27 17:06:26.258925 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.258910    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m66z9\""
May 27 17:06:26.265097 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.265081    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jst8"
May 27 17:06:26.265175 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.265154    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fh2gk"
May 27 17:06:26.396953 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.396930    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jst8"]
May 27 17:06:26.399323 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:26.399295    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c054a79_8078_4a64_8e25_3465fd819536.slice/crio-a8c126a2613b9cbe8b970aedc7ba5ad86a4354864f7daab7a4bbe1898fd86a46 WatchSource:0}: Error finding container a8c126a2613b9cbe8b970aedc7ba5ad86a4354864f7daab7a4bbe1898fd86a46: Status 404 returned error can't find the container with id a8c126a2613b9cbe8b970aedc7ba5ad86a4354864f7daab7a4bbe1898fd86a46
May 27 17:06:26.416672 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.416650    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fh2gk"]
May 27 17:06:26.419490 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:06:26.419467    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc714b343_7f2e_4206_888a_a4f51f806b26.slice/crio-559b94b27de77cfc3bc7886debad9f5d1047a607a74ffe5392dcbaef4cc26a11 WatchSource:0}: Error finding container 559b94b27de77cfc3bc7886debad9f5d1047a607a74ffe5392dcbaef4cc26a11: Status 404 returned error can't find the container with id 559b94b27de77cfc3bc7886debad9f5d1047a607a74ffe5392dcbaef4cc26a11
May 27 17:06:26.467135 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.467099    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fh2gk" event={"ID":"c714b343-7f2e-4206-888a-a4f51f806b26","Type":"ContainerStarted","Data":"559b94b27de77cfc3bc7886debad9f5d1047a607a74ffe5392dcbaef4cc26a11"}
May 27 17:06:26.468023 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:26.468004    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jst8" event={"ID":"8c054a79-8078-4a64-8e25-3465fd819536","Type":"ContainerStarted","Data":"a8c126a2613b9cbe8b970aedc7ba5ad86a4354864f7daab7a4bbe1898fd86a46"}
May 27 17:06:28.479545 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:28.479512    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jst8" event={"ID":"8c054a79-8078-4a64-8e25-3465fd819536","Type":"ContainerStarted","Data":"d628916ceb126e4c22126ba0be34d900cf3e6d5826e5959461e859979eefc694"}
May 27 17:06:28.479545 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:28.479549    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jst8" event={"ID":"8c054a79-8078-4a64-8e25-3465fd819536","Type":"ContainerStarted","Data":"c632edfdbb2585dd3109c2a13c65758c956802a091f918a565a0072fe55961cd"}
May 27 17:06:28.480017 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:28.479675    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4jst8"
May 27 17:06:28.496657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:28.496581    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4jst8" podStartSLOduration=129.064142262 podStartE2EDuration="2m10.496566875s" podCreationTimestamp="2026-05-27 17:04:18 +0000 UTC" firstStartedPulling="2026-05-27 17:06:26.401077101 +0000 UTC m=+162.075502171" lastFinishedPulling="2026-05-27 17:06:27.83350171 +0000 UTC m=+163.507926784" observedRunningTime="2026-05-27 17:06:28.495919957 +0000 UTC m=+164.170345051" watchObservedRunningTime="2026-05-27 17:06:28.496566875 +0000 UTC m=+164.170991970"
May 27 17:06:29.484346 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:29.484314    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fh2gk" event={"ID":"c714b343-7f2e-4206-888a-a4f51f806b26","Type":"ContainerStarted","Data":"3798304b4d1f8ce3471aa736fb714faf0fd23cb11154f93f9d182cb665244d0f"}
May 27 17:06:29.503562 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:29.503520    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fh2gk" podStartSLOduration=129.003754528 podStartE2EDuration="2m11.503507068s" podCreationTimestamp="2026-05-27 17:04:18 +0000 UTC" firstStartedPulling="2026-05-27 17:06:26.421215503 +0000 UTC m=+162.095640574" lastFinishedPulling="2026-05-27 17:06:28.920968026 +0000 UTC m=+164.595393114" observedRunningTime="2026-05-27 17:06:29.50260724 +0000 UTC m=+165.177032334" watchObservedRunningTime="2026-05-27 17:06:29.503507068 +0000 UTC m=+165.177932161"
May 27 17:06:31.702070 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:31.701978    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c456f9f56-xpsfn" podUID="0174cead-fdcb-4b1a-b03a-89113e162b88" containerName="console" containerID="cri-o://62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85" gracePeriod=15
May 27 17:06:31.951689 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:31.951669    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c456f9f56-xpsfn_0174cead-fdcb-4b1a-b03a-89113e162b88/console/0.log"
May 27 17:06:31.951827 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:31.951726    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:06:32.087940 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.087865    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.087940 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.087907    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.087940 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.087928    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.088203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088097    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.088203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088152    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.088203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088194    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glzfw\" (UniqueName: \"kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.088351 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088222    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config\") pod \"0174cead-fdcb-4b1a-b03a-89113e162b88\" (UID: \"0174cead-fdcb-4b1a-b03a-89113e162b88\") "
May 27 17:06:32.088394 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088303    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:32.088449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088320    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config" (OuterVolumeSpecName: "console-config") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:32.088498 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088481    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-oauth-serving-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.088534 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088496    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:32.088864 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.088831    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca" (OuterVolumeSpecName: "service-ca") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:32.090192 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.090169    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:32.090288 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.090237    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw" (OuterVolumeSpecName: "kube-api-access-glzfw") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "kube-api-access-glzfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:06:32.090406 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.090390    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0174cead-fdcb-4b1a-b03a-89113e162b88" (UID: "0174cead-fdcb-4b1a-b03a-89113e162b88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:32.189751 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189711    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-trusted-ca-bundle\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.189751 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189744    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-service-ca\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.189751 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189755    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glzfw\" (UniqueName: \"kubernetes.io/projected/0174cead-fdcb-4b1a-b03a-89113e162b88-kube-api-access-glzfw\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.189987 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189788    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-oauth-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.189987 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189801    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0174cead-fdcb-4b1a-b03a-89113e162b88-console-serving-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.189987 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.189810    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0174cead-fdcb-4b1a-b03a-89113e162b88-console-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:32.492170 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492144    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c456f9f56-xpsfn_0174cead-fdcb-4b1a-b03a-89113e162b88/console/0.log"
May 27 17:06:32.492320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492187    2574 generic.go:358] "Generic (PLEG): container finished" podID="0174cead-fdcb-4b1a-b03a-89113e162b88" containerID="62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85" exitCode=2
May 27 17:06:32.492320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492256    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c456f9f56-xpsfn"
May 27 17:06:32.492320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492257    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c456f9f56-xpsfn" event={"ID":"0174cead-fdcb-4b1a-b03a-89113e162b88","Type":"ContainerDied","Data":"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"}
May 27 17:06:32.492320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492288    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c456f9f56-xpsfn" event={"ID":"0174cead-fdcb-4b1a-b03a-89113e162b88","Type":"ContainerDied","Data":"b44f2fb60e82cecbe2a52c327fd4ba0f69a00362aa94b5e25efa3ba2d92d4c53"}
May 27 17:06:32.492320 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.492309    2574 scope.go:117] "RemoveContainer" containerID="62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"
May 27 17:06:32.500487 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.500468    2574 scope.go:117] "RemoveContainer" containerID="62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"
May 27 17:06:32.500725 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:32.500706    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85\": container with ID starting with 62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85 not found: ID does not exist" containerID="62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"
May 27 17:06:32.500780 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.500734    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85"} err="failed to get container status \"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85\": rpc error: code = NotFound desc = could not find container \"62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85\": container with ID starting with 62562c3576089b229a683a366c081cfa2b4222b1f2394858270056b3ef279a85 not found: ID does not exist"
May 27 17:06:32.513381 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.513355    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:06:32.516666 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.516647    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c456f9f56-xpsfn"]
May 27 17:06:32.939866 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:32.939838    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0174cead-fdcb-4b1a-b03a-89113e162b88" path="/var/lib/kubelet/pods/0174cead-fdcb-4b1a-b03a-89113e162b88/volumes"
May 27 17:06:38.486349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:38.486321    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4jst8"
May 27 17:06:42.121099 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.121041    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b9d849d5-4hc6w" podUID="c53b520b-0817-4d49-83ce-d665c40a0cf3" containerName="console" containerID="cri-o://09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78" gracePeriod=15
May 27 17:06:42.371342 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.371290    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9d849d5-4hc6w_c53b520b-0817-4d49-83ce-d665c40a0cf3/console/0.log"
May 27 17:06:42.371452 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.371347    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:06:42.373508 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373490    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373571 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373519    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373571 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373544    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373571 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373561    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373708 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373690    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373774 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373724    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whmld\" (UniqueName: \"kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld\") pod \"c53b520b-0817-4d49-83ce-d665c40a0cf3\" (UID: \"c53b520b-0817-4d49-83ce-d665c40a0cf3\") "
May 27 17:06:42.373962 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373933    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca" (OuterVolumeSpecName: "service-ca") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:42.373962 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373945    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:42.374097 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.373948    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config" (OuterVolumeSpecName: "console-config") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:06:42.375649 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.375604    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:42.375870 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.375835    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:06:42.375945 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.375884    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld" (OuterVolumeSpecName: "kube-api-access-whmld") pod "c53b520b-0817-4d49-83ce-d665c40a0cf3" (UID: "c53b520b-0817-4d49-83ce-d665c40a0cf3"). InnerVolumeSpecName "kube-api-access-whmld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:06:42.474293 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474259    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.474293 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474287    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-serving-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.474293 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474297    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-service-ca\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.474546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474306    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c53b520b-0817-4d49-83ce-d665c40a0cf3-oauth-serving-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.474546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474315    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c53b520b-0817-4d49-83ce-d665c40a0cf3-console-oauth-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.474546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.474325    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whmld\" (UniqueName: \"kubernetes.io/projected/c53b520b-0817-4d49-83ce-d665c40a0cf3-kube-api-access-whmld\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:06:42.522736 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522705    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9d849d5-4hc6w_c53b520b-0817-4d49-83ce-d665c40a0cf3/console/0.log"
May 27 17:06:42.522919 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522747    2574 generic.go:358] "Generic (PLEG): container finished" podID="c53b520b-0817-4d49-83ce-d665c40a0cf3" containerID="09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78" exitCode=2
May 27 17:06:42.522919 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522795    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d849d5-4hc6w" event={"ID":"c53b520b-0817-4d49-83ce-d665c40a0cf3","Type":"ContainerDied","Data":"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"}
May 27 17:06:42.522919 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522822    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d849d5-4hc6w"
May 27 17:06:42.522919 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522833    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d849d5-4hc6w" event={"ID":"c53b520b-0817-4d49-83ce-d665c40a0cf3","Type":"ContainerDied","Data":"3759b1b1aea2057536eb19bc4bcd8335d9896c44b826c7759a2e2c8098f1ccf8"}
May 27 17:06:42.522919 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.522850    2574 scope.go:117] "RemoveContainer" containerID="09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"
May 27 17:06:42.530935 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.530918    2574 scope.go:117] "RemoveContainer" containerID="09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"
May 27 17:06:42.531196 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:06:42.531177    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78\": container with ID starting with 09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78 not found: ID does not exist" containerID="09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"
May 27 17:06:42.531252 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.531204    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78"} err="failed to get container status \"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78\": rpc error: code = NotFound desc = could not find container \"09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78\": container with ID starting with 09a8c0cf2552b7ee41046d9692340540a57c0eb16ec3bca0cc2d018038270d78 not found: ID does not exist"
May 27 17:06:42.543089 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.543068    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:06:42.547233 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.547209    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9d849d5-4hc6w"]
May 27 17:06:42.940427 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:06:42.940397    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c53b520b-0817-4d49-83ce-d665c40a0cf3" path="/var/lib/kubelet/pods/c53b520b-0817-4d49-83ce-d665c40a0cf3/volumes"
May 27 17:07:04.102520 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:04.102482    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:04.121519 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:04.121495    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:04.599584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:04.599562    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:22.015067 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015027    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:22.015642 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015530    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="prometheus" containerID="cri-o://a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3" gracePeriod=600
May 27 17:07:22.015642 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015569    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="config-reloader" containerID="cri-o://d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8" gracePeriod=600
May 27 17:07:22.015642 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015615    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755" gracePeriod=600
May 27 17:07:22.015642 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015622    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-web" containerID="cri-o://b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f" gracePeriod=600
May 27 17:07:22.015887 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015550    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy" containerID="cri-o://8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0" gracePeriod=600
May 27 17:07:22.015887 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.015577    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="thanos-sidecar" containerID="cri-o://ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94" gracePeriod=600
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636381    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755" exitCode=0
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636405    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0" exitCode=0
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636413    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94" exitCode=0
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636419    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8" exitCode=0
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636424    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3" exitCode=0
May 27 17:07:22.636465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636449    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"}
May 27 17:07:22.636741 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636481    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"}
May 27 17:07:22.636741 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636490    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"}
May 27 17:07:22.636741 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636499    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"}
May 27 17:07:22.636741 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:22.636507    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"}
May 27 17:07:23.258360 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.258337    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.363412 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363319    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.363412 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363359    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.363412 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363389    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.363697 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363415    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.363697 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363450    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.363697 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363483    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364594 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.363525    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364718 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364635    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364718 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364675    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364718 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364703    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364907 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364743    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364907 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364793    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364907 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364823    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.364907 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364868    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.365105 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364913    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.365105 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364958    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.365105 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364982    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnmjh\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.365105 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.365008    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle\") pod \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\" (UID: \"a92e0173-93a2-46f1-9f36-9bece6ea3e8d\") "
May 27 17:07:23.365876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364174    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:07:23.365876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.364511    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:07:23.365876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.365620    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:07:23.367550 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.366588    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:07:23.367550 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.366837    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.367550 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.367150    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:07:23.367792 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.367715    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:07:23.367852 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.367832    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.368163 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.367960    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.368163 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.368127    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:07:23.368372 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.368346    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config" (OuterVolumeSpecName: "config") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.368830 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.368691    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.368830 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.368797    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.369361 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.369332    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.369439 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.369395    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out" (OuterVolumeSpecName: "config-out") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:07:23.369695 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.369667    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh" (OuterVolumeSpecName: "kube-api-access-fnmjh") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "kube-api-access-fnmjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:07:23.369917 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.369896    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.378616 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.378591    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config" (OuterVolumeSpecName: "web-config") pod "a92e0173-93a2-46f1-9f36-9bece6ea3e8d" (UID: "a92e0173-93a2-46f1-9f36-9bece6ea3e8d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 17:07:23.465749 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465714    2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465749 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465742    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465755    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-web-config\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465791    2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-kube-rbac-proxy\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465805    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnmjh\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-kube-api-access-fnmjh\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465819    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465830    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-db\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465839    2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-grpc-tls\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465847    2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-metrics-client-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465856    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-tls-assets\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465864    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465874    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465905    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-configmap-metrics-client-ca\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465914    2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465922    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465931    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-config-out\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465939    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.465951 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.465949    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a92e0173-93a2-46f1-9f36-9bece6ea3e8d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:07:23.642282 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.642182    2574 generic.go:358] "Generic (PLEG): container finished" podID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerID="b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f" exitCode=0
May 27 17:07:23.642282 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.642229    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"}
May 27 17:07:23.642282 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.642256    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a92e0173-93a2-46f1-9f36-9bece6ea3e8d","Type":"ContainerDied","Data":"f40652c4153bc33ad7a207b0d4b57c17a71dd0b5b09433e85926436b814d50e4"}
May 27 17:07:23.642282 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.642272    2574 scope.go:117] "RemoveContainer" containerID="ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"
May 27 17:07:23.642598 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.642304    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.650808 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.650788    2574 scope.go:117] "RemoveContainer" containerID="8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"
May 27 17:07:23.657710 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.657692    2574 scope.go:117] "RemoveContainer" containerID="b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"
May 27 17:07:23.663668 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.663654    2574 scope.go:117] "RemoveContainer" containerID="ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"
May 27 17:07:23.669217 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.669195    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:23.670145 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.670124    2574 scope.go:117] "RemoveContainer" containerID="d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"
May 27 17:07:23.673511 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.673492    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:23.676571 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.676552    2574 scope.go:117] "RemoveContainer" containerID="a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"
May 27 17:07:23.682989 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.682975    2574 scope.go:117] "RemoveContainer" containerID="cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354"
May 27 17:07:23.690574 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.689959    2574 scope.go:117] "RemoveContainer" containerID="ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"
May 27 17:07:23.690830 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.690807    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755\": container with ID starting with ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755 not found: ID does not exist" containerID="ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"
May 27 17:07:23.690946 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.690840    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755"} err="failed to get container status \"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755\": rpc error: code = NotFound desc = could not find container \"ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755\": container with ID starting with ec023b930e5f514218b00868f8b9eae9b540cab29a5f86f5b22f3dd392f6e755 not found: ID does not exist"
May 27 17:07:23.690946 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.690865    2574 scope.go:117] "RemoveContainer" containerID="8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"
May 27 17:07:23.691163 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.691146    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0\": container with ID starting with 8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0 not found: ID does not exist" containerID="8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"
May 27 17:07:23.691215 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691169    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0"} err="failed to get container status \"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0\": rpc error: code = NotFound desc = could not find container \"8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0\": container with ID starting with 8f194c6a552ab009267967d43fb7ff8779b2f57184fec9663b02afe817a9f4b0 not found: ID does not exist"
May 27 17:07:23.691215 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691188    2574 scope.go:117] "RemoveContainer" containerID="b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"
May 27 17:07:23.691440 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.691423    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f\": container with ID starting with b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f not found: ID does not exist" containerID="b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"
May 27 17:07:23.691487 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691449    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f"} err="failed to get container status \"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f\": rpc error: code = NotFound desc = could not find container \"b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f\": container with ID starting with b68cba9a02dffb798c43ff8026d5a2350fe94bfaf0146a0ad5cf46bfbff6908f not found: ID does not exist"
May 27 17:07:23.691487 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691465    2574 scope.go:117] "RemoveContainer" containerID="ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"
May 27 17:07:23.691699 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.691683    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94\": container with ID starting with ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94 not found: ID does not exist" containerID="ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"
May 27 17:07:23.691743 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691704    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94"} err="failed to get container status \"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94\": rpc error: code = NotFound desc = could not find container \"ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94\": container with ID starting with ba7334d514c505b96469902278f42d6bd9365cf5c638a7655b2b990b824d4d94 not found: ID does not exist"
May 27 17:07:23.691743 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691719    2574 scope.go:117] "RemoveContainer" containerID="d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"
May 27 17:07:23.691940 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.691923    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8\": container with ID starting with d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8 not found: ID does not exist" containerID="d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"
May 27 17:07:23.691982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691944    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8"} err="failed to get container status \"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8\": rpc error: code = NotFound desc = could not find container \"d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8\": container with ID starting with d8f4f848b1162932064ad5abbcb6f8bcccb2dfa92d82394dcaf79965fb06e3b8 not found: ID does not exist"
May 27 17:07:23.691982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.691960    2574 scope.go:117] "RemoveContainer" containerID="a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"
May 27 17:07:23.692184 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.692166    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3\": container with ID starting with a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3 not found: ID does not exist" containerID="a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"
May 27 17:07:23.692246 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.692192    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3"} err="failed to get container status \"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3\": rpc error: code = NotFound desc = could not find container \"a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3\": container with ID starting with a1dfe73203a76c75ef3af6f980efd8070ce6ee8269027c2515b58b6da541c5c3 not found: ID does not exist"
May 27 17:07:23.692246 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.692212    2574 scope.go:117] "RemoveContainer" containerID="cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354"
May 27 17:07:23.692448 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:07:23.692433    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354\": container with ID starting with cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354 not found: ID does not exist" containerID="cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354"
May 27 17:07:23.692482 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.692469    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354"} err="failed to get container status \"cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354\": rpc error: code = NotFound desc = could not find container \"cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354\": container with ID starting with cd23f109c0002935ad4a44f3b0119701cc7733092fcf23f74dc4c24eeb2fc354 not found: ID does not exist"
May 27 17:07:23.696876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.696855    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:23.697161 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697145    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="prometheus"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697165    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="prometheus"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697175    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0174cead-fdcb-4b1a-b03a-89113e162b88" containerName="console"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697184    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0174cead-fdcb-4b1a-b03a-89113e162b88" containerName="console"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697196    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="thanos-sidecar"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697205    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="thanos-sidecar"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697213    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-thanos"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697222    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-thanos"
May 27 17:07:23.697238 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697234    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="init-config-reloader"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697242    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="init-config-reloader"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697252    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53b520b-0817-4d49-83ce-d665c40a0cf3" containerName="console"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697260    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53b520b-0817-4d49-83ce-d665c40a0cf3" containerName="console"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697278    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697287    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697299    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="config-reloader"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697307    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="config-reloader"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697317    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-web"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697325    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-web"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697390    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="config-reloader"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697402    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697412    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-thanos"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697423    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="thanos-sidecar"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697432    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="0174cead-fdcb-4b1a-b03a-89113e162b88" containerName="console"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697443    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="kube-rbac-proxy-web"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697453    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" containerName="prometheus"
May 27 17:07:23.697604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.697463    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="c53b520b-0817-4d49-83ce-d665c40a0cf3" containerName="console"
May 27 17:07:23.702946 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.702928    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.705784 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.705740    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 27 17:07:23.705784 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.705742    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 27 17:07:23.705784 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.705745    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 27 17:07:23.705941 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.705830    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rw5qm\""
May 27 17:07:23.705985 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.705975    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 27 17:07:23.706064 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706047    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 27 17:07:23.706264 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706248    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 27 17:07:23.706386 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706371    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 17:07:23.706471 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706427    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 27 17:07:23.706877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706847    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 27 17:07:23.706984 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706888    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 27 17:07:23.706984 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706847    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-324f17vkk666b\""
May 27 17:07:23.706984 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.706920    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 27 17:07:23.709399 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.709373    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 27 17:07:23.710896 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.710876    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 27 17:07:23.715551 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.715530    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:23.768239 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-web-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768490    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l856s\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-kube-api-access-l856s\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768603    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-config-out\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.768832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.768675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869676 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869638    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869676 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869675    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869921 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869697    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869921 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869720    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869921 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869735    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.869921 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869879    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-web-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869917    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869951    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.869994    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870023    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870051    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870078    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l856s\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-kube-api-access-l856s\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870114    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870131    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870152    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870187    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-config-out\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870215    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870269    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870299    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870522    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870562    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.871306 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.870750    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.872856    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-web-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.872984    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.873049    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-config\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.873198    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.873243    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873081 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.873349    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.873908 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.873635    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.874114 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.874090    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10090078-2a58-4309-8b4c-d8c5da92c639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.874653 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.874624    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.875131 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.875112    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.875318 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.875296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10090078-2a58-4309-8b4c-d8c5da92c639-config-out\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.875577 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.875561    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.875681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.875666    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10090078-2a58-4309-8b4c-d8c5da92c639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:23.881848 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:23.881833    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l856s\" (UniqueName: \"kubernetes.io/projected/10090078-2a58-4309-8b4c-d8c5da92c639-kube-api-access-l856s\") pod \"prometheus-k8s-0\" (UID: \"10090078-2a58-4309-8b4c-d8c5da92c639\") " pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:24.012217 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.012184    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:07:24.143248 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.143040    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 27 17:07:24.145655 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:07:24.145627    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10090078_2a58_4309_8b4c_d8c5da92c639.slice/crio-ed7eef8370164a321b0b3a66b7c7393519e62f731a79b90baec4a1896ac07ce4 WatchSource:0}: Error finding container ed7eef8370164a321b0b3a66b7c7393519e62f731a79b90baec4a1896ac07ce4: Status 404 returned error can't find the container with id ed7eef8370164a321b0b3a66b7c7393519e62f731a79b90baec4a1896ac07ce4
May 27 17:07:24.646212 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.646174    2574 generic.go:358] "Generic (PLEG): container finished" podID="10090078-2a58-4309-8b4c-d8c5da92c639" containerID="ba47f8ab73d0beb8c1962017d500c2259771c1929160ce5d12a2b1609b185a43" exitCode=0
May 27 17:07:24.646634 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.646264    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerDied","Data":"ba47f8ab73d0beb8c1962017d500c2259771c1929160ce5d12a2b1609b185a43"}
May 27 17:07:24.646634 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.646296    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"ed7eef8370164a321b0b3a66b7c7393519e62f731a79b90baec4a1896ac07ce4"}
May 27 17:07:24.941424 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:24.941388    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a92e0173-93a2-46f1-9f36-9bece6ea3e8d" path="/var/lib/kubelet/pods/a92e0173-93a2-46f1-9f36-9bece6ea3e8d/volumes"
May 27 17:07:25.653307 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653273    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"45500dedb88737fdca65744cc7265c8b996431ec1433a7f3072a48e5279645ed"}
May 27 17:07:25.653307 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653308    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"922a6dd8e4f708294cb8ca2725bd58401f432753c40501934a7d2f64d47fa006"}
May 27 17:07:25.653725 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653320    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"7e95dd6fa77922797f33aeb71a014a31d63dce61e5797b5b8a998e02253b6a6f"}
May 27 17:07:25.653725 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653329    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"acb1ceded92d1489b1ea9039f85ed44fa00750ec571eaabca67ec6871c8710e3"}
May 27 17:07:25.653725 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653337    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"3865d5a45ea591dfc05104e490b724788e38a7bf4eabe7b7386073cb30bebe55"}
May 27 17:07:25.653725 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.653345    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10090078-2a58-4309-8b4c-d8c5da92c639","Type":"ContainerStarted","Data":"5b7e19f3a5e692342ed6fcd955c4f663a6856ed785955186df38a5f3859a4f5c"}
May 27 17:07:25.681223 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:25.681176    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6811622980000003 podStartE2EDuration="2.681162298s" podCreationTimestamp="2026-05-27 17:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:07:25.679203002 +0000 UTC m=+221.353628096" watchObservedRunningTime="2026-05-27 17:07:25.681162298 +0000 UTC m=+221.355587402"
May 27 17:07:29.012561 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:07:29.012524    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:08:24.013375 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:24.013342    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:08:24.028304 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:24.028275    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:08:24.827428 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:24.827404    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 27 17:08:44.859299 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:44.859267    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:08:44.859925 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:44.859660    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:08:44.862978 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:08:44.862958    2574 kubelet.go:1628] "Image garbage collection succeeded"
May 27 17:10:37.375336 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.375301    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ftckq"]
May 27 17:10:37.378643 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.378622    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.381666 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.381646    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 27 17:10:37.381747 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.381645    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rkcks\""
May 27 17:10:37.383201 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.383187    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 27 17:10:37.387250 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.387230    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ftckq"]
May 27 17:10:37.453472 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.453446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.453591 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.453505    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5229w\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-kube-api-access-5229w\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.553892 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.553858    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5229w\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-kube-api-access-5229w\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.553997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.553919    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.563341 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.563311    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.563447 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.563432    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5229w\" (UniqueName: \"kubernetes.io/projected/d80fa521-f8fc-4ced-a0cb-4a0442bfdf23-kube-api-access-5229w\") pod \"cert-manager-webhook-587ccfb98-ftckq\" (UID: \"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.687345 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.687320    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:37.809670 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.809640    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ftckq"]
May 27 17:10:37.812670 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:10:37.812635    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd80fa521_f8fc_4ced_a0cb_4a0442bfdf23.slice/crio-fee440407c5e2739437056e7a609f0de87bae67fe119f3059717362d5f88b9fa WatchSource:0}: Error finding container fee440407c5e2739437056e7a609f0de87bae67fe119f3059717362d5f88b9fa: Status 404 returned error can't find the container with id fee440407c5e2739437056e7a609f0de87bae67fe119f3059717362d5f88b9fa
May 27 17:10:37.814395 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:37.814380    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:10:38.152091 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:38.152015    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq" event={"ID":"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23","Type":"ContainerStarted","Data":"fee440407c5e2739437056e7a609f0de87bae67fe119f3059717362d5f88b9fa"}
May 27 17:10:43.170357 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:43.170321    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq" event={"ID":"d80fa521-f8fc-4ced-a0cb-4a0442bfdf23","Type":"ContainerStarted","Data":"7a6193796499cbc6d603e55b76bd3740f5995ab23906a0065c5a8dc484b1b6ed"}
May 27 17:10:43.170712 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:43.170373    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:43.189076 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:43.189034    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq" podStartSLOduration=1.663665403 podStartE2EDuration="6.18902061s" podCreationTimestamp="2026-05-27 17:10:37 +0000 UTC" firstStartedPulling="2026-05-27 17:10:37.814506709 +0000 UTC m=+413.488931780" lastFinishedPulling="2026-05-27 17:10:42.339861911 +0000 UTC m=+418.014286987" observedRunningTime="2026-05-27 17:10:43.188100156 +0000 UTC m=+418.862525249" watchObservedRunningTime="2026-05-27 17:10:43.18902061 +0000 UTC m=+418.863445704"
May 27 17:10:49.175529 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:49.175493    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-ftckq"
May 27 17:10:56.583465 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.583428    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2vfn9"]
May 27 17:10:56.586789 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.586750    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.589713 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.589690    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jcdz7\""
May 27 17:10:56.593889 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.593846    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2vfn9"]
May 27 17:10:56.690014 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.689972    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-bound-sa-token\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.690014 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.690019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw4fm\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-kube-api-access-mw4fm\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.791342 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.791310    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw4fm\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-kube-api-access-mw4fm\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.791492 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.791391    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-bound-sa-token\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.800076 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.800045    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-bound-sa-token\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.800186 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.800172    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw4fm\" (UniqueName: \"kubernetes.io/projected/4b182757-44e2-4d20-b287-9c834fe1757b-kube-api-access-mw4fm\") pod \"cert-manager-79c8d999ff-2vfn9\" (UID: \"4b182757-44e2-4d20-b287-9c834fe1757b\") " pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:56.896212 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:56.896127    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-2vfn9"
May 27 17:10:57.023982 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:57.023953    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2vfn9"]
May 27 17:10:57.027833 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:10:57.027806    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b182757_44e2_4d20_b287_9c834fe1757b.slice/crio-2a916785a846e2cdc9feb36bfa77808369c20615c3fa8e0003d973629c4eeade WatchSource:0}: Error finding container 2a916785a846e2cdc9feb36bfa77808369c20615c3fa8e0003d973629c4eeade: Status 404 returned error can't find the container with id 2a916785a846e2cdc9feb36bfa77808369c20615c3fa8e0003d973629c4eeade
May 27 17:10:57.209621 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:57.209591    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-2vfn9" event={"ID":"4b182757-44e2-4d20-b287-9c834fe1757b","Type":"ContainerStarted","Data":"5a1d9620d449eb15557a8390355c6882f4b3e293ebf9f1352b9d6d508961ccf1"}
May 27 17:10:57.209621 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:10:57.209625    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-2vfn9" event={"ID":"4b182757-44e2-4d20-b287-9c834fe1757b","Type":"ContainerStarted","Data":"2a916785a846e2cdc9feb36bfa77808369c20615c3fa8e0003d973629c4eeade"}
May 27 17:11:08.243818 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.243702    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-2vfn9" podStartSLOduration=12.243672017 podStartE2EDuration="12.243672017s" podCreationTimestamp="2026-05-27 17:10:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:10:57.224484178 +0000 UTC m=+432.898909268" watchObservedRunningTime="2026-05-27 17:11:08.243672017 +0000 UTC m=+443.918097089"
May 27 17:11:08.245375 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.245350    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"]
May 27 17:11:08.248630 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.248614    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.252501 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.252481    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 17:11:08.252610 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.252513    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 17:11:08.252610 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.252524    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 17:11:08.252610 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.252477    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4m86b\""
May 27 17:11:08.256632 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.256614    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 17:11:08.273273 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.273253    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"]
May 27 17:11:08.293047 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.293025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnl9b\" (UniqueName: \"kubernetes.io/projected/9d508889-c76e-469e-a1d2-74e9737e8576-kube-api-access-vnl9b\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.293166 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.293061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.293166 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.293087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-webhook-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.393676 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.393644    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnl9b\" (UniqueName: \"kubernetes.io/projected/9d508889-c76e-469e-a1d2-74e9737e8576-kube-api-access-vnl9b\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.393904 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.393688    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.393904 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.393712    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-webhook-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.396192 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.396169    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.396294 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.396179    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d508889-c76e-469e-a1d2-74e9737e8576-webhook-cert\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.402703 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.402680    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnl9b\" (UniqueName: \"kubernetes.io/projected/9d508889-c76e-469e-a1d2-74e9737e8576-kube-api-access-vnl9b\") pod \"opendatahub-operator-controller-manager-854fc5c4fb-tpzh8\" (UID: \"9d508889-c76e-469e-a1d2-74e9737e8576\") " pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.559324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.559232    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:08.710290 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:08.710262    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"]
May 27 17:11:08.712297 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:11:08.712271    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d508889_c76e_469e_a1d2_74e9737e8576.slice/crio-e41efb6e98152edf4b754364329a844582b95caac901cdb0bfc7d43b24ea8a23 WatchSource:0}: Error finding container e41efb6e98152edf4b754364329a844582b95caac901cdb0bfc7d43b24ea8a23: Status 404 returned error can't find the container with id e41efb6e98152edf4b754364329a844582b95caac901cdb0bfc7d43b24ea8a23
May 27 17:11:09.246295 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:09.246243    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8" event={"ID":"9d508889-c76e-469e-a1d2-74e9737e8576","Type":"ContainerStarted","Data":"e41efb6e98152edf4b754364329a844582b95caac901cdb0bfc7d43b24ea8a23"}
May 27 17:11:12.256895 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:12.256863    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8" event={"ID":"9d508889-c76e-469e-a1d2-74e9737e8576","Type":"ContainerStarted","Data":"fdfa4edf2a781a01343df854f309746c5561672aff5bcf9915e6f27d0f130836"}
May 27 17:11:12.257256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:12.256914    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:12.280079 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:12.280031    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8" podStartSLOduration=1.781493608 podStartE2EDuration="4.280017432s" podCreationTimestamp="2026-05-27 17:11:08 +0000 UTC" firstStartedPulling="2026-05-27 17:11:08.713901612 +0000 UTC m=+444.388326683" lastFinishedPulling="2026-05-27 17:11:11.212425427 +0000 UTC m=+446.886850507" observedRunningTime="2026-05-27 17:11:12.278111867 +0000 UTC m=+447.952536960" watchObservedRunningTime="2026-05-27 17:11:12.280017432 +0000 UTC m=+447.954442524"
May 27 17:11:23.261556 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:23.261526    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-854fc5c4fb-tpzh8"
May 27 17:11:29.477074 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.477043    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-mzrcm"]
May 27 17:11:29.483683 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.483659    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:29.486413 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.486389    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 27 17:11:29.487579 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.487556    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7wbrt\""
May 27 17:11:29.488324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.488301    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-mzrcm"]
May 27 17:11:29.576057 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.576020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:29.576234 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.576091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qfm\" (UniqueName: \"kubernetes.io/projected/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-kube-api-access-t6qfm\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:29.677372 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.677338    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qfm\" (UniqueName: \"kubernetes.io/projected/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-kube-api-access-t6qfm\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:29.677528 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.677385    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:29.677528 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:29.677482    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 27 17:11:29.677631 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:29.677539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert podName:ae131f8d-eb3d-4282-ae54-b81eeac9d5ee nodeName:}" failed. No retries permitted until 2026-05-27 17:11:30.177523912 +0000 UTC m=+465.851948983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert") pod "odh-model-controller-858dbf95b8-mzrcm" (UID: "ae131f8d-eb3d-4282-ae54-b81eeac9d5ee") : secret "odh-model-controller-webhook-cert" not found
May 27 17:11:29.688480 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:29.688454    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qfm\" (UniqueName: \"kubernetes.io/projected/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-kube-api-access-t6qfm\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:30.182450 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:30.182414    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:30.184749 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:30.184721    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae131f8d-eb3d-4282-ae54-b81eeac9d5ee-cert\") pod \"odh-model-controller-858dbf95b8-mzrcm\" (UID: \"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee\") " pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:30.394392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:30.394358    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:30.519891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:30.519867    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-mzrcm"]
May 27 17:11:30.522397 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:11:30.522359    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae131f8d_eb3d_4282_ae54_b81eeac9d5ee.slice/crio-b693338c5faf3f2b0363e47e0e741d8ec6c0fed587fe9183633993bf2365a634 WatchSource:0}: Error finding container b693338c5faf3f2b0363e47e0e741d8ec6c0fed587fe9183633993bf2365a634: Status 404 returned error can't find the container with id b693338c5faf3f2b0363e47e0e741d8ec6c0fed587fe9183633993bf2365a634
May 27 17:11:31.318200 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:31.318156    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" event={"ID":"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee","Type":"ContainerStarted","Data":"b693338c5faf3f2b0363e47e0e741d8ec6c0fed587fe9183633993bf2365a634"}
May 27 17:11:34.329431 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.329390    2574 generic.go:358] "Generic (PLEG): container finished" podID="ae131f8d-eb3d-4282-ae54-b81eeac9d5ee" containerID="527650e2a9396fa4d6c842692115d123b652694c7ba6fb9e650b51cd42c9b03f" exitCode=1
May 27 17:11:34.329431 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.329431    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" event={"ID":"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee","Type":"ContainerDied","Data":"527650e2a9396fa4d6c842692115d123b652694c7ba6fb9e650b51cd42c9b03f"}
May 27 17:11:34.329986 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.329782    2574 scope.go:117] "RemoveContainer" containerID="527650e2a9396fa4d6c842692115d123b652694c7ba6fb9e650b51cd42c9b03f"
May 27 17:11:34.906858 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.906824    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9wjns"]
May 27 17:11:34.910041 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.910023    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:34.912601 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.912574    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 27 17:11:34.912728 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.912611    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qcnpf\""
May 27 17:11:34.918586 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:34.918535    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9wjns"]
May 27 17:11:35.028028 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.027998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wggb9\" (UniqueName: \"kubernetes.io/projected/63379391-d23c-43f9-9b90-4067dac0816f-kube-api-access-wggb9\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.028264 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.028053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.128801 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.128746    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wggb9\" (UniqueName: \"kubernetes.io/projected/63379391-d23c-43f9-9b90-4067dac0816f-kube-api-access-wggb9\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.128976 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.128831    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.128976 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:35.128937    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 27 17:11:35.129047 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:35.128998    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert podName:63379391-d23c-43f9-9b90-4067dac0816f nodeName:}" failed. No retries permitted until 2026-05-27 17:11:35.628978492 +0000 UTC m=+471.303403569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert") pod "kserve-controller-manager-856948b99f-9wjns" (UID: "63379391-d23c-43f9-9b90-4067dac0816f") : secret "kserve-webhook-server-cert" not found
May 27 17:11:35.142509 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.142476    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggb9\" (UniqueName: \"kubernetes.io/projected/63379391-d23c-43f9-9b90-4067dac0816f-kube-api-access-wggb9\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.333949 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.333862    2574 generic.go:358] "Generic (PLEG): container finished" podID="ae131f8d-eb3d-4282-ae54-b81eeac9d5ee" containerID="308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c" exitCode=1
May 27 17:11:35.333949 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.333908    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" event={"ID":"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee","Type":"ContainerDied","Data":"308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c"}
May 27 17:11:35.333949 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.333942    2574 scope.go:117] "RemoveContainer" containerID="527650e2a9396fa4d6c842692115d123b652694c7ba6fb9e650b51cd42c9b03f"
May 27 17:11:35.334412 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.334226    2574 scope.go:117] "RemoveContainer" containerID="308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c"
May 27 17:11:35.334465 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:35.334415    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-mzrcm_opendatahub(ae131f8d-eb3d-4282-ae54-b81eeac9d5ee)\"" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" podUID="ae131f8d-eb3d-4282-ae54-b81eeac9d5ee"
May 27 17:11:35.633349 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:35.633268    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:35.633475 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:35.633403    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 27 17:11:35.633475 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:35.633463    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert podName:63379391-d23c-43f9-9b90-4067dac0816f nodeName:}" failed. No retries permitted until 2026-05-27 17:11:36.633448347 +0000 UTC m=+472.307873417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert") pod "kserve-controller-manager-856948b99f-9wjns" (UID: "63379391-d23c-43f9-9b90-4067dac0816f") : secret "kserve-webhook-server-cert" not found
May 27 17:11:36.338594 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.338570    2574 scope.go:117] "RemoveContainer" containerID="308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c"
May 27 17:11:36.339015 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:36.338722    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-mzrcm_opendatahub(ae131f8d-eb3d-4282-ae54-b81eeac9d5ee)\"" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" podUID="ae131f8d-eb3d-4282-ae54-b81eeac9d5ee"
May 27 17:11:36.639933 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.639839    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:36.642168 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.642139    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63379391-d23c-43f9-9b90-4067dac0816f-cert\") pod \"kserve-controller-manager-856948b99f-9wjns\" (UID: \"63379391-d23c-43f9-9b90-4067dac0816f\") " pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:36.720576 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.720546    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:36.847860 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.847836    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-9wjns"]
May 27 17:11:36.850378 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:11:36.850349    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63379391_d23c_43f9_9b90_4067dac0816f.slice/crio-3b8bf95783095651d22cf002346e90030ef36651342d600c6956648475fc3fd8 WatchSource:0}: Error finding container 3b8bf95783095651d22cf002346e90030ef36651342d600c6956648475fc3fd8: Status 404 returned error can't find the container with id 3b8bf95783095651d22cf002346e90030ef36651342d600c6956648475fc3fd8
May 27 17:11:36.947635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.947604    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"]
May 27 17:11:36.952077 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.952057    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:36.955347 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.955319    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 27 17:11:36.955464 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.955353    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 27 17:11:36.955464 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.955357    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dvrf8\""
May 27 17:11:36.956607 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.956551    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 17:11:36.956607 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.956554    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 17:11:36.962649 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:36.962629    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"]
May 27 17:11:37.042839 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.042815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl4jx\" (UniqueName: \"kubernetes.io/projected/7491029b-0abd-4335-bffd-7edf8d6336c3-kube-api-access-cl4jx\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.042952 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.042853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7491029b-0abd-4335-bffd-7edf8d6336c3-tmp\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.042952 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.042885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.144046 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.144017    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7491029b-0abd-4335-bffd-7edf8d6336c3-tmp\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.144161 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.144062    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.144161 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.144108    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl4jx\" (UniqueName: \"kubernetes.io/projected/7491029b-0abd-4335-bffd-7edf8d6336c3-kube-api-access-cl4jx\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.144242 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:37.144227    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 27 17:11:37.144298 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:37.144288    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs podName:7491029b-0abd-4335-bffd-7edf8d6336c3 nodeName:}" failed. No retries permitted until 2026-05-27 17:11:37.644270827 +0000 UTC m=+473.318695912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs") pod "kube-auth-proxy-69f455b956-k6bsh" (UID: "7491029b-0abd-4335-bffd-7edf8d6336c3") : secret "kube-auth-proxy-tls" not found
May 27 17:11:37.146240 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.146219    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7491029b-0abd-4335-bffd-7edf8d6336c3-tmp\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.158836 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.158819    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl4jx\" (UniqueName: \"kubernetes.io/projected/7491029b-0abd-4335-bffd-7edf8d6336c3-kube-api-access-cl4jx\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.342567 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.342484    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns" event={"ID":"63379391-d23c-43f9-9b90-4067dac0816f","Type":"ContainerStarted","Data":"3b8bf95783095651d22cf002346e90030ef36651342d600c6956648475fc3fd8"}
May 27 17:11:37.648745 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.648664    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.650971 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.650943    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7491029b-0abd-4335-bffd-7edf8d6336c3-tls-certs\") pod \"kube-auth-proxy-69f455b956-k6bsh\" (UID: \"7491029b-0abd-4335-bffd-7edf8d6336c3\") " pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.862327 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.862291    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"
May 27 17:11:37.985305 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:37.985282    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f455b956-k6bsh"]
May 27 17:11:37.987036 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:11:37.987007    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7491029b_0abd_4335_bffd_7edf8d6336c3.slice/crio-0eb34798db8b967a98274e6eef5278898b5bed1a8ab8dd2045f7bceff6c820dc WatchSource:0}: Error finding container 0eb34798db8b967a98274e6eef5278898b5bed1a8ab8dd2045f7bceff6c820dc: Status 404 returned error can't find the container with id 0eb34798db8b967a98274e6eef5278898b5bed1a8ab8dd2045f7bceff6c820dc
May 27 17:11:38.347514 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:38.347475    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh" event={"ID":"7491029b-0abd-4335-bffd-7edf8d6336c3","Type":"ContainerStarted","Data":"0eb34798db8b967a98274e6eef5278898b5bed1a8ab8dd2045f7bceff6c820dc"}
May 27 17:11:40.395026 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:40.394990    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:40.395485 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:40.395475    2574 scope.go:117] "RemoveContainer" containerID="308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c"
May 27 17:11:40.395728 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:11:40.395700    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-mzrcm_opendatahub(ae131f8d-eb3d-4282-ae54-b81eeac9d5ee)\"" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" podUID="ae131f8d-eb3d-4282-ae54-b81eeac9d5ee"
May 27 17:11:41.360983 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:41.360949    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns" event={"ID":"63379391-d23c-43f9-9b90-4067dac0816f","Type":"ContainerStarted","Data":"eae33e67162278553a582278e11547c3d6400ee874c1da0bcfd857f0582e9e8a"}
May 27 17:11:41.361170 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:41.361064    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:11:41.376603 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:41.376527    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns" podStartSLOduration=3.422748186 podStartE2EDuration="7.376483413s" podCreationTimestamp="2026-05-27 17:11:34 +0000 UTC" firstStartedPulling="2026-05-27 17:11:36.852395457 +0000 UTC m=+472.526820543" lastFinishedPulling="2026-05-27 17:11:40.806130692 +0000 UTC m=+476.480555770" observedRunningTime="2026-05-27 17:11:41.376269245 +0000 UTC m=+477.050694339" watchObservedRunningTime="2026-05-27 17:11:41.376483413 +0000 UTC m=+477.050908507"
May 27 17:11:42.365138 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:42.365058    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh" event={"ID":"7491029b-0abd-4335-bffd-7edf8d6336c3","Type":"ContainerStarted","Data":"109336019d8fc240a6b8140723cf02ad826fafa9cfcc5f55a5d7e6bbf660e3df"}
May 27 17:11:42.383978 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:42.383922    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69f455b956-k6bsh" podStartSLOduration=2.333921491 podStartE2EDuration="6.383909808s" podCreationTimestamp="2026-05-27 17:11:36 +0000 UTC" firstStartedPulling="2026-05-27 17:11:37.988716096 +0000 UTC m=+473.663141170" lastFinishedPulling="2026-05-27 17:11:42.038704416 +0000 UTC m=+477.713129487" observedRunningTime="2026-05-27 17:11:42.382522931 +0000 UTC m=+478.056948024" watchObservedRunningTime="2026-05-27 17:11:42.383909808 +0000 UTC m=+478.058334900"
May 27 17:11:50.394624 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:50.394595    2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:50.395027 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:50.394980    2574 scope.go:117] "RemoveContainer" containerID="308431c03e3daa9271645946fa8fe85e4ffc84ef9676eb58625aa66e4560209c"
May 27 17:11:51.397452 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:51.397416    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" event={"ID":"ae131f8d-eb3d-4282-ae54-b81eeac9d5ee","Type":"ContainerStarted","Data":"528ea7feb200c7e18ffa47e166478740badc6d954b7c834a4f34dea94fa840fc"}
May 27 17:11:51.397883 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:51.397628    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:11:51.426469 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:51.426417    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm" podStartSLOduration=2.253920934 podStartE2EDuration="22.426402784s" podCreationTimestamp="2026-05-27 17:11:29 +0000 UTC" firstStartedPulling="2026-05-27 17:11:30.523629505 +0000 UTC m=+466.198054580" lastFinishedPulling="2026-05-27 17:11:50.696111345 +0000 UTC m=+486.370536430" observedRunningTime="2026-05-27 17:11:51.425188007 +0000 UTC m=+487.099613101" watchObservedRunningTime="2026-05-27 17:11:51.426402784 +0000 UTC m=+487.100827878"
May 27 17:11:52.525478 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.525445    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"]
May 27 17:11:52.528922 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.528902    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.531392 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.531374    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 27 17:11:52.531519 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.531397    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-p9g4b\""
May 27 17:11:52.531519 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.531409    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 27 17:11:52.539867 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.539836    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"]
May 27 17:11:52.576458 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.576430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/016f502e-a9ff-4131-92a8-6c0b3c0796f4-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.576599 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.576462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxq6m\" (UniqueName: \"kubernetes.io/projected/016f502e-a9ff-4131-92a8-6c0b3c0796f4-kube-api-access-kxq6m\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.677406 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.677373    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/016f502e-a9ff-4131-92a8-6c0b3c0796f4-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.677406 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.677408    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxq6m\" (UniqueName: \"kubernetes.io/projected/016f502e-a9ff-4131-92a8-6c0b3c0796f4-kube-api-access-kxq6m\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.680295 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.680268    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/016f502e-a9ff-4131-92a8-6c0b3c0796f4-operator-config\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.694904 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.694879    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxq6m\" (UniqueName: \"kubernetes.io/projected/016f502e-a9ff-4131-92a8-6c0b3c0796f4-kube-api-access-kxq6m\") pod \"servicemesh-operator3-55f49c5f94-kmnc7\" (UID: \"016f502e-a9ff-4131-92a8-6c0b3c0796f4\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.840278 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.840197    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:52.971555 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:52.971521    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"]
May 27 17:11:52.975021 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:11:52.974995    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016f502e_a9ff_4131_92a8_6c0b3c0796f4.slice/crio-b8d2b1e5aa2bc4b50ee6775914b8275934b2dc5eda5aa6bdb9beb9d562a488a1 WatchSource:0}: Error finding container b8d2b1e5aa2bc4b50ee6775914b8275934b2dc5eda5aa6bdb9beb9d562a488a1: Status 404 returned error can't find the container with id b8d2b1e5aa2bc4b50ee6775914b8275934b2dc5eda5aa6bdb9beb9d562a488a1
May 27 17:11:53.404092 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:53.404060    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7" event={"ID":"016f502e-a9ff-4131-92a8-6c0b3c0796f4","Type":"ContainerStarted","Data":"b8d2b1e5aa2bc4b50ee6775914b8275934b2dc5eda5aa6bdb9beb9d562a488a1"}
May 27 17:11:56.417158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:56.417112    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7" event={"ID":"016f502e-a9ff-4131-92a8-6c0b3c0796f4","Type":"ContainerStarted","Data":"12fde4b4b909807316f33c64e08e28d5f0cc101cf8a59ab0b75a1b66aada1076"}
May 27 17:11:56.417581 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:56.417186    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:11:56.438158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:11:56.438111    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7" podStartSLOduration=1.108034021 podStartE2EDuration="4.438095114s" podCreationTimestamp="2026-05-27 17:11:52 +0000 UTC" firstStartedPulling="2026-05-27 17:11:52.977643169 +0000 UTC m=+488.652068240" lastFinishedPulling="2026-05-27 17:11:56.307704259 +0000 UTC m=+491.982129333" observedRunningTime="2026-05-27 17:11:56.435520335 +0000 UTC m=+492.109945428" watchObservedRunningTime="2026-05-27 17:11:56.438095114 +0000 UTC m=+492.112520209"
May 27 17:12:02.402790 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:02.402738    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-mzrcm"
May 27 17:12:07.421876 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:07.421848    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-kmnc7"
May 27 17:12:08.671853 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.671815    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"]
May 27 17:12:08.677498 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.677482    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.681684 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.681663    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 27 17:12:08.681684 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.681675    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nnw78\""
May 27 17:12:08.687165 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.687146    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 27 17:12:08.687269 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.687181    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 27 17:12:08.688215 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.688201    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 27 17:12:08.698364 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.698341    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"]
May 27 17:12:08.814735 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.814936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814746    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn47m\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-kube-api-access-vn47m\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.814936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.814936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814912    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.815082 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d843336d-ee2f-4793-b070-65f7f00f3ba1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.815082 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.814986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.815157 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.815099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916422 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916384    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916438    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d843336d-ee2f-4793-b070-65f7f00f3ba1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916464    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916527    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916561    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916592    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn47m\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-kube-api-access-vn47m\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.916634    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.917154 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.917102    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.919055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.919004    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d843336d-ee2f-4793-b070-65f7f00f3ba1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.919055 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.919022    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.919360 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.919323    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.919474 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.919430    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d843336d-ee2f-4793-b070-65f7f00f3ba1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.936454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.936384    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn47m\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-kube-api-access-vn47m\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.938049 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.938028    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d843336d-ee2f-4793-b070-65f7f00f3ba1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mslcs\" (UID: \"d843336d-ee2f-4793-b070-65f7f00f3ba1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:08.987317 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:08.987267    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:09.137211 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:09.137182    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"]
May 27 17:12:09.138347 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:12:09.138321    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd843336d_ee2f_4793_b070_65f7f00f3ba1.slice/crio-6e23a4a65d3bcab596794e9d2614a585615042d926fc28c933131f70aaaae1aa WatchSource:0}: Error finding container 6e23a4a65d3bcab596794e9d2614a585615042d926fc28c933131f70aaaae1aa: Status 404 returned error can't find the container with id 6e23a4a65d3bcab596794e9d2614a585615042d926fc28c933131f70aaaae1aa
May 27 17:12:09.466824 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:09.466791    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs" event={"ID":"d843336d-ee2f-4793-b070-65f7f00f3ba1","Type":"ContainerStarted","Data":"6e23a4a65d3bcab596794e9d2614a585615042d926fc28c933131f70aaaae1aa"}
May 27 17:12:12.308154 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.308106    2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 27 17:12:12.308462 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.308190    2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 27 17:12:12.370176 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.370156    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-9wjns"
May 27 17:12:12.479521 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.479486    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs" event={"ID":"d843336d-ee2f-4793-b070-65f7f00f3ba1","Type":"ContainerStarted","Data":"a9ad9e3cb6474dd221143cc0c746661fdcd9fd49f0434fae219d927a8cf0cee4"}
May 27 17:12:12.479720 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.479572    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:12:12.500026 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:12.499968    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs" podStartSLOduration=1.332384023 podStartE2EDuration="4.499950537s" podCreationTimestamp="2026-05-27 17:12:08 +0000 UTC" firstStartedPulling="2026-05-27 17:12:09.140289693 +0000 UTC m=+504.814714764" lastFinishedPulling="2026-05-27 17:12:12.307855987 +0000 UTC m=+507.982281278" observedRunningTime="2026-05-27 17:12:12.497988955 +0000 UTC m=+508.172414048" watchObservedRunningTime="2026-05-27 17:12:12.499950537 +0000 UTC m=+508.174375714"
May 27 17:12:13.485422 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:13.485380    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-mslcs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 27 17:12:13.485901 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:13.485477    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs" podUID="d843336d-ee2f-4793-b070-65f7f00f3ba1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 17:12:16.484500 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:12:16.484469    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mslcs"
May 27 17:13:01.898648 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.898608    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"]
May 27 17:13:01.900886 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.900865    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:01.903915 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.903889    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7mjbr\""
May 27 17:13:01.905001 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.904981    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 17:13:01.905108 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.904981    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 17:13:01.905108 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.905020    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 17:13:01.913167 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.913144    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"]
May 27 17:13:01.973546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:01.973509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvpm2\" (UniqueName: \"kubernetes.io/projected/386ac2cc-e48d-4577-a748-ed6c6f74a8c3-kube-api-access-wvpm2\") pod \"dns-operator-controller-manager-648d5c98bc-7xq9f\" (UID: \"386ac2cc-e48d-4577-a748-ed6c6f74a8c3\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:02.074593 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:02.074549    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvpm2\" (UniqueName: \"kubernetes.io/projected/386ac2cc-e48d-4577-a748-ed6c6f74a8c3-kube-api-access-wvpm2\") pod \"dns-operator-controller-manager-648d5c98bc-7xq9f\" (UID: \"386ac2cc-e48d-4577-a748-ed6c6f74a8c3\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:02.089231 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:02.089195    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvpm2\" (UniqueName: \"kubernetes.io/projected/386ac2cc-e48d-4577-a748-ed6c6f74a8c3-kube-api-access-wvpm2\") pod \"dns-operator-controller-manager-648d5c98bc-7xq9f\" (UID: \"386ac2cc-e48d-4577-a748-ed6c6f74a8c3\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:02.210699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:02.210664    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:02.342747 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:02.342711    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"]
May 27 17:13:02.347000 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:13:02.346965    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386ac2cc_e48d_4577_a748_ed6c6f74a8c3.slice/crio-7cbbc46f13de14e59ff4b4379acfc2c98337af556e8a7dc6ad4f5f411c0abade WatchSource:0}: Error finding container 7cbbc46f13de14e59ff4b4379acfc2c98337af556e8a7dc6ad4f5f411c0abade: Status 404 returned error can't find the container with id 7cbbc46f13de14e59ff4b4379acfc2c98337af556e8a7dc6ad4f5f411c0abade
May 27 17:13:02.647586 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:02.647498    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f" event={"ID":"386ac2cc-e48d-4577-a748-ed6c6f74a8c3","Type":"ContainerStarted","Data":"7cbbc46f13de14e59ff4b4379acfc2c98337af556e8a7dc6ad4f5f411c0abade"}
May 27 17:13:05.658499 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:05.658466    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f" event={"ID":"386ac2cc-e48d-4577-a748-ed6c6f74a8c3","Type":"ContainerStarted","Data":"242a39485b6d82ba5ffe243037b69d2d0d20fb1de51e6e299630d98089eea3e4"}
May 27 17:13:05.659005 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:05.658596    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:05.674852 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:05.674811    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f" podStartSLOduration=2.356675489 podStartE2EDuration="4.67479649s" podCreationTimestamp="2026-05-27 17:13:01 +0000 UTC" firstStartedPulling="2026-05-27 17:13:02.349577722 +0000 UTC m=+558.024002809" lastFinishedPulling="2026-05-27 17:13:04.667698736 +0000 UTC m=+560.342123810" observedRunningTime="2026-05-27 17:13:05.673916938 +0000 UTC m=+561.348342030" watchObservedRunningTime="2026-05-27 17:13:05.67479649 +0000 UTC m=+561.349221584"
May 27 17:13:06.615944 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.615902    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"]
May 27 17:13:06.618515 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.618493    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.622271 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.622251    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6q7cp\""
May 27 17:13:06.629806 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.629740    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"]
May 27 17:13:06.717021 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.716984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjr9\" (UniqueName: \"kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.717385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.717087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.817769 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.817736    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjr9\" (UniqueName: \"kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.817936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.817902    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.818294 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.818277    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.834245 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.834211    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjr9\" (UniqueName: \"kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:06.928221 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:06.928193    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:07.059468 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:07.059438    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"]
May 27 17:13:07.063213 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:13:07.063178    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3e9ed2_51d9_4cd1_ac83_aae2b689d9b8.slice/crio-8807a59ce585143be35494398f2810a7af7f0739ecc7ef8e2ef7937a8da111ee WatchSource:0}: Error finding container 8807a59ce585143be35494398f2810a7af7f0739ecc7ef8e2ef7937a8da111ee: Status 404 returned error can't find the container with id 8807a59ce585143be35494398f2810a7af7f0739ecc7ef8e2ef7937a8da111ee
May 27 17:13:07.667327 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:07.667296    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" event={"ID":"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8","Type":"ContainerStarted","Data":"8807a59ce585143be35494398f2810a7af7f0739ecc7ef8e2ef7937a8da111ee"}
May 27 17:13:13.689168 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:13.689125    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" event={"ID":"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8","Type":"ContainerStarted","Data":"f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac"}
May 27 17:13:13.689594 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:13.689236    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:13.710498 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:13.710448    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" podStartSLOduration=1.904656556 podStartE2EDuration="7.710433761s" podCreationTimestamp="2026-05-27 17:13:06 +0000 UTC" firstStartedPulling="2026-05-27 17:13:07.065697189 +0000 UTC m=+562.740122263" lastFinishedPulling="2026-05-27 17:13:12.871474394 +0000 UTC m=+568.545899468" observedRunningTime="2026-05-27 17:13:13.707056688 +0000 UTC m=+569.381481782" watchObservedRunningTime="2026-05-27 17:13:13.710433761 +0000 UTC m=+569.384858853"
May 27 17:13:16.664331 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:16.664300    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-7xq9f"
May 27 17:13:24.694970 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:24.694939    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:25.761511 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.761478    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"]
May 27 17:13:25.763815 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.763796    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.777399 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.777374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.777490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.777452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzq9n\" (UniqueName: \"kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.785716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.785695    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"]
May 27 17:13:25.858409 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.858375    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"]
May 27 17:13:25.858626 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:25.858606    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xzq9n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq" podUID="1e567a06-9020-4efc-aa00-09a259313d0c"
May 27 17:13:25.878650 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.878617    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.878806 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.878682    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzq9n\" (UniqueName: \"kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.879008 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.878989    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.893787 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.893747    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"]
May 27 17:13:25.895935 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.895920    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:25.901943 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.901921    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzq9n\" (UniqueName: \"kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:25.906054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.906028    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"]
May 27 17:13:25.979820 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.979786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:25.979820 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:25.979821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwk7f\" (UniqueName: \"kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.080297 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.080202    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.080297 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.080236    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwk7f\" (UniqueName: \"kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.080657 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.080633    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.088820 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.088797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwk7f\" (UniqueName: \"kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f\") pod \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.215260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.215222    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.305579 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.305549    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"]
May 27 17:13:26.306877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.305961    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" containerName="manager" containerID="cri-o://f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac" gracePeriod=2
May 27 17:13:26.309503 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.309414    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"]
May 27 17:13:26.309621 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.309510    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.323022 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.322991    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"]
May 27 17:13:26.341875 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.338709    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:26.341875 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.339494    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" containerName="manager"
May 27 17:13:26.341875 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.339514    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" containerName="manager"
May 27 17:13:26.341875 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.339703    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" containerName="manager"
May 27 17:13:26.345508 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.344104    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"]
May 27 17:13:26.345508 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.344976    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.346489 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.346464    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"]
May 27 17:13:26.349260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.349217    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:26.349644 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.349596    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.352058 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.352028    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"]
May 27 17:13:26.372819 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.372794    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:26.375021 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.374998    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.382672 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.382648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.382897 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.382678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgdk\" (UniqueName: \"kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.382897 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.382701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdjl\" (UniqueName: \"kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.382897 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.382739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.385719 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.385696    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:26.436552 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.436516    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.484231 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484191    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.484368 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484244    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgdk\" (UniqueName: \"kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.484368 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484276    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdjl\" (UniqueName: \"kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.484510 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484410    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.484590 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484566    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.484782 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.484747    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.500599 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.500573    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdjl\" (UniqueName: \"kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9djwh\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.506878 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.506857    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgdk\" (UniqueName: \"kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk\") pod \"kuadrant-operator-controller-manager-84b657d985-5kpgt\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.533849 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.533829    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:26.536284 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.536259    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.585360 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.585331    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume\") pod \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") "
May 27 17:13:26.585535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.585398    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsjr9\" (UniqueName: \"kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9\") pod \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\" (UID: \"bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8\") "
May 27 17:13:26.585862 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.585836    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" (UID: "bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:13:26.587553 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.587524    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9" (OuterVolumeSpecName: "kube-api-access-jsjr9") pod "bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" (UID: "bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8"). InnerVolumeSpecName "kube-api-access-jsjr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:13:26.654081 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:26.654051    2574 log.go:32] "RunPodSandbox from runtime service failed" err=<
May 27 17:13:26.654081 ip-10-0-134-95 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-84b657d985-2bvbc_kuadrant-system_d4c2e07b-e028-4fe3-8f35-2bf86a0a583d_0(c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff): error adding pod kuadrant-system_kuadrant-operator-controller-manager-84b657d985-2bvbc to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff" Netns:"/var/run/netns/abfd920e-43c1-4177-9ed2-2c38f4fd6f04" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-84b657d985-2bvbc;K8S_POD_INFRA_CONTAINER_ID=c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff;K8S_POD_UID=d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc] networking: [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff network default NAD default] [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:21 [10.132.0.33/23]
May 27 17:13:26.654081 ip-10-0-134-95 kubenswrapper[2574]:         '
May 27 17:13:26.654081 ip-10-0-134-95 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
May 27 17:13:26.654081 ip-10-0-134-95 kubenswrapper[2574]:  >
May 27 17:13:26.654256 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:26.654109    2574 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err=<
May 27 17:13:26.654256 ip-10-0-134-95 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-84b657d985-2bvbc_kuadrant-system_d4c2e07b-e028-4fe3-8f35-2bf86a0a583d_0(c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff): error adding pod kuadrant-system_kuadrant-operator-controller-manager-84b657d985-2bvbc to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff" Netns:"/var/run/netns/abfd920e-43c1-4177-9ed2-2c38f4fd6f04" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-84b657d985-2bvbc;K8S_POD_INFRA_CONTAINER_ID=c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff;K8S_POD_UID=d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc] networking: [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff network default NAD default] [kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc c3c5c5ea3063b16cf2d5a6f0fdaa1f8e96f16240f9777e39a9b10c42f42fbbff network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:21 [10.132.0.33/23]
May 27 17:13:26.654256 ip-10-0-134-95 kubenswrapper[2574]:         '
May 27 17:13:26.654256 ip-10-0-134-95 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
May 27 17:13:26.654256 ip-10-0-134-95 kubenswrapper[2574]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.686902 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.686871    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsjr9\" (UniqueName: \"kubernetes.io/projected/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-kube-api-access-jsjr9\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.686902 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.686898    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.700824 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.700795    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:26.709563 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.709540    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:26.734532 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.734500    2574 generic.go:358] "Generic (PLEG): container finished" podID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" containerID="f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac" exitCode=0
May 27 17:13:26.734699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.734557    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc"
May 27 17:13:26.734699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.734585    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.734699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.734583    2574 scope.go:117] "RemoveContainer" containerID="f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac"
May 27 17:13:26.734898 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.734700    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:26.737161 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.737119    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.739650 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.739620    2574 status_manager.go:895] "Failed to get status for pod" podUID="d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc" err="pods \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.741832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.741789    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:26.741832 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.741812    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.745442 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.745416    2574 status_manager.go:895] "Failed to get status for pod" podUID="1e567a06-9020-4efc-aa00-09a259313d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.747343 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.747323    2574 scope.go:117] "RemoveContainer" containerID="f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac"
May 27 17:13:26.747566 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.747439    2574 status_manager.go:895] "Failed to get status for pod" podUID="1e567a06-9020-4efc-aa00-09a259313d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.748340 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:26.747797    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac\": container with ID starting with f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac not found: ID does not exist" containerID="f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac"
May 27 17:13:26.748340 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.747832    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac"} err="failed to get container status \"f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac\": rpc error: code = NotFound desc = could not find container \"f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac\": container with ID starting with f4da10638c009e49ae14d3e839c92c076e05d495a13b91f32cb0389f451193ac not found: ID does not exist"
May 27 17:13:26.748645 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.748560    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:26.749827 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.749803    2574 status_manager.go:895] "Failed to get status for pod" podUID="d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc" err="pods \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.751938 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.751905    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.754048 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.753942    2574 status_manager.go:895] "Failed to get status for pod" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9wwdc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9wwdc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.755996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.755962    2574 status_manager.go:895] "Failed to get status for pod" podUID="1e567a06-9020-4efc-aa00-09a259313d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.758158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.758130    2574 status_manager.go:895] "Failed to get status for pod" podUID="d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc" err="pods \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:26.788051 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.787895    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume\") pod \"1e567a06-9020-4efc-aa00-09a259313d0c\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") "
May 27 17:13:26.788051 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.787978    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwk7f\" (UniqueName: \"kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f\") pod \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") "
May 27 17:13:26.788051 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.788009    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzq9n\" (UniqueName: \"kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n\") pod \"1e567a06-9020-4efc-aa00-09a259313d0c\" (UID: \"1e567a06-9020-4efc-aa00-09a259313d0c\") "
May 27 17:13:26.788051 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.788040    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume\") pod \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\" (UID: \"d4c2e07b-e028-4fe3-8f35-2bf86a0a583d\") "
May 27 17:13:26.788622 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.788449    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" (UID: "d4c2e07b-e028-4fe3-8f35-2bf86a0a583d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:13:26.788754 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.788725    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1e567a06-9020-4efc-aa00-09a259313d0c" (UID: "1e567a06-9020-4efc-aa00-09a259313d0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:13:26.790701 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.790668    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n" (OuterVolumeSpecName: "kube-api-access-xzq9n") pod "1e567a06-9020-4efc-aa00-09a259313d0c" (UID: "1e567a06-9020-4efc-aa00-09a259313d0c"). InnerVolumeSpecName "kube-api-access-xzq9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:13:26.791301 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.791279    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f" (OuterVolumeSpecName: "kube-api-access-pwk7f") pod "d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" (UID: "d4c2e07b-e028-4fe3-8f35-2bf86a0a583d"). InnerVolumeSpecName "kube-api-access-pwk7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:13:26.839091 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.839048    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:26.843028 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:13:26.842996    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc093895_a18f_420a_b61d_af63105321f1.slice/crio-57c815baa5d0ab237b2ca54d31b1bcc4196d0c7a505a00deacf7ce7a498d833b WatchSource:0}: Error finding container 57c815baa5d0ab237b2ca54d31b1bcc4196d0c7a505a00deacf7ce7a498d833b: Status 404 returned error can't find the container with id 57c815baa5d0ab237b2ca54d31b1bcc4196d0c7a505a00deacf7ce7a498d833b
May 27 17:13:26.877031 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.877004    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:26.881273 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:13:26.881239    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad3e801_dd78_4064_bf25_9197e61c403c.slice/crio-3c9de9e1ba57f532c974160465c648bae93884794d2d10494bfde983500d5752 WatchSource:0}: Error finding container 3c9de9e1ba57f532c974160465c648bae93884794d2d10494bfde983500d5752: Status 404 returned error can't find the container with id 3c9de9e1ba57f532c974160465c648bae93884794d2d10494bfde983500d5752
May 27 17:13:26.889588 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.889568    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.889588 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.889589    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e567a06-9020-4efc-aa00-09a259313d0c-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.889707 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.889599    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwk7f\" (UniqueName: \"kubernetes.io/projected/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d-kube-api-access-pwk7f\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.889707 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.889608    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzq9n\" (UniqueName: \"kubernetes.io/projected/1e567a06-9020-4efc-aa00-09a259313d0c-kube-api-access-xzq9n\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:26.941547 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.941517    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e567a06-9020-4efc-aa00-09a259313d0c" path="/var/lib/kubelet/pods/1e567a06-9020-4efc-aa00-09a259313d0c/volumes"
May 27 17:13:26.941906 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.941886    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8" path="/var/lib/kubelet/pods/bc3e9ed2-51d9-4cd1-ac83-aae2b689d9b8/volumes"
May 27 17:13:26.942405 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:26.942366    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" path="/var/lib/kubelet/pods/d4c2e07b-e028-4fe3-8f35-2bf86a0a583d/volumes"
May 27 17:13:27.741556 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.741518    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" event={"ID":"dc093895-a18f-420a-b61d-af63105321f1","Type":"ContainerStarted","Data":"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"}
May 27 17:13:27.741726 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.741562    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" event={"ID":"dc093895-a18f-420a-b61d-af63105321f1","Type":"ContainerStarted","Data":"57c815baa5d0ab237b2ca54d31b1bcc4196d0c7a505a00deacf7ce7a498d833b"}
May 27 17:13:27.741859 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.741838    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:27.743393 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.743370    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" event={"ID":"5ad3e801-dd78-4064-bf25-9197e61c403c","Type":"ContainerStarted","Data":"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"}
May 27 17:13:27.743490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.743398    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" event={"ID":"5ad3e801-dd78-4064-bf25-9197e61c403c","Type":"ContainerStarted","Data":"3c9de9e1ba57f532c974160465c648bae93884794d2d10494bfde983500d5752"}
May 27 17:13:27.743490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.743431    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:27.744583 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.744566    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc"
May 27 17:13:27.744795 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.744570    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq"
May 27 17:13:27.764038 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.763998    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" podStartSLOduration=1.7639846129999999 podStartE2EDuration="1.763984613s" podCreationTimestamp="2026-05-27 17:13:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:13:27.762191027 +0000 UTC m=+583.436616121" watchObservedRunningTime="2026-05-27 17:13:27.763984613 +0000 UTC m=+583.438409706"
May 27 17:13:27.764598 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.764576    2574 status_manager.go:895] "Failed to get status for pod" podUID="d4c2e07b-e028-4fe3-8f35-2bf86a0a583d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2bvbc" err="pods \"kuadrant-operator-controller-manager-84b657d985-2bvbc\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:27.783333 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.783288    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" podStartSLOduration=1.7832762720000002 podStartE2EDuration="1.783276272s" podCreationTimestamp="2026-05-27 17:13:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:13:27.782063049 +0000 UTC m=+583.456488144" watchObservedRunningTime="2026-05-27 17:13:27.783276272 +0000 UTC m=+583.457701366"
May 27 17:13:27.784094 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:27.784066    2574 status_manager.go:895] "Failed to get status for pod" podUID="1e567a06-9020-4efc-aa00-09a259313d0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mhjwq\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object"
May 27 17:13:38.750453 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:38.750421    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:38.750895 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:38.750470    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:38.816785 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:38.816735    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:38.817054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:38.817023    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" podUID="dc093895-a18f-420a-b61d-af63105321f1" containerName="manager" containerID="cri-o://1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670" gracePeriod=10
May 27 17:13:39.070260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.070236    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:39.166639 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.166603    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:13:39.167008 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.166994    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc093895-a18f-420a-b61d-af63105321f1" containerName="manager"
May 27 17:13:39.167073 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.167010    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc093895-a18f-420a-b61d-af63105321f1" containerName="manager"
May 27 17:13:39.167111 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.167079    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc093895-a18f-420a-b61d-af63105321f1" containerName="manager"
May 27 17:13:39.170601 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.170581    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.189523 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.189446    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xdjl\" (UniqueName: \"kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl\") pod \"dc093895-a18f-420a-b61d-af63105321f1\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") "
May 27 17:13:39.189666 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.189643    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume\") pod \"dc093895-a18f-420a-b61d-af63105321f1\" (UID: \"dc093895-a18f-420a-b61d-af63105321f1\") "
May 27 17:13:39.190333 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.190306    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc093895-a18f-420a-b61d-af63105321f1" (UID: "dc093895-a18f-420a-b61d-af63105321f1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:13:39.191962 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.191934    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl" (OuterVolumeSpecName: "kube-api-access-9xdjl") pod "dc093895-a18f-420a-b61d-af63105321f1" (UID: "dc093895-a18f-420a-b61d-af63105321f1"). InnerVolumeSpecName "kube-api-access-9xdjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:13:39.192728 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.192705    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:13:39.290358 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.290260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.290358 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.290314    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjr5\" (UniqueName: \"kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.290581 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.290465    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc093895-a18f-420a-b61d-af63105321f1-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:39.290581 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.290494    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xdjl\" (UniqueName: \"kubernetes.io/projected/dc093895-a18f-420a-b61d-af63105321f1-kube-api-access-9xdjl\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:39.391299 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.391257    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjr5\" (UniqueName: \"kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.391499 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.391361    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.391798 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.391740    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.409093 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.409063    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjr5\" (UniqueName: \"kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-k7hc9\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.479836 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.479796    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.612904 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.612845    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:13:39.615331 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:13:39.615306    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f06505_f41c_45f1_9fb3_103ac4d746fa.slice/crio-e0b9f7e026e3d67e86304f54f0bbf5f853f5c32ecdb39c2671e084a0135aabd8 WatchSource:0}: Error finding container e0b9f7e026e3d67e86304f54f0bbf5f853f5c32ecdb39c2671e084a0135aabd8: Status 404 returned error can't find the container with id e0b9f7e026e3d67e86304f54f0bbf5f853f5c32ecdb39c2671e084a0135aabd8
May 27 17:13:39.789530 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.789494    2574 generic.go:358] "Generic (PLEG): container finished" podID="dc093895-a18f-420a-b61d-af63105321f1" containerID="1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670" exitCode=0
May 27 17:13:39.790020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.789541    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" event={"ID":"dc093895-a18f-420a-b61d-af63105321f1","Type":"ContainerDied","Data":"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"}
May 27 17:13:39.790020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.789560    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"
May 27 17:13:39.790020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.789577    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh" event={"ID":"dc093895-a18f-420a-b61d-af63105321f1","Type":"ContainerDied","Data":"57c815baa5d0ab237b2ca54d31b1bcc4196d0c7a505a00deacf7ce7a498d833b"}
May 27 17:13:39.790020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.789595    2574 scope.go:117] "RemoveContainer" containerID="1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"
May 27 17:13:39.791095 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.791072    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" event={"ID":"d7f06505-f41c-45f1-9fb3-103ac4d746fa","Type":"ContainerStarted","Data":"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"}
May 27 17:13:39.791207 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.791102    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" event={"ID":"d7f06505-f41c-45f1-9fb3-103ac4d746fa","Type":"ContainerStarted","Data":"e0b9f7e026e3d67e86304f54f0bbf5f853f5c32ecdb39c2671e084a0135aabd8"}
May 27 17:13:39.791207 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.791193    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:39.805912 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.805890    2574 scope.go:117] "RemoveContainer" containerID="1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"
May 27 17:13:39.806343 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:39.806309    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670\": container with ID starting with 1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670 not found: ID does not exist" containerID="1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"
May 27 17:13:39.806403 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.806350    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670"} err="failed to get container status \"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670\": rpc error: code = NotFound desc = could not find container \"1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670\": container with ID starting with 1bb1ae30ae3b4f2517fd913d9b63740e6b54fbbd73790c3f3e99feaebbe32670 not found: ID does not exist"
May 27 17:13:39.819278 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.819194    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" podStartSLOduration=0.819182602 podStartE2EDuration="819.182602ms" podCreationTimestamp="2026-05-27 17:13:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:13:39.818399344 +0000 UTC m=+595.492824438" watchObservedRunningTime="2026-05-27 17:13:39.819182602 +0000 UTC m=+595.493607695"
May 27 17:13:39.834277 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.834251    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:39.837917 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:39.837885    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9djwh"]
May 27 17:13:40.940512 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:40.940482    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc093895-a18f-420a-b61d-af63105321f1" path="/var/lib/kubelet/pods/dc093895-a18f-420a-b61d-af63105321f1/volumes"
May 27 17:13:44.882849 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:44.882823    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:13:44.883371 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:44.882905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:13:50.797438 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:50.797409    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:13:50.851020 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:50.850977    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:50.851371 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:50.851323    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" podUID="5ad3e801-dd78-4064-bf25-9197e61c403c" containerName="manager" containerID="cri-o://d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd" gracePeriod=10
May 27 17:13:51.097530 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.097503    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:51.198216 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.198181    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume\") pod \"5ad3e801-dd78-4064-bf25-9197e61c403c\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") "
May 27 17:13:51.198374 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.198249    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvgdk\" (UniqueName: \"kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk\") pod \"5ad3e801-dd78-4064-bf25-9197e61c403c\" (UID: \"5ad3e801-dd78-4064-bf25-9197e61c403c\") "
May 27 17:13:51.198642 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.198615    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ad3e801-dd78-4064-bf25-9197e61c403c" (UID: "5ad3e801-dd78-4064-bf25-9197e61c403c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:13:51.200312 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.200291    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk" (OuterVolumeSpecName: "kube-api-access-vvgdk") pod "5ad3e801-dd78-4064-bf25-9197e61c403c" (UID: "5ad3e801-dd78-4064-bf25-9197e61c403c"). InnerVolumeSpecName "kube-api-access-vvgdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:13:51.299685 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.299648    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad3e801-dd78-4064-bf25-9197e61c403c-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:51.299685 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.299676    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvgdk\" (UniqueName: \"kubernetes.io/projected/5ad3e801-dd78-4064-bf25-9197e61c403c-kube-api-access-vvgdk\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:13:51.831788 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.831732    2574 generic.go:358] "Generic (PLEG): container finished" podID="5ad3e801-dd78-4064-bf25-9197e61c403c" containerID="d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd" exitCode=0
May 27 17:13:51.832263 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.831798    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" event={"ID":"5ad3e801-dd78-4064-bf25-9197e61c403c","Type":"ContainerDied","Data":"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"}
May 27 17:13:51.832263 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.831813    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"
May 27 17:13:51.832263 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.831837    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt" event={"ID":"5ad3e801-dd78-4064-bf25-9197e61c403c","Type":"ContainerDied","Data":"3c9de9e1ba57f532c974160465c648bae93884794d2d10494bfde983500d5752"}
May 27 17:13:51.832263 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.831853    2574 scope.go:117] "RemoveContainer" containerID="d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"
May 27 17:13:51.840262 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.840241    2574 scope.go:117] "RemoveContainer" containerID="d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"
May 27 17:13:51.840478 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:13:51.840459    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd\": container with ID starting with d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd not found: ID does not exist" containerID="d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"
May 27 17:13:51.840532 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.840486    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd"} err="failed to get container status \"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd\": rpc error: code = NotFound desc = could not find container \"d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd\": container with ID starting with d647ae4bea9c5099ce527e63b38aedf3d1ea0c7238085ab91503c02aba0a95dd not found: ID does not exist"
May 27 17:13:51.855640 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.855615    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:51.859449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:51.859420    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-5kpgt"]
May 27 17:13:52.940397 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:13:52.940358    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad3e801-dd78-4064-bf25-9197e61c403c" path="/var/lib/kubelet/pods/5ad3e801-dd78-4064-bf25-9197e61c403c/volumes"
May 27 17:14:09.981845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.980546    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:09.981845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.981340    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad3e801-dd78-4064-bf25-9197e61c403c" containerName="manager"
May 27 17:14:09.981845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.981361    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad3e801-dd78-4064-bf25-9197e61c403c" containerName="manager"
May 27 17:14:09.981845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.981538    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ad3e801-dd78-4064-bf25-9197e61c403c" containerName="manager"
May 27 17:14:09.985212 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.985190    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:09.988881 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.988860    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 27 17:14:09.989019 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.988896    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-88lld\""
May 27 17:14:09.990059 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:09.990033    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:10.076850 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.076821    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:10.159047 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.159014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzlb5\" (UniqueName: \"kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.159220 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.159052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.260257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.260163    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzlb5\" (UniqueName: \"kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.260257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.260204    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.260800 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.260748    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.268673 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.268637    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzlb5\" (UniqueName: \"kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5\") pod \"limitador-limitador-7d549b5b-x98mv\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") " pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.296732 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.296700    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:10.432257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.432234    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:10.434447 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:14:10.434419    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff3db89_c25c_4132_b2d0_a2190f79c135.slice/crio-3882211d91f0e96a27d0a8146052d2deda238a3655b268c24b70c073fb5b8b54 WatchSource:0}: Error finding container 3882211d91f0e96a27d0a8146052d2deda238a3655b268c24b70c073fb5b8b54: Status 404 returned error can't find the container with id 3882211d91f0e96a27d0a8146052d2deda238a3655b268c24b70c073fb5b8b54
May 27 17:14:10.898271 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:10.898240    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" event={"ID":"aff3db89-c25c-4132-b2d0-a2190f79c135","Type":"ContainerStarted","Data":"3882211d91f0e96a27d0a8146052d2deda238a3655b268c24b70c073fb5b8b54"}
May 27 17:14:13.910527 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:13.910485    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" event={"ID":"aff3db89-c25c-4132-b2d0-a2190f79c135","Type":"ContainerStarted","Data":"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"}
May 27 17:14:13.910924 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:13.910595    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:13.927992 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:13.927950    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" podStartSLOduration=2.184677537 podStartE2EDuration="4.927933567s" podCreationTimestamp="2026-05-27 17:14:09 +0000 UTC" firstStartedPulling="2026-05-27 17:14:10.436334811 +0000 UTC m=+626.110759882" lastFinishedPulling="2026-05-27 17:14:13.179590827 +0000 UTC m=+628.854015912" observedRunningTime="2026-05-27 17:14:13.925711726 +0000 UTC m=+629.600136819" watchObservedRunningTime="2026-05-27 17:14:13.927933567 +0000 UTC m=+629.602358705"
May 27 17:14:24.920506 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:24.920471    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:25.581442 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:25.581410    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:25.581683 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:25.581657    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" podUID="aff3db89-c25c-4132-b2d0-a2190f79c135" containerName="limitador" containerID="cri-o://98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99" gracePeriod=30
May 27 17:14:26.130926 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.130901    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:26.185920 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.185884    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file\") pod \"aff3db89-c25c-4132-b2d0-a2190f79c135\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") "
May 27 17:14:26.186107 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.185938    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzlb5\" (UniqueName: \"kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5\") pod \"aff3db89-c25c-4132-b2d0-a2190f79c135\" (UID: \"aff3db89-c25c-4132-b2d0-a2190f79c135\") "
May 27 17:14:26.186228 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.186205    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file" (OuterVolumeSpecName: "config-file") pod "aff3db89-c25c-4132-b2d0-a2190f79c135" (UID: "aff3db89-c25c-4132-b2d0-a2190f79c135"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 17:14:26.188061 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.188035    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5" (OuterVolumeSpecName: "kube-api-access-qzlb5") pod "aff3db89-c25c-4132-b2d0-a2190f79c135" (UID: "aff3db89-c25c-4132-b2d0-a2190f79c135"). InnerVolumeSpecName "kube-api-access-qzlb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:14:26.287133 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.287094    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aff3db89-c25c-4132-b2d0-a2190f79c135-config-file\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:14:26.287133 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.287126    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzlb5\" (UniqueName: \"kubernetes.io/projected/aff3db89-c25c-4132-b2d0-a2190f79c135-kube-api-access-qzlb5\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:14:26.953117 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.953088    2574 generic.go:358] "Generic (PLEG): container finished" podID="aff3db89-c25c-4132-b2d0-a2190f79c135" containerID="98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99" exitCode=0
May 27 17:14:26.953257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.953154    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv"
May 27 17:14:26.953257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.953164    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" event={"ID":"aff3db89-c25c-4132-b2d0-a2190f79c135","Type":"ContainerDied","Data":"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"}
May 27 17:14:26.953257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.953202    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-x98mv" event={"ID":"aff3db89-c25c-4132-b2d0-a2190f79c135","Type":"ContainerDied","Data":"3882211d91f0e96a27d0a8146052d2deda238a3655b268c24b70c073fb5b8b54"}
May 27 17:14:26.953257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.953222    2574 scope.go:117] "RemoveContainer" containerID="98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"
May 27 17:14:26.961606 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.961585    2574 scope.go:117] "RemoveContainer" containerID="98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"
May 27 17:14:26.961883 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:14:26.961860    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99\": container with ID starting with 98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99 not found: ID does not exist" containerID="98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"
May 27 17:14:26.961943 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.961892    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99"} err="failed to get container status \"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99\": rpc error: code = NotFound desc = could not find container \"98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99\": container with ID starting with 98c67cc37bb5362a9a28ba309537cba193f9c1f09b85efcaab17839552742b99 not found: ID does not exist"
May 27 17:14:26.970813 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.970787    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:26.974501 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:26.974481    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-x98mv"]
May 27 17:14:28.940877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:28.940842    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff3db89-c25c-4132-b2d0-a2190f79c135" path="/var/lib/kubelet/pods/aff3db89-c25c-4132-b2d0-a2190f79c135/volumes"
May 27 17:14:30.547375 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.547340    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-hrhvr"]
May 27 17:14:30.547790 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.547707    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff3db89-c25c-4132-b2d0-a2190f79c135" containerName="limitador"
May 27 17:14:30.547790 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.547720    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff3db89-c25c-4132-b2d0-a2190f79c135" containerName="limitador"
May 27 17:14:30.547916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.547826    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="aff3db89-c25c-4132-b2d0-a2190f79c135" containerName="limitador"
May 27 17:14:30.552406 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.552381    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.555010 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.554983    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-95wg4\""
May 27 17:14:30.555161 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.555026    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 27 17:14:30.561133 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.561097    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-hrhvr"]
May 27 17:14:30.623182 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.623148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkn9\" (UniqueName: \"kubernetes.io/projected/ccfe8ec3-f56a-4c75-ab02-3e56849de048-kube-api-access-7qkn9\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.623356 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.623211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccfe8ec3-f56a-4c75-ab02-3e56849de048-data\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.723932 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.723894    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkn9\" (UniqueName: \"kubernetes.io/projected/ccfe8ec3-f56a-4c75-ab02-3e56849de048-kube-api-access-7qkn9\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.724129 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.723961    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccfe8ec3-f56a-4c75-ab02-3e56849de048-data\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.724304 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.724288    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ccfe8ec3-f56a-4c75-ab02-3e56849de048-data\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.733571 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.733541    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkn9\" (UniqueName: \"kubernetes.io/projected/ccfe8ec3-f56a-4c75-ab02-3e56849de048-kube-api-access-7qkn9\") pod \"postgres-68c4fbbd6f-hrhvr\" (UID: \"ccfe8ec3-f56a-4c75-ab02-3e56849de048\") " pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.865458 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.865368    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:30.992597 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:30.992572    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-hrhvr"]
May 27 17:14:30.995222 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:14:30.995194    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfe8ec3_f56a_4c75_ab02_3e56849de048.slice/crio-534ed9b623dc75dca430724f8769f8cf2217703e4fa4fa459ad702efd257268b WatchSource:0}: Error finding container 534ed9b623dc75dca430724f8769f8cf2217703e4fa4fa459ad702efd257268b: Status 404 returned error can't find the container with id 534ed9b623dc75dca430724f8769f8cf2217703e4fa4fa459ad702efd257268b
May 27 17:14:31.972676 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:31.972639    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-hrhvr" event={"ID":"ccfe8ec3-f56a-4c75-ab02-3e56849de048","Type":"ContainerStarted","Data":"534ed9b623dc75dca430724f8769f8cf2217703e4fa4fa459ad702efd257268b"}
May 27 17:14:36.995728 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:36.995690    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-hrhvr" event={"ID":"ccfe8ec3-f56a-4c75-ab02-3e56849de048","Type":"ContainerStarted","Data":"f35be151edb37c07094de45c556ba9123eda6d2d81f162c4aa2451acb1dbf00c"}
May 27 17:14:36.996101 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:36.995807    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:37.013324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:37.013243    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-hrhvr" podStartSLOduration=1.258269287 podStartE2EDuration="7.013230638s" podCreationTimestamp="2026-05-27 17:14:30 +0000 UTC" firstStartedPulling="2026-05-27 17:14:30.996455355 +0000 UTC m=+646.670880431" lastFinishedPulling="2026-05-27 17:14:36.751416708 +0000 UTC m=+652.425841782" observedRunningTime="2026-05-27 17:14:37.011346495 +0000 UTC m=+652.685771588" watchObservedRunningTime="2026-05-27 17:14:37.013230638 +0000 UTC m=+652.687655732"
May 27 17:14:43.027881 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:43.027852    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-hrhvr"
May 27 17:14:48.172724 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.172687    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:14:48.179158 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.179136    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:48.181922 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.181894    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 27 17:14:48.182051 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.181938    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qsqk5\""
May 27 17:14:48.190797 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.190742    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:14:48.276844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.276787    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jlp\" (UniqueName: \"kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp\") pod \"maas-controller-76c7888947-bdxx6\" (UID: \"5d08125b-e3b2-428e-83cf-69031d915163\") " pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:48.312174 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.312141    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:14:48.315574 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.315554    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:48.325910 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.325883    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:14:48.378025 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.377994    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jlp\" (UniqueName: \"kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp\") pod \"maas-controller-76c7888947-bdxx6\" (UID: \"5d08125b-e3b2-428e-83cf-69031d915163\") " pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:48.378200 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.378101    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgx6\" (UniqueName: \"kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6\") pod \"maas-controller-7d6874867c-b95f8\" (UID: \"8058fa1d-7a51-48dd-9d73-aa27a93127f4\") " pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:48.386256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.386233    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jlp\" (UniqueName: \"kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp\") pod \"maas-controller-76c7888947-bdxx6\" (UID: \"5d08125b-e3b2-428e-83cf-69031d915163\") " pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:48.479598 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.479494    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgx6\" (UniqueName: \"kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6\") pod \"maas-controller-7d6874867c-b95f8\" (UID: \"8058fa1d-7a51-48dd-9d73-aa27a93127f4\") " pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:48.487429 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.487398    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgx6\" (UniqueName: \"kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6\") pod \"maas-controller-7d6874867c-b95f8\" (UID: \"8058fa1d-7a51-48dd-9d73-aa27a93127f4\") " pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:48.490208 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.490191    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:48.615550 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.615526    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:14:48.617813 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:14:48.617782    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d08125b_e3b2_428e_83cf_69031d915163.slice/crio-f8dcff8a1242641ec4bddde1b4182e6620934c58ebe22e10137d5086aa89d7cf WatchSource:0}: Error finding container f8dcff8a1242641ec4bddde1b4182e6620934c58ebe22e10137d5086aa89d7cf: Status 404 returned error can't find the container with id f8dcff8a1242641ec4bddde1b4182e6620934c58ebe22e10137d5086aa89d7cf
May 27 17:14:48.627110 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.627089    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:48.757578 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:48.757555    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:14:48.759702 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:14:48.759670    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8058fa1d_7a51_48dd_9d73_aa27a93127f4.slice/crio-0430857a3b7b2c22dcc7a6dd54ede862df58d21a56182e0e08ed1aaa7f223b2a WatchSource:0}: Error finding container 0430857a3b7b2c22dcc7a6dd54ede862df58d21a56182e0e08ed1aaa7f223b2a: Status 404 returned error can't find the container with id 0430857a3b7b2c22dcc7a6dd54ede862df58d21a56182e0e08ed1aaa7f223b2a
May 27 17:14:49.044915 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:49.044827    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-b95f8" event={"ID":"8058fa1d-7a51-48dd-9d73-aa27a93127f4","Type":"ContainerStarted","Data":"0430857a3b7b2c22dcc7a6dd54ede862df58d21a56182e0e08ed1aaa7f223b2a"}
May 27 17:14:49.045872 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:49.045844    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76c7888947-bdxx6" event={"ID":"5d08125b-e3b2-428e-83cf-69031d915163","Type":"ContainerStarted","Data":"f8dcff8a1242641ec4bddde1b4182e6620934c58ebe22e10137d5086aa89d7cf"}
May 27 17:14:52.060716 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.060678    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-b95f8" event={"ID":"8058fa1d-7a51-48dd-9d73-aa27a93127f4","Type":"ContainerStarted","Data":"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"}
May 27 17:14:52.061187 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.060802    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:14:52.062069 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.062043    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76c7888947-bdxx6" event={"ID":"5d08125b-e3b2-428e-83cf-69031d915163","Type":"ContainerStarted","Data":"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"}
May 27 17:14:52.062182 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.062089    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:14:52.078144 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.078095    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d6874867c-b95f8" podStartSLOduration=1.50691167 podStartE2EDuration="4.078080497s" podCreationTimestamp="2026-05-27 17:14:48 +0000 UTC" firstStartedPulling="2026-05-27 17:14:48.761065839 +0000 UTC m=+664.435490910" lastFinishedPulling="2026-05-27 17:14:51.332234652 +0000 UTC m=+667.006659737" observedRunningTime="2026-05-27 17:14:52.075936081 +0000 UTC m=+667.750361175" watchObservedRunningTime="2026-05-27 17:14:52.078080497 +0000 UTC m=+667.752505628"
May 27 17:14:52.094750 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:14:52.094697    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-76c7888947-bdxx6" podStartSLOduration=1.391563351 podStartE2EDuration="4.094682034s" podCreationTimestamp="2026-05-27 17:14:48 +0000 UTC" firstStartedPulling="2026-05-27 17:14:48.619230138 +0000 UTC m=+664.293655216" lastFinishedPulling="2026-05-27 17:14:51.322348817 +0000 UTC m=+666.996773899" observedRunningTime="2026-05-27 17:14:52.093438049 +0000 UTC m=+667.767863144" watchObservedRunningTime="2026-05-27 17:14:52.094682034 +0000 UTC m=+667.769107152"
May 27 17:15:03.071694 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.071659    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:15:03.072309 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.072136    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:15:03.125193 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.125161    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:15:03.125393 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.125371    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-76c7888947-bdxx6" podUID="5d08125b-e3b2-428e-83cf-69031d915163" containerName="manager" containerID="cri-o://220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f" gracePeriod=30
May 27 17:15:03.367936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.367911    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:15:03.509448 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.509418    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7jlp\" (UniqueName: \"kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp\") pod \"5d08125b-e3b2-428e-83cf-69031d915163\" (UID: \"5d08125b-e3b2-428e-83cf-69031d915163\") "
May 27 17:15:03.511612 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.511579    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp" (OuterVolumeSpecName: "kube-api-access-s7jlp") pod "5d08125b-e3b2-428e-83cf-69031d915163" (UID: "5d08125b-e3b2-428e-83cf-69031d915163"). InnerVolumeSpecName "kube-api-access-s7jlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:15:03.610822 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:03.610734    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7jlp\" (UniqueName: \"kubernetes.io/projected/5d08125b-e3b2-428e-83cf-69031d915163-kube-api-access-s7jlp\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:15:04.102203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.102165    2574 generic.go:358] "Generic (PLEG): container finished" podID="5d08125b-e3b2-428e-83cf-69031d915163" containerID="220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f" exitCode=0
May 27 17:15:04.102631 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.102230    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76c7888947-bdxx6"
May 27 17:15:04.102631 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.102252    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76c7888947-bdxx6" event={"ID":"5d08125b-e3b2-428e-83cf-69031d915163","Type":"ContainerDied","Data":"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"}
May 27 17:15:04.102631 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.102291    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76c7888947-bdxx6" event={"ID":"5d08125b-e3b2-428e-83cf-69031d915163","Type":"ContainerDied","Data":"f8dcff8a1242641ec4bddde1b4182e6620934c58ebe22e10137d5086aa89d7cf"}
May 27 17:15:04.102631 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.102307    2574 scope.go:117] "RemoveContainer" containerID="220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"
May 27 17:15:04.111750 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.111731    2574 scope.go:117] "RemoveContainer" containerID="220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"
May 27 17:15:04.112028 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:15:04.112008    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f\": container with ID starting with 220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f not found: ID does not exist" containerID="220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"
May 27 17:15:04.112088 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.112041    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f"} err="failed to get container status \"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f\": rpc error: code = NotFound desc = could not find container \"220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f\": container with ID starting with 220b9f673fad379656be937b0def4e995acbea25e9accebe40a7fdfb6a24b31f not found: ID does not exist"
May 27 17:15:04.124139 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.124109    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:15:04.127878 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.127854    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76c7888947-bdxx6"]
May 27 17:15:04.941416 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:04.941386    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d08125b-e3b2-428e-83cf-69031d915163" path="/var/lib/kubelet/pods/5d08125b-e3b2-428e-83cf-69031d915163/volumes"
May 27 17:15:22.469477 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.469440    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7c9fbf4bd6-pq4d7"]
May 27 17:15:22.469973 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.469836    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d08125b-e3b2-428e-83cf-69031d915163" containerName="manager"
May 27 17:15:22.469973 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.469848    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d08125b-e3b2-428e-83cf-69031d915163" containerName="manager"
May 27 17:15:22.469973 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.469917    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d08125b-e3b2-428e-83cf-69031d915163" containerName="manager"
May 27 17:15:22.514678 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.514643    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c9fbf4bd6-pq4d7"]
May 27 17:15:22.514864 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.514821    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.517544 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.517524    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 27 17:15:22.517664 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.517613    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zj5h8\""
May 27 17:15:22.559977 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.559941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m669z\" (UniqueName: \"kubernetes.io/projected/d03c65c6-aaa0-4c5c-a587-0677981608bf-kube-api-access-m669z\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.560157 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.559990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.661291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.661255    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m669z\" (UniqueName: \"kubernetes.io/projected/d03c65c6-aaa0-4c5c-a587-0677981608bf-kube-api-access-m669z\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.661463 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.661303    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.661463 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:15:22.661424    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 27 17:15:22.661534 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:15:22.661501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls podName:d03c65c6-aaa0-4c5c-a587-0677981608bf nodeName:}" failed. No retries permitted until 2026-05-27 17:15:23.161486083 +0000 UTC m=+698.835911154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls") pod "maas-api-7c9fbf4bd6-pq4d7" (UID: "d03c65c6-aaa0-4c5c-a587-0677981608bf") : secret "maas-api-serving-cert" not found
May 27 17:15:22.671591 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.671562    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m669z\" (UniqueName: \"kubernetes.io/projected/d03c65c6-aaa0-4c5c-a587-0677981608bf-kube-api-access-m669z\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:22.847331 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.847245    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"]
May 27 17:15:22.849709 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.849689    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:22.852554 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.852527    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lsw78\""
May 27 17:15:22.852665 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.852562    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 27 17:15:22.861602 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.861578    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"]
May 27 17:15:22.863139 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.863110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh6lp\" (UniqueName: \"kubernetes.io/projected/fc1eb76d-72db-4de7-ad2d-54025a159765-kube-api-access-vh6lp\") pod \"payload-processing-58b6c8fdc7-bs5xd\" (UID: \"fc1eb76d-72db-4de7-ad2d-54025a159765\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:22.964462 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.964418    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh6lp\" (UniqueName: \"kubernetes.io/projected/fc1eb76d-72db-4de7-ad2d-54025a159765-kube-api-access-vh6lp\") pod \"payload-processing-58b6c8fdc7-bs5xd\" (UID: \"fc1eb76d-72db-4de7-ad2d-54025a159765\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:22.972452 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:22.972420    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh6lp\" (UniqueName: \"kubernetes.io/projected/fc1eb76d-72db-4de7-ad2d-54025a159765-kube-api-access-vh6lp\") pod \"payload-processing-58b6c8fdc7-bs5xd\" (UID: \"fc1eb76d-72db-4de7-ad2d-54025a159765\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:23.161754 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:23.161717    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:23.166023 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:23.165988    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:23.166176 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:15:23.166159    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 27 17:15:23.166268 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:15:23.166245    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls podName:d03c65c6-aaa0-4c5c-a587-0677981608bf nodeName:}" failed. No retries permitted until 2026-05-27 17:15:24.166224448 +0000 UTC m=+699.840649520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls") pod "maas-api-7c9fbf4bd6-pq4d7" (UID: "d03c65c6-aaa0-4c5c-a587-0677981608bf") : secret "maas-api-serving-cert" not found
May 27 17:15:23.307417 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:23.307390    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"]
May 27 17:15:23.309776 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:15:23.309727    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1eb76d_72db_4de7_ad2d_54025a159765.slice/crio-4cc5d4c82720557cee36bf8f413192c38a6c90f5a3cc3ddfa8ab28e759bec850 WatchSource:0}: Error finding container 4cc5d4c82720557cee36bf8f413192c38a6c90f5a3cc3ddfa8ab28e759bec850: Status 404 returned error can't find the container with id 4cc5d4c82720557cee36bf8f413192c38a6c90f5a3cc3ddfa8ab28e759bec850
May 27 17:15:24.175528 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:24.175488    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:24.178038 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:24.178005    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d03c65c6-aaa0-4c5c-a587-0677981608bf-maas-api-tls\") pod \"maas-api-7c9fbf4bd6-pq4d7\" (UID: \"d03c65c6-aaa0-4c5c-a587-0677981608bf\") " pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:24.182557 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:24.182524    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd" event={"ID":"fc1eb76d-72db-4de7-ad2d-54025a159765","Type":"ContainerStarted","Data":"4cc5d4c82720557cee36bf8f413192c38a6c90f5a3cc3ddfa8ab28e759bec850"}
May 27 17:15:24.325717 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:24.325680    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:24.458023 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:24.457998    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c9fbf4bd6-pq4d7"]
May 27 17:15:24.460991 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:15:24.460951    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03c65c6_aaa0_4c5c_a587_0677981608bf.slice/crio-eabe7f912a5609ce8afa85afb6dc245564c4ebb000a92e9db8d2054e83118d04 WatchSource:0}: Error finding container eabe7f912a5609ce8afa85afb6dc245564c4ebb000a92e9db8d2054e83118d04: Status 404 returned error can't find the container with id eabe7f912a5609ce8afa85afb6dc245564c4ebb000a92e9db8d2054e83118d04
May 27 17:15:25.187821 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:25.187782    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd" event={"ID":"fc1eb76d-72db-4de7-ad2d-54025a159765","Type":"ContainerStarted","Data":"07fc9dbd8c3e4ed3dabfab03f0289b006b5effe775449db3d321048b9963d00b"}
May 27 17:15:25.188273 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:25.187854    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:25.188953 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:25.188931    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7" event={"ID":"d03c65c6-aaa0-4c5c-a587-0677981608bf","Type":"ContainerStarted","Data":"eabe7f912a5609ce8afa85afb6dc245564c4ebb000a92e9db8d2054e83118d04"}
May 27 17:15:25.204104 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:25.204061    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd" podStartSLOduration=1.5139535689999999 podStartE2EDuration="3.204046843s" podCreationTimestamp="2026-05-27 17:15:22 +0000 UTC" firstStartedPulling="2026-05-27 17:15:23.311745487 +0000 UTC m=+698.986170562" lastFinishedPulling="2026-05-27 17:15:25.001838762 +0000 UTC m=+700.676263836" observedRunningTime="2026-05-27 17:15:25.202557388 +0000 UTC m=+700.876982475" watchObservedRunningTime="2026-05-27 17:15:25.204046843 +0000 UTC m=+700.878471935"
May 27 17:15:26.193668 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:26.193634    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7" event={"ID":"d03c65c6-aaa0-4c5c-a587-0677981608bf","Type":"ContainerStarted","Data":"e89006109518d4f02312e6d10a0588aea583c4e23fbc11b568c61729784b4bea"}
May 27 17:15:26.194113 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:26.193718    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:26.211299 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:26.211247    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7" podStartSLOduration=2.550075967 podStartE2EDuration="4.211231618s" podCreationTimestamp="2026-05-27 17:15:22 +0000 UTC" firstStartedPulling="2026-05-27 17:15:24.462711725 +0000 UTC m=+700.137136807" lastFinishedPulling="2026-05-27 17:15:26.123867374 +0000 UTC m=+701.798292458" observedRunningTime="2026-05-27 17:15:26.208965041 +0000 UTC m=+701.883390136" watchObservedRunningTime="2026-05-27 17:15:26.211231618 +0000 UTC m=+701.885656710"
May 27 17:15:32.202739 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:32.202650    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7c9fbf4bd6-pq4d7"
May 27 17:15:36.195999 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:36.195966    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-bs5xd"
May 27 17:15:41.077426 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.077395    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"]
May 27 17:15:41.079886 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.079867    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.082325 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.082302    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-svj7x\""
May 27 17:15:41.082480 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.082421    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 17:15:41.083485 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.083465    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 17:15:41.083485 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.083483    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 27 17:15:41.089454 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.089428    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"]
May 27 17:15:41.131257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.131257 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.131461 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5r6l\" (UniqueName: \"kubernetes.io/projected/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kube-api-access-w5r6l\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.131461 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.131461 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.131461 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.131406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232440 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232389    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5r6l\" (UniqueName: \"kubernetes.io/projected/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kube-api-access-w5r6l\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232440 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232435    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232483    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232502    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232526    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.232681 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232541    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.233000 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.232973    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.233066 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.233012    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.233066 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.233043    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.234877 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.234838    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.235113 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.235091    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.241844 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.241820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5r6l\" (UniqueName: \"kubernetes.io/projected/7a278c37-a1c8-4f08-a48c-fc3a40bb34a6-kube-api-access-w5r6l\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w\" (UID: \"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.391072 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.390977    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:41.531343 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.531316    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"]
May 27 17:15:41.533595 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:15:41.533566    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a278c37_a1c8_4f08_a48c_fc3a40bb34a6.slice/crio-ed0eafa34dea77fcc750aade8e97c77cc03f6290ac857d0f6cc9965dfa094711 WatchSource:0}: Error finding container ed0eafa34dea77fcc750aade8e97c77cc03f6290ac857d0f6cc9965dfa094711: Status 404 returned error can't find the container with id ed0eafa34dea77fcc750aade8e97c77cc03f6290ac857d0f6cc9965dfa094711
May 27 17:15:41.541213 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:41.539107    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:15:42.256809 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:42.256750    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w" event={"ID":"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6","Type":"ContainerStarted","Data":"ed0eafa34dea77fcc750aade8e97c77cc03f6290ac857d0f6cc9965dfa094711"}
May 27 17:15:47.574381 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.574242    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"]
May 27 17:15:47.600350 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.600257    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"]
May 27 17:15:47.600546 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.600416    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.603324 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.603091    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 27 17:15:47.698726 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.698693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.698897 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.698736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ca93cf-cf9e-4343-92a9-f8515583f615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.698967 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.698889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mff6z\" (UniqueName: \"kubernetes.io/projected/c0ca93cf-cf9e-4343-92a9-f8515583f615-kube-api-access-mff6z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.698967 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.698936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.699094 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.699073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.699149 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.699112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799673 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799616    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799673 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799674    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ca93cf-cf9e-4343-92a9-f8515583f615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799932 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799747    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mff6z\" (UniqueName: \"kubernetes.io/projected/c0ca93cf-cf9e-4343-92a9-f8515583f615-kube-api-access-mff6z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799932 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799800    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799932 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799867    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.799932 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.799891    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.800178 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.800146    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.800483 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.800462    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.800596 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.800572    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.802706 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.802672    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0ca93cf-cf9e-4343-92a9-f8515583f615-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.803068 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.803040    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ca93cf-cf9e-4343-92a9-f8515583f615-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.808948 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.808920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mff6z\" (UniqueName: \"kubernetes.io/projected/c0ca93cf-cf9e-4343-92a9-f8515583f615-kube-api-access-mff6z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5\" (UID: \"c0ca93cf-cf9e-4343-92a9-f8515583f615\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:47.913563 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:47.913520    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:48.394066 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:48.393900    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"]
May 27 17:15:49.283700 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:49.283657    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w" event={"ID":"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6","Type":"ContainerStarted","Data":"281dee149ea2669f75558d00a4c099106f36c45cbb011c43b3bb6ec8d98165c1"}
May 27 17:15:49.285443 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:49.285413    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5" event={"ID":"c0ca93cf-cf9e-4343-92a9-f8515583f615","Type":"ContainerStarted","Data":"cabd513853402d545c25c0dcbc54a731d93118cc3cb40b72124e63488b76c22e"}
May 27 17:15:49.285591 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:49.285449    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5" event={"ID":"c0ca93cf-cf9e-4343-92a9-f8515583f615","Type":"ContainerStarted","Data":"17a77c0901e49976d8496ac53624d5a232512e53aff926d27117cdb94447ecfc"}
May 27 17:15:54.306923 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:54.306889    2574 generic.go:358] "Generic (PLEG): container finished" podID="7a278c37-a1c8-4f08-a48c-fc3a40bb34a6" containerID="281dee149ea2669f75558d00a4c099106f36c45cbb011c43b3bb6ec8d98165c1" exitCode=0
May 27 17:15:54.307297 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:54.306964    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w" event={"ID":"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6","Type":"ContainerDied","Data":"281dee149ea2669f75558d00a4c099106f36c45cbb011c43b3bb6ec8d98165c1"}
May 27 17:15:55.312481 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:55.312446    2574 generic.go:358] "Generic (PLEG): container finished" podID="c0ca93cf-cf9e-4343-92a9-f8515583f615" containerID="cabd513853402d545c25c0dcbc54a731d93118cc3cb40b72124e63488b76c22e" exitCode=0
May 27 17:15:55.312948 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:55.312504    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5" event={"ID":"c0ca93cf-cf9e-4343-92a9-f8515583f615","Type":"ContainerDied","Data":"cabd513853402d545c25c0dcbc54a731d93118cc3cb40b72124e63488b76c22e"}
May 27 17:15:56.318651 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.318620    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w" event={"ID":"7a278c37-a1c8-4f08-a48c-fc3a40bb34a6","Type":"ContainerStarted","Data":"d0f9bdd7205c95c003959a93286730bc802fd56e0254a1270cfb6ffe92e615f2"}
May 27 17:15:56.319148 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.318926    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:15:56.320307 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.320284    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5" event={"ID":"c0ca93cf-cf9e-4343-92a9-f8515583f615","Type":"ContainerStarted","Data":"48332739b583fc3094a7ba82ecc7b9a4af19deede39f9a624f3445a2640ead51"}
May 27 17:15:56.320502 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.320480    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:15:56.337505 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.337447    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w" podStartSLOduration=1.3286722499999999 podStartE2EDuration="15.337428609s" podCreationTimestamp="2026-05-27 17:15:41 +0000 UTC" firstStartedPulling="2026-05-27 17:15:41.539298789 +0000 UTC m=+717.213723867" lastFinishedPulling="2026-05-27 17:15:55.548055156 +0000 UTC m=+731.222480226" observedRunningTime="2026-05-27 17:15:56.33692925 +0000 UTC m=+732.011354347" watchObservedRunningTime="2026-05-27 17:15:56.337428609 +0000 UTC m=+732.011853705"
May 27 17:15:56.355435 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:15:56.355381    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5" podStartSLOduration=9.012873063 podStartE2EDuration="9.355365409s" podCreationTimestamp="2026-05-27 17:15:47 +0000 UTC" firstStartedPulling="2026-05-27 17:15:55.313288897 +0000 UTC m=+730.987713967" lastFinishedPulling="2026-05-27 17:15:55.655781241 +0000 UTC m=+731.330206313" observedRunningTime="2026-05-27 17:15:56.353838258 +0000 UTC m=+732.028263351" watchObservedRunningTime="2026-05-27 17:15:56.355365409 +0000 UTC m=+732.029790505"
May 27 17:16:07.347097 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:07.347054    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w"
May 27 17:16:07.347896 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:07.347874    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5"
May 27 17:16:14.383395 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.383357    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"]
May 27 17:16:14.387260 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.387239    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.389890 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.389864    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 27 17:16:14.395956 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.395928    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"]
May 27 17:16:14.442801 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.442747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.442989 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.442893    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.443046 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.442984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.443046 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.443018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.443150 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.443054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctxn\" (UniqueName: \"kubernetes.io/projected/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kube-api-access-4ctxn\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.443150 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.443103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544430 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544397    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544430 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544434    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544672 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544467    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctxn\" (UniqueName: \"kubernetes.io/projected/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kube-api-access-4ctxn\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544672 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544514    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544672 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544560    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.544845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.544805    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.545134 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.545108    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.545214 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.545187    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.545379 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.545358    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.546841 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.546819    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.547615 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.547584    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.557114 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.557084    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctxn\" (UniqueName: \"kubernetes.io/projected/248c2bfb-9d6f-4c11-b10e-be14bb2567d4-kube-api-access-4ctxn\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc\" (UID: \"248c2bfb-9d6f-4c11-b10e-be14bb2567d4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.699516 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.699476    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:14.843822 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:14.843746    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"]
May 27 17:16:14.847551 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:16:14.847500    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248c2bfb_9d6f_4c11_b10e_be14bb2567d4.slice/crio-4a7f390bbe1978db39a322814029647a377dbddf199b1abbef7128fb84e34f32 WatchSource:0}: Error finding container 4a7f390bbe1978db39a322814029647a377dbddf199b1abbef7128fb84e34f32: Status 404 returned error can't find the container with id 4a7f390bbe1978db39a322814029647a377dbddf199b1abbef7128fb84e34f32
May 27 17:16:15.395603 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:15.395562    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc" event={"ID":"248c2bfb-9d6f-4c11-b10e-be14bb2567d4","Type":"ContainerStarted","Data":"303f8682f0567ee2374460916db1130e008de5feea6642005cf57987d6b4572c"}
May 27 17:16:15.395603 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:15.395605    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc" event={"ID":"248c2bfb-9d6f-4c11-b10e-be14bb2567d4","Type":"ContainerStarted","Data":"4a7f390bbe1978db39a322814029647a377dbddf199b1abbef7128fb84e34f32"}
May 27 17:16:21.419683 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:21.419650    2574 generic.go:358] "Generic (PLEG): container finished" podID="248c2bfb-9d6f-4c11-b10e-be14bb2567d4" containerID="303f8682f0567ee2374460916db1130e008de5feea6642005cf57987d6b4572c" exitCode=0
May 27 17:16:21.420080 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:21.419724    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc" event={"ID":"248c2bfb-9d6f-4c11-b10e-be14bb2567d4","Type":"ContainerDied","Data":"303f8682f0567ee2374460916db1130e008de5feea6642005cf57987d6b4572c"}
May 27 17:16:22.425312 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:22.425282    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc" event={"ID":"248c2bfb-9d6f-4c11-b10e-be14bb2567d4","Type":"ContainerStarted","Data":"33f90ba91cefc3a290efd3e9f87139a11d67dd78deb90324107e37b66740c3f9"}
May 27 17:16:22.425685 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:22.425498    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:22.444435 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:22.444339    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc" podStartSLOduration=8.064578917 podStartE2EDuration="8.444317867s" podCreationTimestamp="2026-05-27 17:16:14 +0000 UTC" firstStartedPulling="2026-05-27 17:16:21.420394892 +0000 UTC m=+757.094819963" lastFinishedPulling="2026-05-27 17:16:21.800133827 +0000 UTC m=+757.474558913" observedRunningTime="2026-05-27 17:16:22.443786582 +0000 UTC m=+758.118211677" watchObservedRunningTime="2026-05-27 17:16:22.444317867 +0000 UTC m=+758.118742959"
May 27 17:16:33.444080 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:33.444049    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc"
May 27 17:16:34.682202 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.682163    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"]
May 27 17:16:34.684826 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.684807    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.687369 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.687347    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 27 17:16:34.695947 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.695921    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"]
May 27 17:16:34.837090 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.837417 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.837552 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.837618 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.837683 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxmd\" (UniqueName: \"kubernetes.io/projected/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kube-api-access-mzxmd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.837738 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.837670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940650 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940555    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940650 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940604    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940892 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940679    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940892 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940712    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxmd\" (UniqueName: \"kubernetes.io/projected/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kube-api-access-mzxmd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940892 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940754    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.940892 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.940861    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.941830 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.941803    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.942104 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.942076    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.942203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.942086    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.944902 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.944876    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.945137 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.945111    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.949965 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.949935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxmd\" (UniqueName: \"kubernetes.io/projected/c649acf9-a783-443e-b27c-f2c7bbdb6e2f-kube-api-access-mzxmd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd\" (UID: \"c649acf9-a783-443e-b27c-f2c7bbdb6e2f\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:34.994535 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:34.994503    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:35.142581 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:35.142540    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"]
May 27 17:16:35.145465 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:16:35.145361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc649acf9_a783_443e_b27c_f2c7bbdb6e2f.slice/crio-3ea4bc5167ad113c3c123d3937b7bc3ee1853b666f1c4d8f3a5dada6d257ccd2 WatchSource:0}: Error finding container 3ea4bc5167ad113c3c123d3937b7bc3ee1853b666f1c4d8f3a5dada6d257ccd2: Status 404 returned error can't find the container with id 3ea4bc5167ad113c3c123d3937b7bc3ee1853b666f1c4d8f3a5dada6d257ccd2
May 27 17:16:35.474522 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:35.474432    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd" event={"ID":"c649acf9-a783-443e-b27c-f2c7bbdb6e2f","Type":"ContainerStarted","Data":"dd9dbe54a4a6d43e23598d1f0588ddb63e72ba000a4a90381e3d91abff19225e"}
May 27 17:16:35.474522 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:35.474476    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd" event={"ID":"c649acf9-a783-443e-b27c-f2c7bbdb6e2f","Type":"ContainerStarted","Data":"3ea4bc5167ad113c3c123d3937b7bc3ee1853b666f1c4d8f3a5dada6d257ccd2"}
May 27 17:16:45.511273 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:45.511237    2574 generic.go:358] "Generic (PLEG): container finished" podID="c649acf9-a783-443e-b27c-f2c7bbdb6e2f" containerID="dd9dbe54a4a6d43e23598d1f0588ddb63e72ba000a4a90381e3d91abff19225e" exitCode=0
May 27 17:16:45.511790 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:45.511311    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd" event={"ID":"c649acf9-a783-443e-b27c-f2c7bbdb6e2f","Type":"ContainerDied","Data":"dd9dbe54a4a6d43e23598d1f0588ddb63e72ba000a4a90381e3d91abff19225e"}
May 27 17:16:46.517105 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:46.517070    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd" event={"ID":"c649acf9-a783-443e-b27c-f2c7bbdb6e2f","Type":"ContainerStarted","Data":"285f7b04b843cb3039dc9c6bc3a58fb692aaac68934d4d9cc991eb17096cac95"}
May 27 17:16:46.517524 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:46.517261    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:16:46.536100 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:46.536042    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd" podStartSLOduration=12.254487687 podStartE2EDuration="12.536022864s" podCreationTimestamp="2026-05-27 17:16:34 +0000 UTC" firstStartedPulling="2026-05-27 17:16:45.512016958 +0000 UTC m=+781.186442034" lastFinishedPulling="2026-05-27 17:16:45.793552123 +0000 UTC m=+781.467977211" observedRunningTime="2026-05-27 17:16:46.534208688 +0000 UTC m=+782.208633782" watchObservedRunningTime="2026-05-27 17:16:46.536022864 +0000 UTC m=+782.210447958"
May 27 17:16:57.534509 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:16:57.534476    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd"
May 27 17:18:28.407286 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.407248    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:18:28.407875 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.407498    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7d6874867c-b95f8" podUID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" containerName="manager" containerID="cri-o://d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df" gracePeriod=30
May 27 17:18:28.667542 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.667511    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:18:28.710256 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.710224    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzgx6\" (UniqueName: \"kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6\") pod \"8058fa1d-7a51-48dd-9d73-aa27a93127f4\" (UID: \"8058fa1d-7a51-48dd-9d73-aa27a93127f4\") "
May 27 17:18:28.712237 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.712204    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6" (OuterVolumeSpecName: "kube-api-access-tzgx6") pod "8058fa1d-7a51-48dd-9d73-aa27a93127f4" (UID: "8058fa1d-7a51-48dd-9d73-aa27a93127f4"). InnerVolumeSpecName "kube-api-access-tzgx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:18:28.811170 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.811129    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzgx6\" (UniqueName: \"kubernetes.io/projected/8058fa1d-7a51-48dd-9d73-aa27a93127f4-kube-api-access-tzgx6\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:18:28.906137 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.906103    2574 generic.go:358] "Generic (PLEG): container finished" podID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" containerID="d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df" exitCode=0
May 27 17:18:28.906318 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.906171    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-b95f8"
May 27 17:18:28.906318 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.906173    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-b95f8" event={"ID":"8058fa1d-7a51-48dd-9d73-aa27a93127f4","Type":"ContainerDied","Data":"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"}
May 27 17:18:28.906318 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.906284    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-b95f8" event={"ID":"8058fa1d-7a51-48dd-9d73-aa27a93127f4","Type":"ContainerDied","Data":"0430857a3b7b2c22dcc7a6dd54ede862df58d21a56182e0e08ed1aaa7f223b2a"}
May 27 17:18:28.906462 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.906305    2574 scope.go:117] "RemoveContainer" containerID="d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"
May 27 17:18:28.919202 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.919170    2574 scope.go:117] "RemoveContainer" containerID="d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"
May 27 17:18:28.919556 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:18:28.919533    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df\": container with ID starting with d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df not found: ID does not exist" containerID="d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"
May 27 17:18:28.919628 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.919578    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df"} err="failed to get container status \"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df\": rpc error: code = NotFound desc = could not find container \"d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df\": container with ID starting with d66ddb02e1e2ff7124bb739522932dcf38e7b7b80bc069feebad26fe0b9e83df not found: ID does not exist"
May 27 17:18:28.931413 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.931376    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:18:28.934311 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.934282    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d6874867c-b95f8"]
May 27 17:18:28.941890 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:28.941861    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" path="/var/lib/kubelet/pods/8058fa1d-7a51-48dd-9d73-aa27a93127f4/volumes"
May 27 17:18:29.630596 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.630558    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d6874867c-xfzkg"]
May 27 17:18:29.631093 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.631064    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" containerName="manager"
May 27 17:18:29.631093 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.631087    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" containerName="manager"
May 27 17:18:29.631319 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.631219    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="8058fa1d-7a51-48dd-9d73-aa27a93127f4" containerName="manager"
May 27 17:18:29.635728 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.635708    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:29.638170 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.638145    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 27 17:18:29.638274 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.638189    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qsqk5\""
May 27 17:18:29.642691 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.642668    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6874867c-xfzkg"]
May 27 17:18:29.722545 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.722459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mvsq\" (UniqueName: \"kubernetes.io/projected/2c00841a-f153-49e6-81cb-313c7203c18e-kube-api-access-6mvsq\") pod \"maas-controller-7d6874867c-xfzkg\" (UID: \"2c00841a-f153-49e6-81cb-313c7203c18e\") " pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:29.823177 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.823147    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mvsq\" (UniqueName: \"kubernetes.io/projected/2c00841a-f153-49e6-81cb-313c7203c18e-kube-api-access-6mvsq\") pod \"maas-controller-7d6874867c-xfzkg\" (UID: \"2c00841a-f153-49e6-81cb-313c7203c18e\") " pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:29.831183 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.831159    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mvsq\" (UniqueName: \"kubernetes.io/projected/2c00841a-f153-49e6-81cb-313c7203c18e-kube-api-access-6mvsq\") pod \"maas-controller-7d6874867c-xfzkg\" (UID: \"2c00841a-f153-49e6-81cb-313c7203c18e\") " pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:29.948447 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:29.948411    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:30.085449 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:30.085386    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d6874867c-xfzkg"]
May 27 17:18:30.087829 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:18:30.087797    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c00841a_f153_49e6_81cb_313c7203c18e.slice/crio-c55ddda6a3f35c8bb5dc227f64f067e5d57a23e1f6a92e9240df5764b2758395 WatchSource:0}: Error finding container c55ddda6a3f35c8bb5dc227f64f067e5d57a23e1f6a92e9240df5764b2758395: Status 404 returned error can't find the container with id c55ddda6a3f35c8bb5dc227f64f067e5d57a23e1f6a92e9240df5764b2758395
May 27 17:18:30.916236 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:30.916204    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-xfzkg" event={"ID":"2c00841a-f153-49e6-81cb-313c7203c18e","Type":"ContainerStarted","Data":"e33b02a48c7ffd81945259615eb6afa6edef65ba2669ac5f8431eb99cfd730ef"}
May 27 17:18:30.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:30.916246    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d6874867c-xfzkg" event={"ID":"2c00841a-f153-49e6-81cb-313c7203c18e","Type":"ContainerStarted","Data":"c55ddda6a3f35c8bb5dc227f64f067e5d57a23e1f6a92e9240df5764b2758395"}
May 27 17:18:30.916635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:30.916267    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:30.932925 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:30.932871    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d6874867c-xfzkg" podStartSLOduration=1.488814102 podStartE2EDuration="1.932854767s" podCreationTimestamp="2026-05-27 17:18:29 +0000 UTC" firstStartedPulling="2026-05-27 17:18:30.089225508 +0000 UTC m=+885.763650579" lastFinishedPulling="2026-05-27 17:18:30.533266164 +0000 UTC m=+886.207691244" observedRunningTime="2026-05-27 17:18:30.930824363 +0000 UTC m=+886.605249448" watchObservedRunningTime="2026-05-27 17:18:30.932854767 +0000 UTC m=+886.607279860"
May 27 17:18:41.925474 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:41.925437    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d6874867c-xfzkg"
May 27 17:18:44.909057 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:44.909031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:18:44.909458 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:18:44.909078    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:23:44.933916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:23:44.933879    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:23:44.935891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:23:44.935868    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:28:44.961415 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:44.961389    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:28:44.964091 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:44.963167    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:28:46.863113 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:46.863076    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:28:46.863509 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:46.863319    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" podUID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" containerName="manager" containerID="cri-o://a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3" gracePeriod=10
May 27 17:28:47.116419 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.116361    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:28:47.132316 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.132289    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume\") pod \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") "
May 27 17:28:47.132478 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.132353    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxjr5\" (UniqueName: \"kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5\") pod \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\" (UID: \"d7f06505-f41c-45f1-9fb3-103ac4d746fa\") "
May 27 17:28:47.132699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.132673    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d7f06505-f41c-45f1-9fb3-103ac4d746fa" (UID: "d7f06505-f41c-45f1-9fb3-103ac4d746fa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 17:28:47.134345 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.134324    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5" (OuterVolumeSpecName: "kube-api-access-jxjr5") pod "d7f06505-f41c-45f1-9fb3-103ac4d746fa" (UID: "d7f06505-f41c-45f1-9fb3-103ac4d746fa"). InnerVolumeSpecName "kube-api-access-jxjr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 17:28:47.160459 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.160426    2574 generic.go:358] "Generic (PLEG): container finished" podID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" containerID="a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3" exitCode=0
May 27 17:28:47.160584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.160487    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"
May 27 17:28:47.160584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.160493    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" event={"ID":"d7f06505-f41c-45f1-9fb3-103ac4d746fa","Type":"ContainerDied","Data":"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"}
May 27 17:28:47.160584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.160532    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9" event={"ID":"d7f06505-f41c-45f1-9fb3-103ac4d746fa","Type":"ContainerDied","Data":"e0b9f7e026e3d67e86304f54f0bbf5f853f5c32ecdb39c2671e084a0135aabd8"}
May 27 17:28:47.160584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.160552    2574 scope.go:117] "RemoveContainer" containerID="a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"
May 27 17:28:47.169545 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.169528    2574 scope.go:117] "RemoveContainer" containerID="a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"
May 27 17:28:47.169882 ip-10-0-134-95 kubenswrapper[2574]: E0527 17:28:47.169860    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3\": container with ID starting with a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3 not found: ID does not exist" containerID="a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"
May 27 17:28:47.169940 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.169892    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3"} err="failed to get container status \"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3\": rpc error: code = NotFound desc = could not find container \"a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3\": container with ID starting with a544457b3775981a7f11049e2f821739c3575a0e5bdf00228b8a19066b3aeaf3 not found: ID does not exist"
May 27 17:28:47.227428 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.227399    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:28:47.232936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.232913    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f06505-f41c-45f1-9fb3-103ac4d746fa-extensions-socket-volume\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:28:47.233054 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.232940    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxjr5\" (UniqueName: \"kubernetes.io/projected/d7f06505-f41c-45f1-9fb3-103ac4d746fa-kube-api-access-jxjr5\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
May 27 17:28:47.245960 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:47.245934    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-k7hc9"]
May 27 17:28:48.940861 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:28:48.940829    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" path="/var/lib/kubelet/pods/d7f06505-f41c-45f1-9fb3-103ac4d746fa/volumes"
May 27 17:29:52.877635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.877597    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"]
May 27 17:29:52.878038 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.877986    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" containerName="manager"
May 27 17:29:52.878038 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.877998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" containerName="manager"
May 27 17:29:52.878112 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.878072    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7f06505-f41c-45f1-9fb3-103ac4d746fa" containerName="manager"
May 27 17:29:52.881387 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.881370    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:52.884389 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.884371    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6q7cp\""
May 27 17:29:52.893412 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:52.893391    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"]
May 27 17:29:53.023817 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.023789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867ce071-ca92-4c44-9ff2-c6663b4329a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.023997 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.023849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4447m\" (UniqueName: \"kubernetes.io/projected/867ce071-ca92-4c44-9ff2-c6663b4329a3-kube-api-access-4447m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.125233 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.125202    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4447m\" (UniqueName: \"kubernetes.io/projected/867ce071-ca92-4c44-9ff2-c6663b4329a3-kube-api-access-4447m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.125388 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.125297    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867ce071-ca92-4c44-9ff2-c6663b4329a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.125595 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.125580    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867ce071-ca92-4c44-9ff2-c6663b4329a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.140402 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.140341    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4447m\" (UniqueName: \"kubernetes.io/projected/867ce071-ca92-4c44-9ff2-c6663b4329a3-kube-api-access-4447m\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r7k6q\" (UID: \"867ce071-ca92-4c44-9ff2-c6663b4329a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.191981 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.191944    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:53.329989 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.329961    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"]
May 27 17:29:53.332650 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:29:53.332619    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867ce071_ca92_4c44_9ff2_c6663b4329a3.slice/crio-ede682ae73e5cb9a40ff3b58dbfb03058e3972ae6d41169fe90b720f04634df7 WatchSource:0}: Error finding container ede682ae73e5cb9a40ff3b58dbfb03058e3972ae6d41169fe90b720f04634df7: Status 404 returned error can't find the container with id ede682ae73e5cb9a40ff3b58dbfb03058e3972ae6d41169fe90b720f04634df7
May 27 17:29:53.334996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.334974    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:29:53.396222 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:53.396197    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q" event={"ID":"867ce071-ca92-4c44-9ff2-c6663b4329a3","Type":"ContainerStarted","Data":"ede682ae73e5cb9a40ff3b58dbfb03058e3972ae6d41169fe90b720f04634df7"}
May 27 17:29:54.400968 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:54.400932    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q" event={"ID":"867ce071-ca92-4c44-9ff2-c6663b4329a3","Type":"ContainerStarted","Data":"7680b27c9293ceddcf8a24d305afcf1431fcf84d3c053320a8cf694fd35261e2"}
May 27 17:29:54.401350 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:54.401029    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:29:54.424219 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:29:54.424175    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q" podStartSLOduration=2.42416033 podStartE2EDuration="2.42416033s" podCreationTimestamp="2026-05-27 17:29:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:29:54.422337309 +0000 UTC m=+1570.096762402" watchObservedRunningTime="2026-05-27 17:29:54.42416033 +0000 UTC m=+1570.098585424"
May 27 17:30:05.407663 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:30:05.407624    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r7k6q"
May 27 17:33:44.986259 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:33:44.986149    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:33:44.991958 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:33:44.989081    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:38:45.012420 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:38:45.012308    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:38:45.016404 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:38:45.016060    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:39:41.603615 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:41.603521    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-9wjns_63379391-d23c-43f9-9b90-4067dac0816f/manager/0.log"
May 27 17:39:41.718056 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:41.718002    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c9fbf4bd6-pq4d7_d03c65c6-aaa0-4c5c-a587-0677981608bf/maas-api/0.log"
May 27 17:39:41.936647 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:41.936617    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d6874867c-xfzkg_2c00841a-f153-49e6-81cb-313c7203c18e/manager/0.log"
May 27 17:39:42.061688 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:42.061646    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-mzrcm_ae131f8d-eb3d-4282-ae54-b81eeac9d5ee/manager/2.log"
May 27 17:39:42.298755 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:42.298666    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854fc5c4fb-tpzh8_9d508889-c76e-469e-a1d2-74e9737e8576/manager/0.log"
May 27 17:39:42.517441 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:42.517396    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-hrhvr_ccfe8ec3-f56a-4c75-ab02-3e56849de048/postgres/0.log"
May 27 17:39:43.971202 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:43.971174    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-7xq9f_386ac2cc-e48d-4577-a748-ed6c6f74a8c3/manager/0.log"
May 27 17:39:44.331490 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:44.331395    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r7k6q_867ce071-ca92-4c44-9ff2-c6663b4329a3/manager/0.log"
May 27 17:39:44.985584 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:44.985551    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mslcs_d843336d-ee2f-4793-b070-65f7f00f3ba1/discovery/0.log"
May 27 17:39:45.196891 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:45.196860    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f455b956-k6bsh_7491029b-0abd-4335-bffd-7edf8d6336c3/kube-auth-proxy/0.log"
May 27 17:39:45.422799 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:45.422770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-bs5xd_fc1eb76d-72db-4de7-ad2d-54025a159765/payload-processing/0.log"
May 27 17:39:45.844461 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:45.844378    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc_248c2bfb-9d6f-4c11-b10e-be14bb2567d4/main/0.log"
May 27 17:39:45.850474 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:45.850450    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-r9jqc_248c2bfb-9d6f-4c11-b10e-be14bb2567d4/storage-initializer/0.log"
May 27 17:39:46.193880 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.193846    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5_c0ca93cf-cf9e-4343-92a9-f8515583f615/storage-initializer/0.log"
May 27 17:39:46.207813 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.207786    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccglrl5_c0ca93cf-cf9e-4343-92a9-f8515583f615/main/0.log"
May 27 17:39:46.313450 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.313416    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w_7a278c37-a1c8-4f08-a48c-fc3a40bb34a6/storage-initializer/0.log"
May 27 17:39:46.320638 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.320616    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-pqk7w_7a278c37-a1c8-4f08-a48c-fc3a40bb34a6/main/0.log"
May 27 17:39:46.426519 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.426478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd_c649acf9-a783-443e-b27c-f2c7bbdb6e2f/main/0.log"
May 27 17:39:46.434053 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:46.434030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-vg2xd_c649acf9-a783-443e-b27c-f2c7bbdb6e2f/storage-initializer/0.log"
May 27 17:39:53.054813 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:53.054780    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kmrbw_e9b4b21f-be65-420b-99f5-d8e862bd5f19/global-pull-secret-syncer/0.log"
May 27 17:39:53.255215 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:53.255184    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-whzk4_f1a34c0a-2993-4426-a340-a3e837e7bd65/konnectivity-agent/0.log"
May 27 17:39:53.302346 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:53.302315    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-95.ec2.internal_804d458f95fa96a745eb8f8ad795da87/haproxy/0.log"
May 27 17:39:57.648654 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:57.648619    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-7xq9f_386ac2cc-e48d-4577-a748-ed6c6f74a8c3/manager/0.log"
May 27 17:39:57.808288 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:57.808253    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r7k6q_867ce071-ca92-4c44-9ff2-c6663b4329a3/manager/0.log"
May 27 17:39:59.591742 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.591714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-bwbz7_30096bae-d32a-4870-9ac5-cd4b82c786cc/monitoring-plugin/0.log"
May 27 17:39:59.784172 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.784142    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2v5j_7cecf5af-7e17-4fc1-8f3c-5c025d0265dc/node-exporter/0.log"
May 27 17:39:59.810818 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.810726    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2v5j_7cecf5af-7e17-4fc1-8f3c-5c025d0265dc/kube-rbac-proxy/0.log"
May 27 17:39:59.833916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.833896    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2v5j_7cecf5af-7e17-4fc1-8f3c-5c025d0265dc/init-textfile/0.log"
May 27 17:39:59.857253 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.857229    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kbws_057bfb2d-32f0-4029-936c-cd749511ae07/kube-rbac-proxy-main/0.log"
May 27 17:39:59.875699 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.875678    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kbws_057bfb2d-32f0-4029-936c-cd749511ae07/kube-rbac-proxy-self/0.log"
May 27 17:39:59.896871 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.896843    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kbws_057bfb2d-32f0-4029-936c-cd749511ae07/openshift-state-metrics/0.log"
May 27 17:39:59.939018 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.938988    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/prometheus/0.log"
May 27 17:39:59.958141 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.958116    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/config-reloader/0.log"
May 27 17:39:59.976154 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.976133    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/thanos-sidecar/0.log"
May 27 17:39:59.994004 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:39:59.993979    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/kube-rbac-proxy-web/0.log"
May 27 17:40:00.012385 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.012353    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/kube-rbac-proxy/0.log"
May 27 17:40:00.032300 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.032265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/kube-rbac-proxy-thanos/0.log"
May 27 17:40:00.052667 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.052639    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_10090078-2a58-4309-8b4c-d8c5da92c639/init-config-reloader/0.log"
May 27 17:40:00.085604 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.085520    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-slzqn_942a66ff-7f44-44b3-9d69-d711140747ce/prometheus-operator/0.log"
May 27 17:40:00.102068 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.102041    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-slzqn_942a66ff-7f44-44b3-9d69-d711140747ce/kube-rbac-proxy/0.log"
May 27 17:40:00.123960 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:00.123924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-4d64h_490c6951-5abb-4453-b448-113fcab13582/prometheus-operator-admission-webhook/0.log"
May 27 17:40:01.835210 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.835170    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"]
May 27 17:40:01.841501 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.841477    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:01.844357 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.844331    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dmpvs\"/\"openshift-service-ca.crt\""
May 27 17:40:01.844507 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.844401    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dmpvs\"/\"kube-root-ca.crt\""
May 27 17:40:01.845488 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.845469    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dmpvs\"/\"default-dockercfg-wmwnq\""
May 27 17:40:01.848522 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.848503    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"]
May 27 17:40:01.900624 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.900585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-sys\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:01.900624 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.900620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-podres\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:01.900916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.900654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-proc\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:01.900916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.900691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-lib-modules\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:01.900916 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:01.900723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btlp2\" (UniqueName: \"kubernetes.io/projected/df6da99a-0ae5-408b-8121-492fa5ab0ca9-kube-api-access-btlp2\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001381 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001345    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btlp2\" (UniqueName: \"kubernetes.io/projected/df6da99a-0ae5-408b-8121-492fa5ab0ca9-kube-api-access-btlp2\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001559 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001440    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-sys\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001559 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001462    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-podres\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001559 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001504    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-proc\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001693 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001560    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-sys\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001693 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-proc\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001693 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001640    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-podres\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001835 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001694    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-lib-modules\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.001835 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.001801    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df6da99a-0ae5-408b-8121-492fa5ab0ca9-lib-modules\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.009192 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.009172    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btlp2\" (UniqueName: \"kubernetes.io/projected/df6da99a-0ae5-408b-8121-492fa5ab0ca9-kube-api-access-btlp2\") pod \"perf-node-gather-daemonset-nhckn\" (UID: \"df6da99a-0ae5-408b-8121-492fa5ab0ca9\") " pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.154291 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.154205    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.295360 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.295333    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"]
May 27 17:40:02.298004 ip-10-0-134-95 kubenswrapper[2574]: W0527 17:40:02.297970    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf6da99a_0ae5_408b_8121_492fa5ab0ca9.slice/crio-392e49884b95acfb8555f1b64594f6b8ccd669020eb14bb62541f0cea735ff05 WatchSource:0}: Error finding container 392e49884b95acfb8555f1b64594f6b8ccd669020eb14bb62541f0cea735ff05: Status 404 returned error can't find the container with id 392e49884b95acfb8555f1b64594f6b8ccd669020eb14bb62541f0cea735ff05
May 27 17:40:02.299689 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.299674    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 17:40:02.546483 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.546452    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-cq2sd_7c750daf-aeba-4596-b397-8e992a931e81/download-server/0.log"
May 27 17:40:02.595968 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.595928    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn" event={"ID":"df6da99a-0ae5-408b-8121-492fa5ab0ca9","Type":"ContainerStarted","Data":"89081522054c345af21aeab3e9a56d494375eae209acefed843a7a872173dc5b"}
May 27 17:40:02.595968 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.595963    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn" event={"ID":"df6da99a-0ae5-408b-8121-492fa5ab0ca9","Type":"ContainerStarted","Data":"392e49884b95acfb8555f1b64594f6b8ccd669020eb14bb62541f0cea735ff05"}
May 27 17:40:02.596203 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.596055    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:02.615635 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:02.615575    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn" podStartSLOduration=1.615557113 podStartE2EDuration="1.615557113s" podCreationTimestamp="2026-05-27 17:40:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 17:40:02.612433981 +0000 UTC m=+2178.286859072" watchObservedRunningTime="2026-05-27 17:40:02.615557113 +0000 UTC m=+2178.289982210"
May 27 17:40:03.896741 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:03.896710    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jst8_8c054a79-8078-4a64-8e25-3465fd819536/dns/0.log"
May 27 17:40:03.917039 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:03.917011    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jst8_8c054a79-8078-4a64-8e25-3465fd819536/kube-rbac-proxy/0.log"
May 27 17:40:03.988854 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:03.988825    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5kckj_079358c4-a393-44f9-b9fa-1fc102d3406b/dns-node-resolver/0.log"
May 27 17:40:04.534778 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:04.534741    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6s5t_527d9373-6319-4a5a-a6cb-5f8939d5ebaa/node-ca/0.log"
May 27 17:40:05.510624 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:05.510588    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mslcs_d843336d-ee2f-4793-b070-65f7f00f3ba1/discovery/0.log"
May 27 17:40:05.552113 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:05.552080    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f455b956-k6bsh_7491029b-0abd-4335-bffd-7edf8d6336c3/kube-auth-proxy/0.log"
May 27 17:40:05.713402 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:05.713367    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-bs5xd_fc1eb76d-72db-4de7-ad2d-54025a159765/payload-processing/0.log"
May 27 17:40:06.274948 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:06.274916    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fh2gk_c714b343-7f2e-4206-888a-a4f51f806b26/serve-healthcheck-canary/0.log"
May 27 17:40:06.881080 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:06.881045    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvcht_9fd838b8-b416-4bfa-8b25-599ab55c2311/kube-rbac-proxy/0.log"
May 27 17:40:06.900309 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:06.900277    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvcht_9fd838b8-b416-4bfa-8b25-599ab55c2311/exporter/0.log"
May 27 17:40:06.921152 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:06.921128    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvcht_9fd838b8-b416-4bfa-8b25-599ab55c2311/extractor/0.log"
May 27 17:40:08.610128 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:08.610096    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dmpvs/perf-node-gather-daemonset-nhckn"
May 27 17:40:08.958024 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:08.957996    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-9wjns_63379391-d23c-43f9-9b90-4067dac0816f/manager/0.log"
May 27 17:40:09.014722 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.014695    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c9fbf4bd6-pq4d7_d03c65c6-aaa0-4c5c-a587-0677981608bf/maas-api/0.log"
May 27 17:40:09.159996 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.159961    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d6874867c-xfzkg_2c00841a-f153-49e6-81cb-313c7203c18e/manager/0.log"
May 27 17:40:09.199229 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.199193    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-mzrcm_ae131f8d-eb3d-4282-ae54-b81eeac9d5ee/manager/1.log"
May 27 17:40:09.220544 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.220469    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-mzrcm_ae131f8d-eb3d-4282-ae54-b81eeac9d5ee/manager/2.log"
May 27 17:40:09.329083 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.329057    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854fc5c4fb-tpzh8_9d508889-c76e-469e-a1d2-74e9737e8576/manager/0.log"
May 27 17:40:09.409830 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:09.409806    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-hrhvr_ccfe8ec3-f56a-4c75-ab02-3e56849de048/postgres/0.log"
May 27 17:40:16.576845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.576817    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/kube-multus-additional-cni-plugins/0.log"
May 27 17:40:16.597960 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.597927    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/egress-router-binary-copy/0.log"
May 27 17:40:16.617990 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.617961    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/cni-plugins/0.log"
May 27 17:40:16.636703 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.636678    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/bond-cni-plugin/0.log"
May 27 17:40:16.659170 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.659141    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/routeoverride-cni/0.log"
May 27 17:40:16.681437 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.681412    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/whereabouts-cni-bincopy/0.log"
May 27 17:40:16.700845 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:16.700823    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qv9m_8c50871b-0a8b-4252-98c7-8f65b052c082/whereabouts-cni/0.log"
May 27 17:40:17.066871 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:17.066834    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kpj7d_757b3253-9e62-409a-9521-6763b37ac0fd/kube-multus/0.log"
May 27 17:40:17.097674 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:17.097645    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2bpp6_045a1e65-3426-4a6c-8824-9759a86b2f41/network-metrics-daemon/0.log"
May 27 17:40:17.116976 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:17.116951    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2bpp6_045a1e65-3426-4a6c-8824-9759a86b2f41/kube-rbac-proxy/0.log"
May 27 17:40:17.998715 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:17.998685    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-controller/0.log"
May 27 17:40:18.014491 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.014467    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/0.log"
May 27 17:40:18.033854 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.033834    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovn-acl-logging/1.log"
May 27 17:40:18.058021 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.057998    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/kube-rbac-proxy-node/0.log"
May 27 17:40:18.083936 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.083911    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/kube-rbac-proxy-ovn-metrics/0.log"
May 27 17:40:18.100824 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.100802    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/northd/0.log"
May 27 17:40:18.121899 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.121875    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/nbdb/0.log"
May 27 17:40:18.141266 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.141244    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/sbdb/0.log"
May 27 17:40:18.307735 ip-10-0-134-95 kubenswrapper[2574]: I0527 17:40:18.307662    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qpf5_a8c8eb69-a1b9-4e29-89fb-5f9acd5ce0cc/ovnkube-controller/0.log"