May 29 02:25:00.836806 ip-10-0-131-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 29 02:25:00.836820 ip-10-0-131-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 29 02:25:00.836828 ip-10-0-131-78 systemd[1]: kubelet.service: Failed with result 'resources'.
May 29 02:25:00.837142 ip-10-0-131-78 systemd[1]: Failed to start Kubernetes Kubelet.
May 29 02:25:10.895164 ip-10-0-131-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 29 02:25:10.895181 ip-10-0-131-78 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 50ee6fe6712748cf9ed012e1b9cb820b --
May 29 02:27:36.204515 ip-10-0-131-78 systemd[1]: Starting Kubernetes Kubelet...
May 29 02:27:36.601163 ip-10-0-131-78 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:36.601163 ip-10-0-131-78 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 02:27:36.601163 ip-10-0-131-78 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:36.601163 ip-10-0-131-78 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 02:27:36.601163 ip-10-0-131-78 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:36.603277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.603205    2547 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 02:27:36.608242 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608228    2547 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:36.608242 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608242    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608246    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608250    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608253    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608256    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608259    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608261    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608265    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608268    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608270    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608273    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608276    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608279    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608281    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608284    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608286    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608294    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608297    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608300    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608302    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:36.608303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608305    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608308    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608310    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608313    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608316    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608319    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608322    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608324    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608327    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608329    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608332    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608334    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608337    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608339    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608344    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608348    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608351    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608353    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608356    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608359    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:36.608775 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608361    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608364    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608366    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608369    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608371    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608373    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608376    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608378    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608380    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608383    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608385    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608388    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608390    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608395    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608399    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608402    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608406    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608408    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608411    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:36.609310 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608414    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608417    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608420    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608423    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608425    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608428    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608431    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608434    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608436    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608438    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608441    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608443    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608446    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608448    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608451    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608453    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608457    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608460    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608462    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:36.609847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608465    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608467    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608470    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608473    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608475    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608477    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.608480    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609867    2547 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609875    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609879    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609882    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609885    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609888    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609892    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609895    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609898    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609901    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609904    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609907    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:36.610332 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609910    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609913    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609916    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609919    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609921    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609924    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609927    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609930    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609932    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609935    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609939    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609943    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609946    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609949    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609951    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609955    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609958    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609961    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609964    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609967    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:36.610799 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609970    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609972    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609975    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609978    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609981    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609984    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609986    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609989    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609992    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609994    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609997    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.609999    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610002    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610004    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610007    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610009    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610012    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610015    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610017    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610020    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:36.611322 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610022    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610025    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610027    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610030    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610032    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610035    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610037    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610041    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610044    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610046    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610049    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610052    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610055    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610057    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610060    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610062    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610065    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610067    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610070    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610072    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:36.611851 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610075    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610077    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610080    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610082    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610085    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610087    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610090    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610093    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610097    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610099    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610102    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610104    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610107    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610109    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610186    2547 flags.go:64] FLAG: --address="0.0.0.0"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610206    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610212    2547 flags.go:64] FLAG: --anonymous-auth="true"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610217    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610221    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610224    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610228    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 02:27:36.612359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610232    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610235    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610238    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610242    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610245    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610248    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610251    2547 flags.go:64] FLAG: --cgroup-root=""
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610254    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610257    2547 flags.go:64] FLAG: --client-ca-file=""
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610260    2547 flags.go:64] FLAG: --cloud-config=""
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610262    2547 flags.go:64] FLAG: --cloud-provider="external"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610265    2547 flags.go:64] FLAG: --cluster-dns="[]"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610270    2547 flags.go:64] FLAG: --cluster-domain=""
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610272    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610275    2547 flags.go:64] FLAG: --config-dir=""
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610278    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610281    2547 flags.go:64] FLAG: --container-log-max-files="5"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610286    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610289    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610293    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610296    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610299    2547 flags.go:64] FLAG: --contention-profiling="false"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610302    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610305    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610308    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 02:27:36.612883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610311    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610314    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610317    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610320    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610323    2547 flags.go:64] FLAG: --enable-load-reader="false"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610326    2547 flags.go:64] FLAG: --enable-server="true"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610329    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610334    2547 flags.go:64] FLAG: --event-burst="100"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610337    2547 flags.go:64] FLAG: --event-qps="50"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610341    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610344    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610347    2547 flags.go:64] FLAG: --eviction-hard=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610351    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610354    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610357    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610360    2547 flags.go:64] FLAG: --eviction-soft=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610363    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610366    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610368    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610371    2547 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610374    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610377    2547 flags.go:64] FLAG: --fail-swap-on="true"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610379    2547 flags.go:64] FLAG: --feature-gates=""
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610383    2547 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610386    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 02:27:36.613512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610389    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610393    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610396    2547 flags.go:64] FLAG: --healthz-port="10248"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610399    2547 flags.go:64] FLAG: --help="false"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610402    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610406    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610409    2547 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610411    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610415    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610418    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610421    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610423    2547 flags.go:64] FLAG: --image-service-endpoint=""
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610426    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610429    2547 flags.go:64] FLAG: --kube-api-burst="100"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610432    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610435    2547 flags.go:64] FLAG: --kube-api-qps="50"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610438    2547 flags.go:64] FLAG: --kube-reserved=""
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610441    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610444    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610449    2547 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610452    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610455    2547 flags.go:64] FLAG: --lock-file=""
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610458    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610461    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 02:27:36.614126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610464    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610469    2547 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610472    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610475    2547 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610477    2547 flags.go:64] FLAG: --logging-format="text"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610480    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610484    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610486    2547 flags.go:64] FLAG: --manifest-url=""
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610490    2547 flags.go:64] FLAG: --manifest-url-header=""
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610494    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610497    2547 flags.go:64] FLAG: --max-open-files="1000000"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610502    2547 flags.go:64] FLAG: --max-pods="110"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610505    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610508    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610511    2547 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610514    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610517    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610519    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610522    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610529    2547 flags.go:64] FLAG: --node-status-max-images="50"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610532    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610535    2547 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610538    2547 flags.go:64] FLAG: --pod-cidr=""
May 29 02:27:36.614721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610541    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610546    2547 flags.go:64] FLAG: --pod-manifest-path=""
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610549    2547 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610552    2547 flags.go:64] FLAG: --pods-per-core="0"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610557    2547 flags.go:64] FLAG: --port="10250"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610560    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610563    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb845923c46a070a"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610566    2547 flags.go:64] FLAG: --qos-reserved=""
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610569    2547 flags.go:64] FLAG: --read-only-port="10255"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610572    2547 flags.go:64] FLAG: --register-node="true"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610575    2547 flags.go:64] FLAG: --register-schedulable="true"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610578    2547 flags.go:64] FLAG: --register-with-taints=""
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610581    2547 flags.go:64] FLAG: --registry-burst="10"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610584    2547 flags.go:64] FLAG: --registry-qps="5"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610587    2547 flags.go:64] FLAG: --reserved-cpus=""
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610589    2547 flags.go:64] FLAG: --reserved-memory=""
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610593    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610599    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610602    2547 flags.go:64] FLAG: --rotate-certificates="false"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610605    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610609    2547 flags.go:64] FLAG: --runonce="false"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610612    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610615    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610618    2547 flags.go:64] FLAG: --seccomp-default="false"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610620    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610623    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 02:27:36.615308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610626    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610629    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610632    2547 flags.go:64] FLAG: --storage-driver-password="root"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610635    2547 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610638    2547 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610641    2547 flags.go:64] FLAG: --storage-driver-user="root"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610643    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610646    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610649    2547 flags.go:64] FLAG: --system-cgroups=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610652    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610658    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610661    2547 flags.go:64] FLAG: --tls-cert-file=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610664    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610668    2547 flags.go:64] FLAG: --tls-min-version=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610670    2547 flags.go:64] FLAG: --tls-private-key-file=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610673    2547 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610676    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610679    2547 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610682    2547 flags.go:64] FLAG: --v="2"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610686    2547 flags.go:64] FLAG: --version="false"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610690    2547 flags.go:64] FLAG: --vmodule=""
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610694    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.610697    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610783    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610787    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:36.615942 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610790    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610793    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610796    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610800    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610802    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610805    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610808    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610811    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610814    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610817    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610819    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610822    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610824    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610827    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610830    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610832    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610835    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610838    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610840    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610843    2547 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:36.616558 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610846    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610848    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610851    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610853    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610856    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610858    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610861    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610864    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610867    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610869    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610872    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610875    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610877    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610880    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610883    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610886    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610888    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610891    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610893    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:36.617146 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610897    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610900    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610903    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610906    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610909    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610912    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610915    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610917    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610920    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610923    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610926    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610929    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610931    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610934    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610936    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610939    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610941    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610944    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610947    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610951    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:36.617651 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610954    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610956    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610959    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610962    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610965    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610967    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610970    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610973    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610975    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610978    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610981    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610983    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610986    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610989    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610991    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610994    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610996    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.610999    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611001    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:36.618149 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611004    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611006    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611009    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611012    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611014    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.611017    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.612028    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.618165    2547 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.618180    2547 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618237    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618242    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618245    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618248    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618251    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618255    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:36.618632 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618258    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618261    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618264    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618266    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618269    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618273    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618276    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618279    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618282    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618285    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618287    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618290    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618293    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618296    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618298    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618301    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618304    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618306    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618308    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:36.619007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618311    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618314    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618317    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618319    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618322    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618324    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618329    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618332    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618335    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618337    2547 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618340    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618342    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618345    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618348    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618350    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618353    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618355    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618358    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618360    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618363    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:36.619493 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618366    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618368    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618371    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618374    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618377    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618379    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618382    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618384    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618387    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618389    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618393    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618395    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618398    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618401    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618403    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618406    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618408    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618410    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618413    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618417    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:36.619994 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618421    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618425    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618428    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618430    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618433    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618436    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618438    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618440    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618443    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618446    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618449    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618451    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618453    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618456    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618458    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618461    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618463    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618466    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618468    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618471    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:36.620501 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618473    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.618478    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618570    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618574    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618577    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618580    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618583    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618586    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618588    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618591    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618594    2547 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618597    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618600    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618603    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618606    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618608    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:36.621031 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618611    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618613    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618616    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618618    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618621    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618623    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618625    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618628    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618630    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618633    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618636    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618639    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618641    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618644    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618647    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618649    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618652    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618654    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618656    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618659    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:36.621503 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618662    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618664    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618667    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618669    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618672    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618674    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618677    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618680    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618683    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618686    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618688    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618706    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618710    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618714    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618718    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618721    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618723    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618726    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618728    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:36.622083 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618731    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618733    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618736    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618738    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618741    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618743    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618745    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618748    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618750    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618753    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618755    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618758    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618760    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618763    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618765    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618768    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618770    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618773    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618775    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618778    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:36.622825 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618780    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618783    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618785    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618788    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618791    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618794    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618796    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618798    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618801    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618804    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618806    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618809    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:36.618813    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.618818    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:36.623373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.619852    2547 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 02:27:36.623757 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.621722    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 02:27:36.625146 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.625126    2547 server.go:1019] "Starting client certificate rotation"
May 29 02:27:36.625252 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.625234    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 02:27:36.625314 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.625272    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 02:27:36.647918 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.647899    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 02:27:36.649610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.649592    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 02:27:36.661246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.661226    2547 log.go:25] "Validated CRI v1 runtime API"
May 29 02:27:36.666943 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.666929    2547 log.go:25] "Validated CRI v1 image API"
May 29 02:27:36.668739 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.668724    2547 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 02:27:36.672974 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.672944    2547 fs.go:135] Filesystem UUIDs: map[124d5653-389f-4094-a38c-0c1c52a6932f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d38ed1e8-97c0-404d-95c7-d972ee669337:/dev/nvme0n1p4]
May 29 02:27:36.673048 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.672966    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 02:27:36.677784 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.677621    2547 manager.go:217] Machine: {Timestamp:2026-05-29 02:27:36.677036991 +0000 UTC m=+0.366992656 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097169 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274137920dc16fbc65ed21c332840b SystemUUID:ec274137-920d-c16f-bc65-ed21c332840b BootID:50ee6fe6-7127-48cf-9ed0-12e1b9cb820b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:38:54:88:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:38:54:88:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:c3:f6:25:74:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 02:27:36.678349 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.678335    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 02:27:36.678428 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.678415    2547 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 02:27:36.681024 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.681001    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 02:27:36.683132 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.683109    2547 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 02:27:36.683269 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.683133    2547 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 02:27:36.683319 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.683279    2547 topology_manager.go:138] "Creating topology manager with none policy"
May 29 02:27:36.683319 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.683288    2547 container_manager_linux.go:306] "Creating device plugin manager"
May 29 02:27:36.683319 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.683295    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 02:27:36.684788 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.684778    2547 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 02:27:36.686650 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.686640    2547 state_mem.go:36] "Initialized new in-memory state store"
May 29 02:27:36.686751 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.686742    2547 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 02:27:36.689486 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.689475    2547 kubelet.go:491] "Attempting to sync node with API server"
May 29 02:27:36.689525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.689492    2547 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 02:27:36.689525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.689507    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 02:27:36.689525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.689516    2547 kubelet.go:397] "Adding apiserver pod source"
May 29 02:27:36.689525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.689524    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 02:27:36.690514 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.690501    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 02:27:36.690553 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.690527    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 02:27:36.693303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.693285    2547 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 29 02:27:36.695001 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.694986    2547 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 02:27:36.695761 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695748    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695767    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695776    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695783    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695795    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695804    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695814    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695823    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695833    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 02:27:36.695839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695842    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 02:27:36.696102 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.695854    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 02:27:36.696102 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.696083    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 02:27:36.696963 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.696952    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 02:27:36.697022 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.696977    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 02:27:36.699934 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.699916    2547 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 02:27:36.700009 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.699952    2547 server.go:1295] "Started kubelet"
May 29 02:27:36.700085 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.700029    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 02:27:36.700220 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.700109    2547 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 02:27:36.700220 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.700175    2547 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 02:27:36.700834 ip-10-0-131-78 systemd[1]: Started Kubernetes Kubelet.
May 29 02:27:36.701403 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.700858    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 02:27:36.701403 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.700897    2547 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 29 02:27:36.701403 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.700918    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 02:27:36.701403 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.701061    2547 server.go:317] "Adding debug handlers to kubelet server"
May 29 02:27:36.703886 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.703870    2547 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 02:27:36.705530 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.704710    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-78.ec2.internal.18b3e8440c1a0856  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-78.ec2.internal,UID:ip-10-0-131-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-78.ec2.internal,},FirstTimestamp:2026-05-29 02:27:36.69993071 +0000 UTC m=+0.389886380,LastTimestamp:2026-05-29 02:27:36.69993071 +0000 UTC m=+0.389886380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-78.ec2.internal,}"
May 29 02:27:36.709144 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.709124    2547 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 02:27:36.709234 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709209    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 02:27:36.709234 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709217    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 02:27:36.709356 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709343    2547 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 02:27:36.709409 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709358    2547 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 02:27:36.709527 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709509    2547 reconstruct.go:97] "Volume reconstruction finished"
May 29 02:27:36.709527 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709525    2547 reconciler.go:26] "Reconciler: start to sync state"
May 29 02:27:36.709671 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.709545    2547 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 02:27:36.710063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710040    2547 factory.go:55] Registering systemd factory
May 29 02:27:36.710063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710067    2547 factory.go:223] Registration of the systemd container factory successfully
May 29 02:27:36.710240 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.710048    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:36.710427 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710406    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-snnbb"
May 29 02:27:36.710826 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710809    2547 factory.go:153] Registering CRI-O factory
May 29 02:27:36.710904 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710828    2547 factory.go:223] Registration of the crio container factory successfully
May 29 02:27:36.710904 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710876    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 02:27:36.710904 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710892    2547 factory.go:103] Registering Raw factory
May 29 02:27:36.711028 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.710910    2547 manager.go:1196] Started watching for new ooms in manager
May 29 02:27:36.711502 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.711488    2547 manager.go:319] Starting recovery of all containers
May 29 02:27:36.712144 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.712119    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 29 02:27:36.718763 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.718743    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-snnbb"
May 29 02:27:36.722510 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.722398    2547 manager.go:324] Recovery completed
May 29 02:27:36.723933 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.723906    2547 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 29 02:27:36.726742 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.726723    2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-78.ec2.internal\" not found" node="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.726895 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.726883    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.729633 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.729618    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.729693 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.729644    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.729693 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.729657    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.730073 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.730055    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 02:27:36.730073 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.730070    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 02:27:36.730176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.730089    2547 state_mem.go:36] "Initialized new in-memory state store"
May 29 02:27:36.732382 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.732370    2547 policy_none.go:49] "None policy: Start"
May 29 02:27:36.732424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.732387    2547 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 02:27:36.732424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.732397    2547 state_mem.go:35] "Initializing new in-memory state store"
May 29 02:27:36.768790 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.768777    2547 manager.go:341] "Starting Device Plugin manager"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.768812    2547 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.768824    2547 server.go:85] "Starting device plugin registration server"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.769039    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.769050    2547 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.769135    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.769227    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.769237    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.769696    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 02:27:36.780610 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.769733    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:36.833883 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.833856    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 02:27:36.834979 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.834958    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 02:27:36.835071 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.834982    2547 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 02:27:36.835071 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.834998    2547 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 02:27:36.835071 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.835005    2547 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 02:27:36.835071 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.835044    2547 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 02:27:36.841630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.841616    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:36.869534 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.869498    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.870210 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.870182    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.870277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.870221    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.870277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.870233    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.870277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.870267    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.876849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.876837    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.876889 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.876855    2547 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-78.ec2.internal\": node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:36.895423 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.895402    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:36.935894 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.935870    2547 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"]
May 29 02:27:36.935953 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.935926    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.936622 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.936595    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.936622 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.936622    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.936761 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.936636    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.937955 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.937941    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.938121 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.938105    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:36.938177 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.938132    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.939964 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.939949    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.939964 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.939959    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.940072 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.939978    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.940072 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.939979    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.940072 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.939994    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.940072 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.940001    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.941409 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.941397    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:36.941445 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.941424    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:36.942324 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.942310    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:36.942391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.942334    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:36.942391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:36.942343    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:36.970249 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.970231    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-78.ec2.internal\" not found" node="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.974108 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.974093    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-78.ec2.internal\" not found" node="ip-10-0-131-78.ec2.internal"
May 29 02:27:36.995456 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:36.995439    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.095975 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.095948    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.111256 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.111236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.111321 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.111262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ad922ff6556f545e846ed84cd40472-config\") pod \"kube-apiserver-proxy-ip-10-0-131-78.ec2.internal\" (UID: \"33ad922ff6556f545e846ed84cd40472\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.111321 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.111293    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.196642 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.196600    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.211895 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211881    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.211944 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211902    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.211944 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211917    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ad922ff6556f545e846ed84cd40472-config\") pod \"kube-apiserver-proxy-ip-10-0-131-78.ec2.internal\" (UID: \"33ad922ff6556f545e846ed84cd40472\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.212004 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211951    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ad922ff6556f545e846ed84cd40472-config\") pod \"kube-apiserver-proxy-ip-10-0-131-78.ec2.internal\" (UID: \"33ad922ff6556f545e846ed84cd40472\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.212004 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211989    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.212067 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.211987    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a29bf12173ecd9e8e42d06f5b7b6ae9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal\" (UID: \"9a29bf12173ecd9e8e42d06f5b7b6ae9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.274033 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.274015    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.277592 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.277575    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:37.297252 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.297232    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.397668 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.397646    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.498220 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.498118    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.598608 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.598580    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.625025 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.625005    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 02:27:37.625530 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.625133    2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 02:27:37.699600 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.699571    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.709473 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.709455    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 02:27:37.721394 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.721363    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 02:22:36 +0000 UTC" deadline="2027-11-01 21:36:20.248959301 +0000 UTC"
May 29 02:27:37.721394 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.721393    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12523h8m42.527569346s"
May 29 02:27:37.725012 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.724996    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 02:27:37.755038 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.754985    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2nx9"
May 29 02:27:37.756662 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:37.756639    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a29bf12173ecd9e8e42d06f5b7b6ae9.slice/crio-64c940fafab07a40798fb392572abbbcec67e18e050fc03a686e1ff9868544b1 WatchSource:0}: Error finding container 64c940fafab07a40798fb392572abbbcec67e18e050fc03a686e1ff9868544b1: Status 404 returned error can't find the container with id 64c940fafab07a40798fb392572abbbcec67e18e050fc03a686e1ff9868544b1
May 29 02:27:37.756809 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:37.756798    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ad922ff6556f545e846ed84cd40472.slice/crio-451bd4f29cf1a32efa819c564c66ed2307badc6971677330c4506db312b1875b WatchSource:0}: Error finding container 451bd4f29cf1a32efa819c564c66ed2307badc6971677330c4506db312b1875b: Status 404 returned error can't find the container with id 451bd4f29cf1a32efa819c564c66ed2307badc6971677330c4506db312b1875b
May 29 02:27:37.761131 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.761108    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:27:37.763604 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.763589    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2nx9"
May 29 02:27:37.800502 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.800481    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.837568 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.837518    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal" event={"ID":"9a29bf12173ecd9e8e42d06f5b7b6ae9","Type":"ContainerStarted","Data":"64c940fafab07a40798fb392572abbbcec67e18e050fc03a686e1ff9868544b1"}
May 29 02:27:37.838873 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.838853    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal" event={"ID":"33ad922ff6556f545e846ed84cd40472","Type":"ContainerStarted","Data":"451bd4f29cf1a32efa819c564c66ed2307badc6971677330c4506db312b1875b"}
May 29 02:27:37.842713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.842691    2547 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:37.900813 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:37.900794    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:37.915842 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:37.915819    2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:38.000930 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.000909    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:38.101436 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.101386    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:38.202317 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.202287    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-78.ec2.internal\" not found"
May 29 02:27:38.248501 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.248478    2547 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:38.309823 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.309793    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal"
May 29 02:27:38.320674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.320650    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 02:27:38.321783 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.321766    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal"
May 29 02:27:38.334441 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.334424    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 02:27:38.690485 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.690428    2547 apiserver.go:52] "Watching apiserver"
May 29 02:27:38.701179 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.701125    2547 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 02:27:38.701777 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.701742    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-2txjc","kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg","openshift-cluster-node-tuning-operator/tuned-8nnpc","openshift-multus/multus-5z9h6","openshift-network-operator/iptables-alerter-n6rsc","openshift-ovn-kubernetes/ovnkube-node-97cs5","kube-system/konnectivity-agent-4m2ft","openshift-dns/node-resolver-zvf6f","openshift-image-registry/node-ca-jqs96","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-nct75","openshift-multus/network-metrics-daemon-lqs2h"]
May 29 02:27:38.704720 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.704676    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.707320 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.707275    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.707716 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.707638    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 02:27:38.707907 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.707782    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 02:27:38.707907 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.707849    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-45mz6\""
May 29 02:27:38.708143 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.708118    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 02:27:38.709758 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.709717    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.710626 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.710435    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 02:27:38.710626 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.710498    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5rz5l\""
May 29 02:27:38.710924 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.710903    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 02:27:38.710996 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.710905    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 02:27:38.712163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.712132    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.712370 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.712348    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 02:27:38.712459 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.712427    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sp5ch\""
May 29 02:27:38.712636 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.712615    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714571    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714571    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714641    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-52m6z\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714662    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714676    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 02:27:38.714683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.714686    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.717170 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.717143    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.718505 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.718468    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 02:27:38.718646 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.718468    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5b4wg\""
May 29 02:27:38.718721 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.718695    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 02:27:38.719321 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.719300    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 02:27:38.719874 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.719847    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.719963 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.719923    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 02:27:38.720274 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-sys\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.720373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720282    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-lib-modules\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.720373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720312    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-tuned\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.720460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720374    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwnfz\" (UniqueName: \"kubernetes.io/projected/daf3b546-2ad5-4170-8576-9ffeecbfa98d-kube-api-access-pwnfz\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.720460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720396    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 02:27:38.720460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720407    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-45trd\""
May 29 02:27:38.720460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720411    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysconfig\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.720460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720451    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-kubernetes\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.720687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720514    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczw9\" (UniqueName: \"kubernetes.io/projected/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-kube-api-access-mczw9\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.720687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720557    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.720687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720601    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-sys-fs\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.720687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720631    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-netns\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.720687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720662    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-multus-certs\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.720920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720695    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ph77\" (UniqueName: \"kubernetes.io/projected/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kube-api-access-2ph77\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.720920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720751    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-system-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.720920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720792    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.720920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf3b546-2ad5-4170-8576-9ffeecbfa98d-host\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.720920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720896    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-device-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720931    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-var-lib-kubelet\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720961    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cnibin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.720992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-os-release\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-conf-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-host\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-tmp\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf3b546-2ad5-4170-8576-9ffeecbfa98d-serviceca\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.721149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721129    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-modprobe-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721182    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-conf\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721279    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-systemd\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721322    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-bin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721365    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-socket-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721386    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721409    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cni-binary-copy\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-socket-dir-parent\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721453    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-k8s-cni-cncf-io\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721486    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-multus\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.721542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721515    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-hostroot\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721582    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-kubelet\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721617    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c89rq\" (UniqueName: \"kubernetes.io/projected/e4c08506-b3a1-4514-8c89-02a406185ac7-kube-api-access-c89rq\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-registration-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721681    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-run\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721708    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-daemon-config\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.722034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.721743    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-etc-kubernetes\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.722432 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.722410    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6qt46\""
May 29 02:27:38.722598 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.722574    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:38.722837 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.722756    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:38.723265 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.723232    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 02:27:38.723854 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.723831    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 02:27:38.726838 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.726790    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.731161 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.731116    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 02:27:38.731424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.731254    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 02:27:38.731424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.731116    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7vphr\""
May 29 02:27:38.733429 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.733379    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.733690 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.733607    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:38.736233 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.736177    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.739347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739090    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 02:27:38.739347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739167    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 02:27:38.739347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739191    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 02:27:38.739805 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739368    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 02:27:38.739805 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739748    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 02:27:38.739922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.739848    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h4f9k\""
May 29 02:27:38.740278 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.740180    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 02:27:38.764344 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.764272    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:22:37 +0000 UTC" deadline="2028-01-31 14:50:57.094342029 +0000 UTC"
May 29 02:27:38.764344 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.764334    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14700h23m18.330011808s"
May 29 02:27:38.811043 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.810995    2547 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 02:27:38.822337 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822273    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cnibin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822337 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822332    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-os-release\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822369    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-conf-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822405    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcb62fb6-4481-45c5-81e0-8b56ce82272a-hosts-file\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822429    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cnibin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822435    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822488    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-conf-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822504    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-os-release\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822543    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-systemd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822568    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-etc-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822590    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-config\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822623    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-host\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822642    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-tmp\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822664    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf3b546-2ad5-4170-8576-9ffeecbfa98d-serviceca\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822690    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-conf\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822694    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-host\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.822698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822715    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-systemd\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822752    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-multus\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822761    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-systemd\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822780    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-etc-kubernetes\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822805    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-multus\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-systemd-units\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822836    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-etc-kubernetes\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822850    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-k8s-cni-cncf-io\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822881    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-hostroot\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822916    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-os-release\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822938    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-conf\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822947    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-k8s-cni-cncf-io\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822945    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-hostroot\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.822948    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-log-socket\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823003    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-bin\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823034    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-env-overrides\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6wk\" (UniqueName: \"kubernetes.io/projected/c9adf29d-9694-4db4-9483-e4ea17603a11-kube-api-access-2r6wk\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.823423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823112    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-iptables-alerter-script\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823143    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-kubelet\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823234    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-kubelet\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823278    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-node-log\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-script-lib\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823324    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/daf3b546-2ad5-4170-8576-9ffeecbfa98d-serviceca\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823378    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dad2726-472c-4f03-9ccd-a0e1afa69931-agent-certs\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhp4\" (UniqueName: \"kubernetes.io/projected/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-kube-api-access-zbhp4\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823441    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c89rq\" (UniqueName: \"kubernetes.io/projected/e4c08506-b3a1-4514-8c89-02a406185ac7-kube-api-access-c89rq\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823475    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-run\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823517    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-cnibin\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823451    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823578    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-run\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823577    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-var-lib-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.824151 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823657    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-host-slash\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823683    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-lib-modules\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823716    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-tuned\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823753    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwnfz\" (UniqueName: \"kubernetes.io/projected/daf3b546-2ad5-4170-8576-9ffeecbfa98d-kube-api-access-pwnfz\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823779    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-slash\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823805    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823835    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823872    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-lib-modules\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823869    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-netns\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823920    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-netns\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.823928    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb62fb6-4481-45c5-81e0-8b56ce82272a-tmp-dir\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjlvd\" (UniqueName: \"kubernetes.io/projected/502a08f0-241a-424b-80f6-bd4840fc3be4-kube-api-access-qjlvd\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824051    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824059    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-system-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824138    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824165    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm4fr\" (UniqueName: \"kubernetes.io/projected/e24ec829-6940-4925-bf2e-e68d7bb063b8-kube-api-access-lm4fr\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.825061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824214    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf3b546-2ad5-4170-8576-9ffeecbfa98d-host\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824244    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-system-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824249    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-device-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824309    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-device-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824289    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-var-lib-kubelet\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824349    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824359    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-var-lib-kubelet\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824411    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-modprobe-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824436    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf3b546-2ad5-4170-8576-9ffeecbfa98d-host\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824441    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824476    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-bin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824444    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-var-lib-cni-bin\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824514    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-system-cni-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824541    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824557    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-modprobe-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824586    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-netd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824619    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dad2726-472c-4f03-9ccd-a0e1afa69931-konnectivity-ca\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.825824 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824652    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-socket-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824679    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824705    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cni-binary-copy\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824733    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-socket-dir-parent\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824758    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhsk\" (UniqueName: \"kubernetes.io/projected/fcb62fb6-4481-45c5-81e0-8b56ce82272a-kube-api-access-jzhsk\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824786    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-netns\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824811    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-ovn\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824842    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-kubelet\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824869    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-registration-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824873    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysctl-d\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824901    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-daemon-config\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824928    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-sys\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824932    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-socket-dir-parent\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824990    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysconfig\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824919    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-socket-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.824940    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-registration-dir\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825063    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-kubernetes\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826365 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825074    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-sysconfig\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825003    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-sys\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825117    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-kubernetes\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825141    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mczw9\" (UniqueName: \"kubernetes.io/projected/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-kube-api-access-mczw9\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825190    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825243    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-sys-fs\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825273    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-multus-certs\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825311    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9adf29d-9694-4db4-9483-e4ea17603a11-ovn-node-metrics-cert\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825340    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ph77\" (UniqueName: \"kubernetes.io/projected/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kube-api-access-2ph77\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825353    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6927a93-4bf0-4f03-bc41-597c22f68ad9-sys-fs\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825369    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825406    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-host-run-multus-certs\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825481    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-cni-binary-copy\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825518    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-cni-dir\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.826869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.825660    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-multus-daemon-config\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.828804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.828754    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-etc-tuned\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.828804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.828785    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4c08506-b3a1-4514-8c89-02a406185ac7-tmp\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.834859 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.834805    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c89rq\" (UniqueName: \"kubernetes.io/projected/e4c08506-b3a1-4514-8c89-02a406185ac7-kube-api-access-c89rq\") pod \"tuned-8nnpc\" (UID: \"e4c08506-b3a1-4514-8c89-02a406185ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:38.837501 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.837447    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwnfz\" (UniqueName: \"kubernetes.io/projected/daf3b546-2ad5-4170-8576-9ffeecbfa98d-kube-api-access-pwnfz\") pod \"node-ca-jqs96\" (UID: \"daf3b546-2ad5-4170-8576-9ffeecbfa98d\") " pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:38.838621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.838570    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ph77\" (UniqueName: \"kubernetes.io/projected/e6927a93-4bf0-4f03-bc41-597c22f68ad9-kube-api-access-2ph77\") pod \"aws-ebs-csi-driver-node-dtnkg\" (UID: \"e6927a93-4bf0-4f03-bc41-597c22f68ad9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:38.839101 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.839059    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczw9\" (UniqueName: \"kubernetes.io/projected/aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad-kube-api-access-mczw9\") pod \"multus-5z9h6\" (UID: \"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad\") " pod="openshift-multus/multus-5z9h6"
May 29 02:27:38.926063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926028    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-system-cni-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926065    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926090    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-netd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926109    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dad2726-472c-4f03-9ccd-a0e1afa69931-konnectivity-ca\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926128    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhsk\" (UniqueName: \"kubernetes.io/projected/fcb62fb6-4481-45c5-81e0-8b56ce82272a-kube-api-access-jzhsk\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926148    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-netns\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926173    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-ovn\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926242    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-ovn\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926266    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-netd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926289    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-netns\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926316    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-kubelet\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926336    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926345    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926383    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9adf29d-9694-4db4-9483-e4ea17603a11-ovn-node-metrics-cert\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926409    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcb62fb6-4481-45c5-81e0-8b56ce82272a-hosts-file\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926411    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-system-cni-dir\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926435    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926472    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-systemd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926436    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-kubelet\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926497    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-etc-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926528    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-config\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926534    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-systemd\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926560    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-systemd-units\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926586    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-os-release\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926590    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-etc-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926616    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-log-socket\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926637    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-systemd-units\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926642    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-bin\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926670    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-env-overrides\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.926839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926696    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6wk\" (UniqueName: \"kubernetes.io/projected/c9adf29d-9694-4db4-9483-e4ea17603a11-kube-api-access-2r6wk\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926701    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-os-release\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926721    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-iptables-alerter-script\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926750    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-log-socket\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926755    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-cni-bin\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926750    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926815    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-node-log\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926843    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-script-lib\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926868    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dad2726-472c-4f03-9ccd-a0e1afa69931-agent-certs\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926895    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhp4\" (UniqueName: \"kubernetes.io/projected/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-kube-api-access-zbhp4\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926925    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-cnibin\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926951    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926951    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcb62fb6-4481-45c5-81e0-8b56ce82272a-hosts-file\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.926979    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-var-lib-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927008    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927035    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-host-slash\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927065    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-slash\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.927632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927100    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dad2726-472c-4f03-9ccd-a0e1afa69931-konnectivity-ca\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927103    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927147    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927156    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb62fb6-4481-45c5-81e0-8b56ce82272a-tmp-dir\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927185    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjlvd\" (UniqueName: \"kubernetes.io/projected/502a08f0-241a-424b-80f6-bd4840fc3be4-kube-api-access-qjlvd\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927189    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-node-log\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927237    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927267    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927294    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm4fr\" (UniqueName: \"kubernetes.io/projected/e24ec829-6940-4925-bf2e-e68d7bb063b8-kube-api-access-lm4fr\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927334    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-binary-copy\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-var-lib-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-host-slash\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927435    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-slash\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927468    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-env-overrides\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927505    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb62fb6-4481-45c5-81e0-8b56ce82272a-tmp-dir\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927520    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-config\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927529    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-iptables-alerter-script\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927570    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e24ec829-6940-4925-bf2e-e68d7bb063b8-cnibin\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.928411 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.927609    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927613    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927647    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9adf29d-9694-4db4-9483-e4ea17603a11-run-openvswitch\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.927736    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:39.427669809 +0000 UTC m=+3.117625484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.927980    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9adf29d-9694-4db4-9483-e4ea17603a11-ovnkube-script-lib\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.928100    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.929329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.928548    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e24ec829-6940-4925-bf2e-e68d7bb063b8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:38.929984 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.929962    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9adf29d-9694-4db4-9483-e4ea17603a11-ovn-node-metrics-cert\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.930336 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.930318    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dad2726-472c-4f03-9ccd-a0e1afa69931-agent-certs\") pod \"konnectivity-agent-4m2ft\" (UID: \"1dad2726-472c-4f03-9ccd-a0e1afa69931\") " pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:38.942168 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.942109    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:38.942168 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.942132    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:38.942168 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.942144    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:38.942401 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:38.942222    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:39.442188709 +0000 UTC m=+3.132144375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:38.942401 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.942306    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhsk\" (UniqueName: \"kubernetes.io/projected/fcb62fb6-4481-45c5-81e0-8b56ce82272a-kube-api-access-jzhsk\") pod \"node-resolver-zvf6f\" (UID: \"fcb62fb6-4481-45c5-81e0-8b56ce82272a\") " pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:38.942513 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.942438    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6wk\" (UniqueName: \"kubernetes.io/projected/c9adf29d-9694-4db4-9483-e4ea17603a11-kube-api-access-2r6wk\") pod \"ovnkube-node-97cs5\" (UID: \"c9adf29d-9694-4db4-9483-e4ea17603a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:38.945058 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.945042    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjlvd\" (UniqueName: \"kubernetes.io/projected/502a08f0-241a-424b-80f6-bd4840fc3be4-kube-api-access-qjlvd\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:38.945345 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.945321    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhp4\" (UniqueName: \"kubernetes.io/projected/5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3-kube-api-access-zbhp4\") pod \"iptables-alerter-n6rsc\" (UID: \"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3\") " pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:38.946306 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:38.946288    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm4fr\" (UniqueName: \"kubernetes.io/projected/e24ec829-6940-4925-bf2e-e68d7bb063b8-kube-api-access-lm4fr\") pod \"multus-additional-cni-plugins-nct75\" (UID: \"e24ec829-6940-4925-bf2e-e68d7bb063b8\") " pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:39.021890 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.021813    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jqs96"
May 29 02:27:39.034736 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.034664    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg"
May 29 02:27:39.041410 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.041358    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:39.048086 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.048029    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nnpc"
May 29 02:27:39.056510 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.056441    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5z9h6"
May 29 02:27:39.067837 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.067775    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6rsc"
May 29 02:27:39.079234 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.079160    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:39.090549 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.090477    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvf6f"
May 29 02:27:39.102002 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.101936    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nct75"
May 29 02:27:39.111400 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.111322    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:27:39.404596 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.404571    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6927a93_4bf0_4f03_bc41_597c22f68ad9.slice/crio-27254550b1c7b13a99f169f8539d07aebb21b9e775bd46f7653e35d8b221c0b0 WatchSource:0}: Error finding container 27254550b1c7b13a99f169f8539d07aebb21b9e775bd46f7653e35d8b221c0b0: Status 404 returned error can't find the container with id 27254550b1c7b13a99f169f8539d07aebb21b9e775bd46f7653e35d8b221c0b0
May 29 02:27:39.406020 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.405883    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecb947e_f20b_4a7b_a3bf_cd7ebde8d3ad.slice/crio-6a3d071ba325dc24b46b19a2a6ae74bf362de9a90234a9f829234576e8b4767d WatchSource:0}: Error finding container 6a3d071ba325dc24b46b19a2a6ae74bf362de9a90234a9f829234576e8b4767d: Status 404 returned error can't find the container with id 6a3d071ba325dc24b46b19a2a6ae74bf362de9a90234a9f829234576e8b4767d
May 29 02:27:39.407116 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.407078    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c08506_b3a1_4514_8c89_02a406185ac7.slice/crio-049c927b65766b5c83efdda31e9018e90c98a8b083d50815e4ff67fbca15de62 WatchSource:0}: Error finding container 049c927b65766b5c83efdda31e9018e90c98a8b083d50815e4ff67fbca15de62: Status 404 returned error can't find the container with id 049c927b65766b5c83efdda31e9018e90c98a8b083d50815e4ff67fbca15de62
May 29 02:27:39.408259 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.408233    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb5e6d9_dc87_4727_b041_2d1bbed4a5e3.slice/crio-04f4bbf663d52e9a6471ff1ec7c969565be0bebb0d7c82e562f23441b5aa6350 WatchSource:0}: Error finding container 04f4bbf663d52e9a6471ff1ec7c969565be0bebb0d7c82e562f23441b5aa6350: Status 404 returned error can't find the container with id 04f4bbf663d52e9a6471ff1ec7c969565be0bebb0d7c82e562f23441b5aa6350
May 29 02:27:39.411161 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.410923    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ec829_6940_4925_bf2e_e68d7bb063b8.slice/crio-7eb8fd8b7b5252b5bff6434e92f46396106dd7b325658d5c4433034157b496e7 WatchSource:0}: Error finding container 7eb8fd8b7b5252b5bff6434e92f46396106dd7b325658d5c4433034157b496e7: Status 404 returned error can't find the container with id 7eb8fd8b7b5252b5bff6434e92f46396106dd7b325658d5c4433034157b496e7
May 29 02:27:39.412654 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.412288    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf3b546_2ad5_4170_8576_9ffeecbfa98d.slice/crio-ffe2645db5404447b5062dff95d76a9817b1926d553c8ae3f421c46ee9da1111 WatchSource:0}: Error finding container ffe2645db5404447b5062dff95d76a9817b1926d553c8ae3f421c46ee9da1111: Status 404 returned error can't find the container with id ffe2645db5404447b5062dff95d76a9817b1926d553c8ae3f421c46ee9da1111
May 29 02:27:39.413389 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.413188    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb62fb6_4481_45c5_81e0_8b56ce82272a.slice/crio-631f5d9f5bdef8cc93e6ae31d67f35697740ecba40ac5f1411bae13829d474e6 WatchSource:0}: Error finding container 631f5d9f5bdef8cc93e6ae31d67f35697740ecba40ac5f1411bae13829d474e6: Status 404 returned error can't find the container with id 631f5d9f5bdef8cc93e6ae31d67f35697740ecba40ac5f1411bae13829d474e6
May 29 02:27:39.414000 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.413953    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dad2726_472c_4f03_9ccd_a0e1afa69931.slice/crio-383e4d9cfe9758e5f49c8b5b2c3eed4a7b6db3015c0c267ed2f9ef1e60e11182 WatchSource:0}: Error finding container 383e4d9cfe9758e5f49c8b5b2c3eed4a7b6db3015c0c267ed2f9ef1e60e11182: Status 404 returned error can't find the container with id 383e4d9cfe9758e5f49c8b5b2c3eed4a7b6db3015c0c267ed2f9ef1e60e11182
May 29 02:27:39.414849 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:27:39.414830    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9adf29d_9694_4db4_9483_e4ea17603a11.slice/crio-b13eb992b3fcf89e987eca8154e298e8a0fc7f1c2b09d268c0c0a3748e709d5d WatchSource:0}: Error finding container b13eb992b3fcf89e987eca8154e298e8a0fc7f1c2b09d268c0c0a3748e709d5d: Status 404 returned error can't find the container with id b13eb992b3fcf89e987eca8154e298e8a0fc7f1c2b09d268c0c0a3748e709d5d
May 29 02:27:39.432027 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.431838    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:39.432076 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.431977    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:39.432114 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.432099    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:40.432078514 +0000 UTC m=+4.122034172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:39.533317 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.533296    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:39.533467 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.533448    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:39.533512 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.533472    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:39.533512 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.533482    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:39.533606 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.533529    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:40.533511543 +0000 UTC m=+4.223467215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:39.765184 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.764757    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:22:37 +0000 UTC" deadline="2028-01-07 13:04:04.357489149 +0000 UTC"
May 29 02:27:39.765184 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.764793    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14122h36m24.592700095s"
May 29 02:27:39.835860 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.835831    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:39.836010 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.835950    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:39.849490 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.849361    2547 generic.go:358] "Generic (PLEG): container finished" podID="9a29bf12173ecd9e8e42d06f5b7b6ae9" containerID="eaf09bbcd99044640e7b21dff733dedaccfd32e6ce4b21b579432f769a1ff79c" exitCode=0
May 29 02:27:39.849490 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.849444    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal" event={"ID":"9a29bf12173ecd9e8e42d06f5b7b6ae9","Type":"ContainerDied","Data":"eaf09bbcd99044640e7b21dff733dedaccfd32e6ce4b21b579432f769a1ff79c"}
May 29 02:27:39.865506 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.865088    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal" event={"ID":"33ad922ff6556f545e846ed84cd40472","Type":"ContainerStarted","Data":"0f9296a73dfef804552866097858e4bbeac299d59ef299bb853668faa88aa4c0"}
May 29 02:27:39.869631 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.869603    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4m2ft" event={"ID":"1dad2726-472c-4f03-9ccd-a0e1afa69931","Type":"ContainerStarted","Data":"383e4d9cfe9758e5f49c8b5b2c3eed4a7b6db3015c0c267ed2f9ef1e60e11182"}
May 29 02:27:39.875911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.875853    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nnpc" event={"ID":"e4c08506-b3a1-4514-8c89-02a406185ac7","Type":"ContainerStarted","Data":"049c927b65766b5c83efdda31e9018e90c98a8b083d50815e4ff67fbca15de62"}
May 29 02:27:39.883296 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.883268    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg" event={"ID":"e6927a93-4bf0-4f03-bc41-597c22f68ad9","Type":"ContainerStarted","Data":"27254550b1c7b13a99f169f8539d07aebb21b9e775bd46f7653e35d8b221c0b0"}
May 29 02:27:39.893739 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.893673    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"b13eb992b3fcf89e987eca8154e298e8a0fc7f1c2b09d268c0c0a3748e709d5d"}
May 29 02:27:39.913552 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.913525    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvf6f" event={"ID":"fcb62fb6-4481-45c5-81e0-8b56ce82272a","Type":"ContainerStarted","Data":"631f5d9f5bdef8cc93e6ae31d67f35697740ecba40ac5f1411bae13829d474e6"}
May 29 02:27:39.920173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.919755    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jqs96" event={"ID":"daf3b546-2ad5-4170-8576-9ffeecbfa98d","Type":"ContainerStarted","Data":"ffe2645db5404447b5062dff95d76a9817b1926d553c8ae3f421c46ee9da1111"}
May 29 02:27:39.927411 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.927314    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6rsc" event={"ID":"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3","Type":"ContainerStarted","Data":"04f4bbf663d52e9a6471ff1ec7c969565be0bebb0d7c82e562f23441b5aa6350"}
May 29 02:27:39.938118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.938090    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerStarted","Data":"7eb8fd8b7b5252b5bff6434e92f46396106dd7b325658d5c4433034157b496e7"}
May 29 02:27:39.947055 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.946999    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5z9h6" event={"ID":"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad","Type":"ContainerStarted","Data":"6a3d071ba325dc24b46b19a2a6ae74bf362de9a90234a9f829234576e8b4767d"}
May 29 02:27:39.974993 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.973486    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-78.ec2.internal" podStartSLOduration=1.973470175 podStartE2EDuration="1.973470175s" podCreationTimestamp="2026-05-29 02:27:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:39.935117101 +0000 UTC m=+3.625072778" watchObservedRunningTime="2026-05-29 02:27:39.973470175 +0000 UTC m=+3.663425830"
May 29 02:27:39.974993 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.974214    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zfdhs"]
May 29 02:27:39.977694 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:39.977192    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:39.977694 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:39.977281    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:40.039266 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.039138    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-dbus\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.039266 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.039188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-kubelet-config\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.039441 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.039370    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141023 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.140990    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-dbus\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.141091    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-kubelet-config\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.141136    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.141222    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-dbus\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.141261    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76485604-838e-4401-a2a7-e5b1a26ad152-kubelet-config\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.141326 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.141278    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.141466 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.141345    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:40.641324234 +0000 UTC m=+4.331279905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.445098 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.445059    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:40.445290 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.445247    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:40.445367 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.445310    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:42.445292323 +0000 UTC m=+6.135247982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:40.546444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.546365    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:40.546597 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.546559    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:40.546597 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.546580    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:40.546597 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.546591    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:40.546743 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.546645    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:42.546626479 +0000 UTC m=+6.236582149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:40.647044 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.647009    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:40.647253 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.647165    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.647253 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.647241    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:41.647222741 +0000 UTC m=+5.337178396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.838297 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.837750    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:40.838297 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:40.837883    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:40.969516 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:40.969254    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal" event={"ID":"9a29bf12173ecd9e8e42d06f5b7b6ae9","Type":"ContainerStarted","Data":"e1b6404d770df23939356c1303b86ea8608d95babf261ab528be14f759fe727a"}
May 29 02:27:41.655179 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:41.655146    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:41.655385 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:41.655295    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:41.655385 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:41.655361    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:43.655342283 +0000 UTC m=+7.345297941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:41.836139 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:41.836111    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:41.836325 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:41.836248    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:41.836626 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:41.836608    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:41.836737 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:41.836699    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:42.462512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:42.462477    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:42.462941 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.462657    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:42.462941 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.462722    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.462703897 +0000 UTC m=+10.152659575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:42.569272 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:42.563824    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:42.569272 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.566694    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:42.569272 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.566719    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:42.569272 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.566732    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:42.569272 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.566802    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.566782754 +0000 UTC m=+10.256738409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:42.835815 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:42.835726    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:42.835970 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:42.835882    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:43.673098 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:43.673059    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:43.673566 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:43.673185    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:43.673566 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:43.673258    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:47.673242851 +0000 UTC m=+11.363198509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:43.836328 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:43.835670    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:43.836328 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:43.835791    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:43.836328 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:43.836213    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:43.836328 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:43.836318    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:44.835809 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:44.835778    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:44.836247 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:44.835918    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:45.835963 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:45.835920    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:45.836493 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:45.835970    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:45.836493 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:45.836038    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:45.836493 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:45.836178    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:46.494655 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:46.494606    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:46.494852 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.494764    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:46.494852 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.494846    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:54.494824645 +0000 UTC m=+18.184780299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:46.596102 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:46.595738    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:46.596102 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.595982    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:46.596102 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.596000    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:46.596102 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.596013    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:46.596102 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.596066    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:54.596048435 +0000 UTC m=+18.286004106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:46.841113 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:46.841029    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:46.841581 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:46.841248    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:47.704669 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:47.704632    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:47.704852 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:47.704798    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:47.704915 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:47.704880    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:55.704858793 +0000 UTC m=+19.394814470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:47.836109 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:47.836071    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:47.836309 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:47.836071    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:47.836382 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:47.836225    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:47.836382 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:47.836368    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:48.835785 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:48.835750    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:48.836244 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:48.835868    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:49.835560 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:49.835500    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:49.835810 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:49.835500    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:49.835810 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:49.835675    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:49.835810 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:49.835740    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:50.835908 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:50.835875    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:50.836330 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:50.836013    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:51.835452 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:51.835417    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:51.835619 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:51.835421    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:51.835619 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:51.835536    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:51.835735 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:51.835618    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:52.835856 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:52.835766    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:52.836340 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:52.835884    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:53.835580 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:53.835548    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:53.835761 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:53.835555    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:53.835761 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:53.835659    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:53.835761 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:53.835739    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:54.558741 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:54.558699    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:54.558903 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.558814    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:54.558903 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.558886    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:10.558864796 +0000 UTC m=+34.248820464 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:54.659875 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:54.659841    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:54.660032 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.659991    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:54.660032 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.660008    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:54.660032 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.660017    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:54.660223 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.660072    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:28:10.660054019 +0000 UTC m=+34.350009695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:54.836173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:54.836100    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:54.836609 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:54.836245    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:55.766373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:55.766341    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:55.766596 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:55.766500    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:55.766596 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:55.766575    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:11.766555425 +0000 UTC m=+35.456511091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:55.835208 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:55.835159    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:55.835348 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:55.835166    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:55.835399 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:55.835345    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:55.835475 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:55.835449    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:56.836217 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:56.836173    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:56.836561 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:56.836273    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:57.836535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:57.836216    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:57.837274 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:57.836217    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:57.837274 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:57.836618    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:27:57.837274 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:57.836707    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:57.999446 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:57.999409    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nnpc" event={"ID":"e4c08506-b3a1-4514-8c89-02a406185ac7","Type":"ContainerStarted","Data":"70be1c4cae7b9c6d89b7d6159259a232e30f31cc93c648283ffef633afe25d56"}
May 29 02:27:58.000759 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.000735    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg" event={"ID":"e6927a93-4bf0-4f03-bc41-597c22f68ad9","Type":"ContainerStarted","Data":"148c478ac196377f75583585694c0af62d75cd36c1fbc830d5ff96079522d9a7"}
May 29 02:27:58.003383 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003364    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:27:58.003689 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003669    2547 generic.go:358] "Generic (PLEG): container finished" podID="c9adf29d-9694-4db4-9483-e4ea17603a11" containerID="ac42df27e8f323997b85b111eae0c87b38691e01cd91488e8dfc6cb059f18b2d" exitCode=1
May 29 02:27:58.003762 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003733    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"4fff65b7d64790238dd18d98cabd77561c681752139c24047f974f4969ab7877"}
May 29 02:27:58.003820 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003764    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"61aa7f939387af87e09bd8a94c5bc687f66609542202e801782ac37974ab0425"}
May 29 02:27:58.003820 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003778    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"828028481ff7d717767b06975926ebf08a76e20f3c09c5ce5af538318785e530"}
May 29 02:27:58.003820 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003792    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"f984ae7774bdeaf9d33b154553d82239933befb8353ded8c8f2d1d4959d6ee0e"}
May 29 02:27:58.003820 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003807    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerDied","Data":"ac42df27e8f323997b85b111eae0c87b38691e01cd91488e8dfc6cb059f18b2d"}
May 29 02:27:58.004000 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.003821    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"16f3b7b195cc3543705f22024b2c5692369c383f26d47b2ac8f1679f50bafa00"}
May 29 02:27:58.004922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.004900    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvf6f" event={"ID":"fcb62fb6-4481-45c5-81e0-8b56ce82272a","Type":"ContainerStarted","Data":"e4e3b16a5fff1a7fc72d0bac6e4d4de159392c37d4dce68d4c4455ced6b960d8"}
May 29 02:27:58.006047 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.006028    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jqs96" event={"ID":"daf3b546-2ad5-4170-8576-9ffeecbfa98d","Type":"ContainerStarted","Data":"9abca501cbecaaeda9c06c067fff7d073ffbf32f6f126f22e421f76c3ff2a8e8"}
May 29 02:27:58.007283 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.007262    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="0b07b07c6aa7943fac9d0d6bccf4eb82cffaa05b203aa8fcd2e080be74f56052" exitCode=0
May 29 02:27:58.007392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.007336    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"0b07b07c6aa7943fac9d0d6bccf4eb82cffaa05b203aa8fcd2e080be74f56052"}
May 29 02:27:58.008716 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.008660    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5z9h6" event={"ID":"aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad","Type":"ContainerStarted","Data":"b6624b09b1646c4a48376aff1fe5fece015e14a33dd2cccc80bde4d6c1b89dc9"}
May 29 02:27:58.010288 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.010248    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4m2ft" event={"ID":"1dad2726-472c-4f03-9ccd-a0e1afa69931","Type":"ContainerStarted","Data":"8f56f0ee98943cef846bc34fc314741815942077ae7e7cf1c4d675751857e124"}
May 29 02:27:58.021381 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.021344    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-78.ec2.internal" podStartSLOduration=20.021333599 podStartE2EDuration="20.021333599s" podCreationTimestamp="2026-05-29 02:27:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:40.99361639 +0000 UTC m=+4.683572066" watchObservedRunningTime="2026-05-29 02:27:58.021333599 +0000 UTC m=+21.711289275"
May 29 02:27:58.021692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.021667    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8nnpc" podStartSLOduration=4.516617961 podStartE2EDuration="22.021657397s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.408904519 +0000 UTC m=+3.098860172" lastFinishedPulling="2026-05-29 02:27:56.913943946 +0000 UTC m=+20.603899608" observedRunningTime="2026-05-29 02:27:58.02123035 +0000 UTC m=+21.711186026" watchObservedRunningTime="2026-05-29 02:27:58.021657397 +0000 UTC m=+21.711613074"
May 29 02:27:58.044052 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.044013    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zvf6f" podStartSLOduration=4.375766709 podStartE2EDuration="22.044002562s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.416743278 +0000 UTC m=+3.106698932" lastFinishedPulling="2026-05-29 02:27:57.084979118 +0000 UTC m=+20.774934785" observedRunningTime="2026-05-29 02:27:58.043504209 +0000 UTC m=+21.733459886" watchObservedRunningTime="2026-05-29 02:27:58.044002562 +0000 UTC m=+21.733958237"
May 29 02:27:58.086309 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.086272    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4m2ft" podStartSLOduration=8.917559694 podStartE2EDuration="22.086260962s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.417013917 +0000 UTC m=+3.106969583" lastFinishedPulling="2026-05-29 02:27:52.585715184 +0000 UTC m=+16.275670851" observedRunningTime="2026-05-29 02:27:58.086071069 +0000 UTC m=+21.776026745" watchObservedRunningTime="2026-05-29 02:27:58.086260962 +0000 UTC m=+21.776216650"
May 29 02:27:58.104320 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.104278    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jqs96" podStartSLOduration=4.6261468279999995 podStartE2EDuration="22.104265859s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.415490945 +0000 UTC m=+3.105446597" lastFinishedPulling="2026-05-29 02:27:56.893609961 +0000 UTC m=+20.583565628" observedRunningTime="2026-05-29 02:27:58.103423849 +0000 UTC m=+21.793379525" watchObservedRunningTime="2026-05-29 02:27:58.104265859 +0000 UTC m=+21.794221536"
May 29 02:27:58.137609 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.137565    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5z9h6" podStartSLOduration=4.614675874 podStartE2EDuration="22.13755269s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.408827653 +0000 UTC m=+3.098783324" lastFinishedPulling="2026-05-29 02:27:56.931704482 +0000 UTC m=+20.621660140" observedRunningTime="2026-05-29 02:27:58.136840364 +0000 UTC m=+21.826796039" watchObservedRunningTime="2026-05-29 02:27:58.13755269 +0000 UTC m=+21.827508365"
May 29 02:27:58.660545 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.660506    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 02:27:58.779516 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.779487    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:58.782676 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.782601    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T02:27:58.66052944Z","UUID":"25863260-b9bd-4d9c-9cca-436314c9ecdb","Handler":null,"Name":"","Endpoint":""}
May 29 02:27:58.784698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.784676    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 02:27:58.784698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.784702    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 02:27:58.835598 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:58.835557    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:27:58.835782 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:58.835682    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:27:59.013663 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.013583    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg" event={"ID":"e6927a93-4bf0-4f03-bc41-597c22f68ad9","Type":"ContainerStarted","Data":"a6f14e666d1da4aac7b82cf529f4c1e827358e72304b0b58ebc6c3b9d816cae5"}
May 29 02:27:59.015169 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.015131    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6rsc" event={"ID":"5bb5e6d9-dc87-4727-b041-2d1bbed4a5e3","Type":"ContainerStarted","Data":"37fd0617729699597a052e1b86118be719852baf75b34c0bcb8a19fb512232f5"}
May 29 02:27:59.772086 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.772051    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:59.772751 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.772730    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:27:59.794931 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.794881    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n6rsc" podStartSLOduration=6.311382963 podStartE2EDuration="23.794868556s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.410141843 +0000 UTC m=+3.100097514" lastFinishedPulling="2026-05-29 02:27:56.893627447 +0000 UTC m=+20.583583107" observedRunningTime="2026-05-29 02:27:59.032279937 +0000 UTC m=+22.722235614" watchObservedRunningTime="2026-05-29 02:27:59.794868556 +0000 UTC m=+23.484824237"
May 29 02:27:59.836580 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.836119    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:27:59.836580 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:59.836258    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:27:59.836580 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:27:59.836331    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:27:59.836580 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:27:59.836430    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:00.019448 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.019411    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg" event={"ID":"e6927a93-4bf0-4f03-bc41-597c22f68ad9","Type":"ContainerStarted","Data":"37d741dd7b0905bb68d9c0ef3c7d2953bef7efd1a7737b62b43a77b626a290ea"}
May 29 02:28:00.022852 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.022798    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:28:00.023544 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.023185    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"65870ce77e203e9ef510c25bd67ae07aae375c0ad83b7211afb8515493dadef6"}
May 29 02:28:00.023960 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.023941    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4m2ft"
May 29 02:28:00.039260 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.039215    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtnkg" podStartSLOduration=3.6653478980000003 podStartE2EDuration="24.039184655s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.406295162 +0000 UTC m=+3.096250818" lastFinishedPulling="2026-05-29 02:27:59.780131915 +0000 UTC m=+23.470087575" observedRunningTime="2026-05-29 02:28:00.038778248 +0000 UTC m=+23.728733922" watchObservedRunningTime="2026-05-29 02:28:00.039184655 +0000 UTC m=+23.729140330"
May 29 02:28:00.835635 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:00.835429    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:00.835826 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:00.835743    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:01.835242 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:01.835208    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:01.835694 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:01.835225    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:01.835694 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:01.835322    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:01.835694 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:01.835371    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:02.839960 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:02.839594    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:02.841152 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:02.840137    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:03.036740 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.036691    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:28:03.037349 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.037305    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"d0d14d7de49661942ecd938f6d72c1947d93d8c44e63a58c3d9242b3ae8e2db2"}
May 29 02:28:03.037762 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.037732    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:03.038107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.038079    2547 scope.go:117] "RemoveContainer" containerID="ac42df27e8f323997b85b111eae0c87b38691e01cd91488e8dfc6cb059f18b2d"
May 29 02:28:03.040256 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.040217    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="64058ff0d64d3145f0b72e6cab78e033a43697e7317bbde0ede0d1e359e7d4c5" exitCode=0
May 29 02:28:03.040383 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.040261    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"64058ff0d64d3145f0b72e6cab78e033a43697e7317bbde0ede0d1e359e7d4c5"}
May 29 02:28:03.066061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.066016    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:03.835953 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.835910    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:03.836084 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.835910    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:03.836084 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:03.836042    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:03.836227 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:03.836113    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:03.976470 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.976392    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfdhs"]
May 29 02:28:03.980434 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.980411    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2txjc"]
May 29 02:28:03.995836 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.995803    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lqs2h"]
May 29 02:28:03.995996 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:03.995929    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:03.996046 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:03.996022    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:04.045554 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.045533    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:28:04.045911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.045880    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" event={"ID":"c9adf29d-9694-4db4-9483-e4ea17603a11","Type":"ContainerStarted","Data":"a3bf8ec268d6bdc59b50f904cca0ddfbe5effdec928efa78bccb8136853cdd09"}
May 29 02:28:04.046030 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.046002    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 29 02:28:04.046346 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.046325    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:04.047853 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.047826    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="d68fa4288b0ef874bcd975bc2dbf50566ef2708fb607b10e96d41c6f27758d3c" exitCode=0
May 29 02:28:04.047948 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.047893    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:04.047948 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.047910    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"d68fa4288b0ef874bcd975bc2dbf50566ef2708fb607b10e96d41c6f27758d3c"}
May 29 02:28:04.048031 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:04.047989    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:04.048081 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.048034    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:04.048131 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:04.048112    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:04.062259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.062240    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:04.079927 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.079886    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5" podStartSLOduration=9.224838442 podStartE2EDuration="27.079875447s" podCreationTimestamp="2026-05-29 02:27:37 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.418005462 +0000 UTC m=+3.107961117" lastFinishedPulling="2026-05-29 02:27:57.273042469 +0000 UTC m=+20.962998122" observedRunningTime="2026-05-29 02:28:04.078512811 +0000 UTC m=+27.768468509" watchObservedRunningTime="2026-05-29 02:28:04.079875447 +0000 UTC m=+27.769831121"
May 29 02:28:04.806260 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:04.806157    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:05.051518 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:05.051486    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="d1b763c59a409c386f9ec04c7958e3a1f9fa82d94a004330b632ae43491f2fef" exitCode=0
May 29 02:28:05.051911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:05.051577    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"d1b763c59a409c386f9ec04c7958e3a1f9fa82d94a004330b632ae43491f2fef"}
May 29 02:28:05.835635 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:05.835605    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:05.835800 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:05.835605    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:05.835800 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:05.835707    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:05.835981 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:05.835796    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:05.835981 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:05.835608    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:05.835981 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:05.835901    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:07.835710 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:07.835673    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:07.836169 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:07.835788    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:07.836169 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:07.835807    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:07.836169 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:07.835791    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:07.836169 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:07.835895    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:07.836169 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:07.835977    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:09.835926 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:09.835879    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:09.836477 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:09.835879    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:09.836477 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:09.836011    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfdhs" podUID="76485604-838e-4401-a2a7-e5b1a26ad152"
May 29 02:28:09.836477 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:09.835879    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:09.836477 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:09.836099    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:28:09.836477 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:09.836213    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2txjc" podUID="3fe583dc-9b21-442f-8901-5ff8c860106b"
May 29 02:28:10.587780 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.587753    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:10.587879 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.587868    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:28:10.587924 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.587916    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:42.587901968 +0000 UTC m=+66.277857621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:28:10.682725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.682702    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-78.ec2.internal" event="NodeReady"
May 29 02:28:10.682834 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.682798    2547 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 02:28:10.688642 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.688625    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:10.688755 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.688743    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:28:10.688800 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.688757    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:28:10.688800 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.688767    2547 projected.go:194] Error preparing data for projected volume kube-api-access-rxs7x for pod openshift-network-diagnostics/network-check-target-2txjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:28:10.688864 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.688806    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x podName:3fe583dc-9b21-442f-8901-5ff8c860106b nodeName:}" failed. No retries permitted until 2026-05-29 02:28:42.68879332 +0000 UTC m=+66.378748987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rxs7x" (UniqueName: "kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x") pod "network-check-target-2txjc" (UID: "3fe583dc-9b21-442f-8901-5ff8c860106b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:28:10.733120 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.733069    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8scw8"]
May 29 02:28:10.748476 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.748451    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g2dsh"]
May 29 02:28:10.748625 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.748610    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:10.750791 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.750771    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrg6b\""
May 29 02:28:10.751111 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.751091    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 02:28:10.751254 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.751093    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 02:28:10.751470 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.751447    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 02:28:10.768586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.768566    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8scw8"]
May 29 02:28:10.768684 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.768592    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g2dsh"]
May 29 02:28:10.768730 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.768704    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.771335 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.771304    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 02:28:10.771457 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.771346    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zl2l4\""
May 29 02:28:10.771532 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.771518    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 02:28:10.890008 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.889982    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:10.890438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.890032    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d152cc93-674d-4780-8fdb-5b53d2182d79-config-volume\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.890438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.890077    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7cmc\" (UniqueName: \"kubernetes.io/projected/1c07db6d-7907-4d7d-8a61-859509226a07-kube-api-access-t7cmc\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:10.890438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.890101    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd8r\" (UniqueName: \"kubernetes.io/projected/d152cc93-674d-4780-8fdb-5b53d2182d79-kube-api-access-7xd8r\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.890438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.890128    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d152cc93-674d-4780-8fdb-5b53d2182d79-tmp-dir\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.890438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.890162    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.991369 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991312    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:10.991461 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.991443    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:10.991505 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991464    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d152cc93-674d-4780-8fdb-5b53d2182d79-config-volume\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.991505 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.991496    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:11.491481212 +0000 UTC m=+35.181436864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:10.991610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991590    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7cmc\" (UniqueName: \"kubernetes.io/projected/1c07db6d-7907-4d7d-8a61-859509226a07-kube-api-access-t7cmc\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:10.991660 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991627    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd8r\" (UniqueName: \"kubernetes.io/projected/d152cc93-674d-4780-8fdb-5b53d2182d79-kube-api-access-7xd8r\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.991710 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991663    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d152cc93-674d-4780-8fdb-5b53d2182d79-tmp-dir\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.991758 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991705    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.991822 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.991807    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:10.991875 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:10.991865    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:11.49184847 +0000 UTC m=+35.181804141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:10.991950 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.991936    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d152cc93-674d-4780-8fdb-5b53d2182d79-tmp-dir\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:10.992084 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:10.992064    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d152cc93-674d-4780-8fdb-5b53d2182d79-config-volume\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:11.002963 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.002935    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd8r\" (UniqueName: \"kubernetes.io/projected/d152cc93-674d-4780-8fdb-5b53d2182d79-kube-api-access-7xd8r\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:11.003061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.003016    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7cmc\" (UniqueName: \"kubernetes.io/projected/1c07db6d-7907-4d7d-8a61-859509226a07-kube-api-access-t7cmc\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:11.066011 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.065976    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerStarted","Data":"a071094110189b37a94c533e110ace795a6b9655f96353dcaed7975367df9393"}
May 29 02:28:11.495564 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.495537    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:11.495726 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.495590    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:11.495726 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.495682    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:11.495797 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.495736    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:12.495723673 +0000 UTC m=+36.185679332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:11.495797 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.495682    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:11.495797 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.495774    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:12.495763497 +0000 UTC m=+36.185719152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:11.797773 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.797698    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:11.797905 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.797794    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:28:11.797905 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:11.797865    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret podName:76485604-838e-4401-a2a7-e5b1a26ad152 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:43.797852143 +0000 UTC m=+67.487807809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret") pod "global-pull-secret-syncer-zfdhs" (UID: "76485604-838e-4401-a2a7-e5b1a26ad152") : object "kube-system"/"original-pull-secret" not registered
May 29 02:28:11.835964 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.835938    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:11.835964 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.835947    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:11.836132 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.835947    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:11.838807 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.838786    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 02:28:11.838917 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.838882    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 02:28:11.838917 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.838887    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 02:28:11.839937 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.839918    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2rwn\""
May 29 02:28:11.840050 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.839920    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 02:28:11.840050 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:11.840016    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrq9j\""
May 29 02:28:12.069975 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:12.069918    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="a071094110189b37a94c533e110ace795a6b9655f96353dcaed7975367df9393" exitCode=0
May 29 02:28:12.069975 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:12.069950    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"a071094110189b37a94c533e110ace795a6b9655f96353dcaed7975367df9393"}
May 29 02:28:12.502535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:12.502503    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:12.502682 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:12.502561    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:12.502682 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:12.502641    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:12.502682 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:12.502660    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:12.502807 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:12.502702    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:14.50268618 +0000 UTC m=+38.192641833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:12.502807 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:12.502716    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:14.50270954 +0000 UTC m=+38.192665193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:13.073546 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:13.073513    2547 generic.go:358] "Generic (PLEG): container finished" podID="e24ec829-6940-4925-bf2e-e68d7bb063b8" containerID="a6f8f7fe5ceca2711dabd0fbabdbd5de1a0e3bab4c7d4dfdf170018ed822d952" exitCode=0
May 29 02:28:13.073546 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:13.073547    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerDied","Data":"a6f8f7fe5ceca2711dabd0fbabdbd5de1a0e3bab4c7d4dfdf170018ed822d952"}
May 29 02:28:14.078172 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.078008    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nct75" event={"ID":"e24ec829-6940-4925-bf2e-e68d7bb063b8","Type":"ContainerStarted","Data":"1ab6d66cec59d275c36e00f29cda5b19eda734cb4225a9202b1a6ad2aa92429e"}
May 29 02:28:14.107008 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.106965    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nct75" podStartSLOduration=6.679418454 podStartE2EDuration="38.10695243s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:27:39.414008573 +0000 UTC m=+3.103964231" lastFinishedPulling="2026-05-29 02:28:10.84154254 +0000 UTC m=+34.531498207" observedRunningTime="2026-05-29 02:28:14.106030094 +0000 UTC m=+37.795985803" watchObservedRunningTime="2026-05-29 02:28:14.10695243 +0000 UTC m=+37.796908106"
May 29 02:28:14.516725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.516691    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:14.516925 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.516749    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:14.516925 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:14.516847    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:14.516925 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:14.516869    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:14.516925 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:14.516915    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:18.516898379 +0000 UTC m=+42.206854032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:14.517064 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:14.516929    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:18.516922922 +0000 UTC m=+42.206878575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:14.907006 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.906971    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"]
May 29 02:28:14.924878 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.924805    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"]
May 29 02:28:14.925174 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.925015    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:14.928101 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.928040    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 29 02:28:14.928420 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.928104    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 29 02:28:14.928420 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.928127    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 29 02:28:14.929082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:14.929051    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 29 02:28:15.021223 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.021115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c463f486-62a1-41ad-865d-f1604eef8e37-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.021540 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.021359    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scfn4\" (UniqueName: \"kubernetes.io/projected/c463f486-62a1-41ad-865d-f1604eef8e37-kube-api-access-scfn4\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.021540 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.021417    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c463f486-62a1-41ad-865d-f1604eef8e37-tmp\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.122706 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.122644    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scfn4\" (UniqueName: \"kubernetes.io/projected/c463f486-62a1-41ad-865d-f1604eef8e37-kube-api-access-scfn4\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.123410 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.122796    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c463f486-62a1-41ad-865d-f1604eef8e37-tmp\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.123410 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.122980    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c463f486-62a1-41ad-865d-f1604eef8e37-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.123494 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.123458    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c463f486-62a1-41ad-865d-f1604eef8e37-tmp\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.128361 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.128294    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c463f486-62a1-41ad-865d-f1604eef8e37-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.133400 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.133355    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scfn4\" (UniqueName: \"kubernetes.io/projected/c463f486-62a1-41ad-865d-f1604eef8e37-kube-api-access-scfn4\") pod \"klusterlet-addon-workmgr-79cdcdf586-k4nj2\" (UID: \"c463f486-62a1-41ad-865d-f1604eef8e37\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.240416 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.240293    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:15.432295 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:15.432245    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"]
May 29 02:28:15.435964 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:28:15.435937    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc463f486_62a1_41ad_865d_f1604eef8e37.slice/crio-7da1960e5be9b510d84bf1d8c12a3f7ec9fc8ee3395f5f69139d1b9f99d6e4f6 WatchSource:0}: Error finding container 7da1960e5be9b510d84bf1d8c12a3f7ec9fc8ee3395f5f69139d1b9f99d6e4f6: Status 404 returned error can't find the container with id 7da1960e5be9b510d84bf1d8c12a3f7ec9fc8ee3395f5f69139d1b9f99d6e4f6
May 29 02:28:16.084427 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:16.084385    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" event={"ID":"c463f486-62a1-41ad-865d-f1604eef8e37","Type":"ContainerStarted","Data":"7da1960e5be9b510d84bf1d8c12a3f7ec9fc8ee3395f5f69139d1b9f99d6e4f6"}
May 29 02:28:18.551928 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:18.551894    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:18.552421 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:18.551960    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:18.552421 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:18.552064    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:18.552421 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:18.552081    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:18.552421 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:18.552148    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:26.552126149 +0000 UTC m=+50.242081808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:18.552421 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:18.552166    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:26.552160175 +0000 UTC m=+50.242115828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:19.091760 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:19.091732    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" event={"ID":"c463f486-62a1-41ad-865d-f1604eef8e37","Type":"ContainerStarted","Data":"52f5eeb658ad4aa1db284238e57bd3f726d40a6a8f795f0a72838551eb0ee243"}
May 29 02:28:19.092037 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:19.092018    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:19.093256 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:19.093218    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:28:19.134936 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:19.134868    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" podStartSLOduration=1.693572483 podStartE2EDuration="5.134855459s" podCreationTimestamp="2026-05-29 02:28:14 +0000 UTC" firstStartedPulling="2026-05-29 02:28:15.438130794 +0000 UTC m=+39.128086447" lastFinishedPulling="2026-05-29 02:28:18.879413766 +0000 UTC m=+42.569369423" observedRunningTime="2026-05-29 02:28:19.114296054 +0000 UTC m=+42.804251729" watchObservedRunningTime="2026-05-29 02:28:19.134855459 +0000 UTC m=+42.824811133"
May 29 02:28:26.609828 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:26.609788    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:26.610343 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:26.609925    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:26.610343 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:26.609935    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:26.610343 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:26.609999    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:42.609984149 +0000 UTC m=+66.299939808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:26.610343 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:26.610004    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:26.610343 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:26.610042    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:42.610031158 +0000 UTC m=+66.299986828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:36.064705 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:36.064674    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-97cs5"
May 29 02:28:42.617798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.617766    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:28:42.617798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.617808    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:28:42.618325 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.617862    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:28:42.618325 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.617904    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:42.618325 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.617976    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:14.617962089 +0000 UTC m=+98.307917742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:28:42.618325 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.617973    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:42.618325 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.618002    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:14.617996168 +0000 UTC m=+98.307951822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:28:42.620375 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.620356    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 02:28:42.628304 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.628286    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 02:28:42.628395 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:28:42.628341    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:46.628328445 +0000 UTC m=+130.318284098 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : secret "metrics-daemon-secret" not found
May 29 02:28:42.718881 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.718858    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:42.721733 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.721712    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 02:28:42.732076 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.732060    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 02:28:42.742316 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.742297    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxs7x\" (UniqueName: \"kubernetes.io/projected/3fe583dc-9b21-442f-8901-5ff8c860106b-kube-api-access-rxs7x\") pod \"network-check-target-2txjc\" (UID: \"3fe583dc-9b21-442f-8901-5ff8c860106b\") " pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:42.748528 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.748510    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrq9j\""
May 29 02:28:42.756765 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.756752    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:42.874618 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:42.874555    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2txjc"]
May 29 02:28:42.878117 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:28:42.878092    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe583dc_9b21_442f_8901_5ff8c860106b.slice/crio-35fe40728f504ca8ff4a873d5875d3536bfbd7da849fb41203aefd5bb06ed97a WatchSource:0}: Error finding container 35fe40728f504ca8ff4a873d5875d3536bfbd7da849fb41203aefd5bb06ed97a: Status 404 returned error can't find the container with id 35fe40728f504ca8ff4a873d5875d3536bfbd7da849fb41203aefd5bb06ed97a
May 29 02:28:43.134801 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:43.134735    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2txjc" event={"ID":"3fe583dc-9b21-442f-8901-5ff8c860106b","Type":"ContainerStarted","Data":"35fe40728f504ca8ff4a873d5875d3536bfbd7da849fb41203aefd5bb06ed97a"}
May 29 02:28:43.826361 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:43.826320    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:43.829331 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:43.829311    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 02:28:43.838892 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:43.838865    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76485604-838e-4401-a2a7-e5b1a26ad152-original-pull-secret\") pod \"global-pull-secret-syncer-zfdhs\" (UID: \"76485604-838e-4401-a2a7-e5b1a26ad152\") " pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:43.950171 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:43.950141    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfdhs"
May 29 02:28:44.083458 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:44.083388    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfdhs"]
May 29 02:28:44.086847 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:28:44.086818    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76485604_838e_4401_a2a7_e5b1a26ad152.slice/crio-e8778ebad7ce6f10e90c39d83037fbe4087d5b3321a2e38f3b7d3fe26ba0abab WatchSource:0}: Error finding container e8778ebad7ce6f10e90c39d83037fbe4087d5b3321a2e38f3b7d3fe26ba0abab: Status 404 returned error can't find the container with id e8778ebad7ce6f10e90c39d83037fbe4087d5b3321a2e38f3b7d3fe26ba0abab
May 29 02:28:44.137479 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:44.137447    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfdhs" event={"ID":"76485604-838e-4401-a2a7-e5b1a26ad152","Type":"ContainerStarted","Data":"e8778ebad7ce6f10e90c39d83037fbe4087d5b3321a2e38f3b7d3fe26ba0abab"}
May 29 02:28:46.143423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:46.143391    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2txjc" event={"ID":"3fe583dc-9b21-442f-8901-5ff8c860106b","Type":"ContainerStarted","Data":"0a7f42e12e39929fa5e6b8ec55794b2af98493193aa7c4f5a7f0e6ce8640a3ba"}
May 29 02:28:46.143862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:46.143548    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:28:46.160472 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:46.160425    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2txjc" podStartSLOduration=67.412480549 podStartE2EDuration="1m10.160410772s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:28:42.879850579 +0000 UTC m=+66.569806233" lastFinishedPulling="2026-05-29 02:28:45.627780789 +0000 UTC m=+69.317736456" observedRunningTime="2026-05-29 02:28:46.160272784 +0000 UTC m=+69.850228461" watchObservedRunningTime="2026-05-29 02:28:46.160410772 +0000 UTC m=+69.850366446"
May 29 02:28:49.150786 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:49.150749    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfdhs" event={"ID":"76485604-838e-4401-a2a7-e5b1a26ad152","Type":"ContainerStarted","Data":"38062056cd4940d93718c35906f0345e38561ba5b479293db505c5d65ba75bf0"}
May 29 02:28:49.167188 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:28:49.167135    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zfdhs" podStartSLOduration=66.146284521 podStartE2EDuration="1m10.167120141s" podCreationTimestamp="2026-05-29 02:27:39 +0000 UTC" firstStartedPulling="2026-05-29 02:28:44.088602613 +0000 UTC m=+67.778558282" lastFinishedPulling="2026-05-29 02:28:48.109438246 +0000 UTC m=+71.799393902" observedRunningTime="2026-05-29 02:28:49.167033852 +0000 UTC m=+72.856989538" watchObservedRunningTime="2026-05-29 02:28:49.167120141 +0000 UTC m=+72.857075815"
May 29 02:29:14.639137 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:14.639099    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:29:14.639137 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:14.639152    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:29:14.639541 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:14.639265    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:29:14.639541 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:14.639271    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:29:14.639541 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:14.639317    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert podName:1c07db6d-7907-4d7d-8a61-859509226a07 nodeName:}" failed. No retries permitted until 2026-05-29 02:30:18.639302395 +0000 UTC m=+162.329258068 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert") pod "ingress-canary-8scw8" (UID: "1c07db6d-7907-4d7d-8a61-859509226a07") : secret "canary-serving-cert" not found
May 29 02:29:14.639541 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:14.639329    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls podName:d152cc93-674d-4780-8fdb-5b53d2182d79 nodeName:}" failed. No retries permitted until 2026-05-29 02:30:18.639323316 +0000 UTC m=+162.329278969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls") pod "dns-default-g2dsh" (UID: "d152cc93-674d-4780-8fdb-5b53d2182d79") : secret "dns-default-metrics-tls" not found
May 29 02:29:17.147791 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:17.147755    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2txjc"
May 29 02:29:43.276330 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.276296    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"]
May 29 02:29:43.278239 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.278221    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"
May 29 02:29:43.280444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.280408    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"]
May 29 02:29:43.280875 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.280846    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pgb7n\""
May 29 02:29:43.281174 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.281151    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 29 02:29:43.281174 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.281153    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 29 02:29:43.282336 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.282317    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"]
May 29 02:29:43.282480 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.282462    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.284163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.284146    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:29:43.284357 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.284340    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.286081 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.286062    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 29 02:29:43.286173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.286087    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 29 02:29:43.286173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.286107    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.286681 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.286661    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9lq9x\""
May 29 02:29:43.286896 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.286878    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 29 02:29:43.287147 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.287127    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 29 02:29:43.287264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.287159    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zgnvm\""
May 29 02:29:43.287264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.287164    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 29 02:29:43.287264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.287245    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 29 02:29:43.287264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.287240    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 29 02:29:43.288271 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.288258    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 29 02:29:43.288315 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.288270    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 29 02:29:43.288967 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.288935    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 29 02:29:43.289183 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.289171    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhxm6\""
May 29 02:29:43.295613 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.295446    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 29 02:29:43.295817 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.295782    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"]
May 29 02:29:43.296564 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.296547    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"]
May 29 02:29:43.298932 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.298914    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"]
May 29 02:29:43.314875 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.314852    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:29:43.388488 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.388457    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"]
May 29 02:29:43.390404 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.390389    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.392736 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.392713    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dmx4k\""
May 29 02:29:43.392857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.392713    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 29 02:29:43.392857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.392718    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 29 02:29:43.392965 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.392922    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 29 02:29:43.392965 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.392953    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 29 02:29:43.398958 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.398939    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"]
May 29 02:29:43.437664 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437640    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.437752 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437671    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.437752 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.437752 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437716    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.437752 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437734    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.437880 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437753    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8163df72-915b-4049-bd3d-c5ed3ca9c73f-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.437880 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbp55\" (UniqueName: \"kubernetes.io/projected/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-kube-api-access-vbp55\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.437880 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437839    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.437880 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.438007 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437879    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8163df72-915b-4049-bd3d-c5ed3ca9c73f-config\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.438007 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437905    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncxp8\" (UniqueName: \"kubernetes.io/projected/8163df72-915b-4049-bd3d-c5ed3ca9c73f-kube-api-access-ncxp8\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.438007 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437921    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56gsl\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.438007 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437967    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmxmb\" (UniqueName: \"kubernetes.io/projected/d5dd1d23-c4c6-4383-9b4b-a083417c508d-kube-api-access-tmxmb\") pod \"volume-data-source-validator-5cf8c89d64-bjftl\" (UID: \"d5dd1d23-c4c6-4383-9b4b-a083417c508d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"
May 29 02:29:43.438007 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.437999    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539128    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbp55\" (UniqueName: \"kubernetes.io/projected/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-kube-api-access-vbp55\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.539173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f12848-2295-4f43-8a22-ec853edd92e2-config\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539175    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539191    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539237    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8163df72-915b-4049-bd3d-c5ed3ca9c73f-config\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zvr\" (UniqueName: \"kubernetes.io/projected/f8f12848-2295-4f43-8a22-ec853edd92e2-kube-api-access-q6zvr\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:43.539277    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539290    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncxp8\" (UniqueName: \"kubernetes.io/projected/8163df72-915b-4049-bd3d-c5ed3ca9c73f-kube-api-access-ncxp8\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.539347 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:43.539297    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfb9d58f-fbfzp: secret "image-registry-tls" not found
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:43.539376    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls podName:1282036b-90ae-478b-a42e-45dc9b262d97 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:44.039355527 +0000 UTC m=+127.729311202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls") pod "image-registry-6bcfb9d58f-fbfzp" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97") : secret "image-registry-tls" not found
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539314    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56gsl\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539416    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmxmb\" (UniqueName: \"kubernetes.io/projected/d5dd1d23-c4c6-4383-9b4b-a083417c508d-kube-api-access-tmxmb\") pod \"volume-data-source-validator-5cf8c89d64-bjftl\" (UID: \"d5dd1d23-c4c6-4383-9b4b-a083417c508d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539448    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539523    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539551    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539577    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539596    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539615    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.539657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539652    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8f12848-2295-4f43-8a22-ec853edd92e2-serving-cert\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.540052 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:43.539678    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 02:29:43.540052 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:43.539748    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls podName:a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e nodeName:}" failed. No retries permitted until 2026-05-29 02:29:44.039730689 +0000 UTC m=+127.729686357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls") pod "cluster-samples-operator-697587599-dfztq" (UID: "a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e") : secret "samples-operator-tls" not found
May 29 02:29:43.540052 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539801    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8163df72-915b-4049-bd3d-c5ed3ca9c73f-config\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.540052 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.539681    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8163df72-915b-4049-bd3d-c5ed3ca9c73f-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.540221 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.540115    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.540586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.540567    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.541273 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.541249    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.541966 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.541942    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.542043 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.541949    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8163df72-915b-4049-bd3d-c5ed3ca9c73f-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.542212 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.542176    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.548818 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.548793    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbp55\" (UniqueName: \"kubernetes.io/projected/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-kube-api-access-vbp55\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:43.549011 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.548841    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncxp8\" (UniqueName: \"kubernetes.io/projected/8163df72-915b-4049-bd3d-c5ed3ca9c73f-kube-api-access-ncxp8\") pod \"kube-storage-version-migrator-operator-565644f49-c5c9s\" (UID: \"8163df72-915b-4049-bd3d-c5ed3ca9c73f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.549227 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.549184    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmxmb\" (UniqueName: \"kubernetes.io/projected/d5dd1d23-c4c6-4383-9b4b-a083417c508d-kube-api-access-tmxmb\") pod \"volume-data-source-validator-5cf8c89d64-bjftl\" (UID: \"d5dd1d23-c4c6-4383-9b4b-a083417c508d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"
May 29 02:29:43.549479 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.549460    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gsl\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.549674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.549659    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:43.589620 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.589600    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"
May 29 02:29:43.597234 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.597213    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"
May 29 02:29:43.640928 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.640832    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8f12848-2295-4f43-8a22-ec853edd92e2-serving-cert\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.641071 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.641018    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f12848-2295-4f43-8a22-ec853edd92e2-config\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.641134 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.641086    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zvr\" (UniqueName: \"kubernetes.io/projected/f8f12848-2295-4f43-8a22-ec853edd92e2-kube-api-access-q6zvr\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.642665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.642639    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f12848-2295-4f43-8a22-ec853edd92e2-config\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.644410 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.644188    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8f12848-2295-4f43-8a22-ec853edd92e2-serving-cert\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.654284 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.653174    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zvr\" (UniqueName: \"kubernetes.io/projected/f8f12848-2295-4f43-8a22-ec853edd92e2-kube-api-access-q6zvr\") pod \"service-ca-operator-57b5b68b8-j7gd6\" (UID: \"f8f12848-2295-4f43-8a22-ec853edd92e2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.699676 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.699651    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"
May 29 02:29:43.719771 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.719738    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl"]
May 29 02:29:43.725944 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:29:43.725902    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dd1d23_c4c6_4383_9b4b_a083417c508d.slice/crio-418f689f39986ddd7954c6d38327b3d2196fd22d3a14f708a85085b363577f69 WatchSource:0}: Error finding container 418f689f39986ddd7954c6d38327b3d2196fd22d3a14f708a85085b363577f69: Status 404 returned error can't find the container with id 418f689f39986ddd7954c6d38327b3d2196fd22d3a14f708a85085b363577f69
May 29 02:29:43.737881 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.737785    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s"]
May 29 02:29:43.740872 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:29:43.740848    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8163df72_915b_4049_bd3d_c5ed3ca9c73f.slice/crio-4bfcf80bbad46df1de716e2d8b26d1b7c6f9834ad926460d089304bb709a67d2 WatchSource:0}: Error finding container 4bfcf80bbad46df1de716e2d8b26d1b7c6f9834ad926460d089304bb709a67d2: Status 404 returned error can't find the container with id 4bfcf80bbad46df1de716e2d8b26d1b7c6f9834ad926460d089304bb709a67d2
May 29 02:29:43.823320 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:43.823260    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6"]
May 29 02:29:43.826143 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:29:43.826122    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f12848_2295_4f43_8a22_ec853edd92e2.slice/crio-11d42bd747bc4dfb545f8f3a2ef9e3e9add182926c5913c5ac28d10fa04e8535 WatchSource:0}: Error finding container 11d42bd747bc4dfb545f8f3a2ef9e3e9add182926c5913c5ac28d10fa04e8535: Status 404 returned error can't find the container with id 11d42bd747bc4dfb545f8f3a2ef9e3e9add182926c5913c5ac28d10fa04e8535
May 29 02:29:44.044817 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:44.044795    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:44.044916 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:44.044839    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:44.044956 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:44.044938    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 02:29:44.045003 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:44.044994    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls podName:a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e nodeName:}" failed. No retries permitted until 2026-05-29 02:29:45.044976072 +0000 UTC m=+128.734931725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls") pod "cluster-samples-operator-697587599-dfztq" (UID: "a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e") : secret "samples-operator-tls" not found
May 29 02:29:44.045003 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:44.044991    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:44.045077 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:44.045011    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfb9d58f-fbfzp: secret "image-registry-tls" not found
May 29 02:29:44.045077 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:44.045035    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls podName:1282036b-90ae-478b-a42e-45dc9b262d97 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:45.045028332 +0000 UTC m=+128.734983985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls") pod "image-registry-6bcfb9d58f-fbfzp" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97") : secret "image-registry-tls" not found
May 29 02:29:44.250209 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:44.250149    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6" event={"ID":"f8f12848-2295-4f43-8a22-ec853edd92e2","Type":"ContainerStarted","Data":"11d42bd747bc4dfb545f8f3a2ef9e3e9add182926c5913c5ac28d10fa04e8535"}
May 29 02:29:44.251930 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:44.251891    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s" event={"ID":"8163df72-915b-4049-bd3d-c5ed3ca9c73f","Type":"ContainerStarted","Data":"4bfcf80bbad46df1de716e2d8b26d1b7c6f9834ad926460d089304bb709a67d2"}
May 29 02:29:44.253063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:44.253025    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl" event={"ID":"d5dd1d23-c4c6-4383-9b4b-a083417c508d","Type":"ContainerStarted","Data":"418f689f39986ddd7954c6d38327b3d2196fd22d3a14f708a85085b363577f69"}
May 29 02:29:45.053767 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:45.053732    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:45.053817    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:45.053906    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:45.053923    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:45.053930    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfb9d58f-fbfzp: secret "image-registry-tls" not found
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:45.053983    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls podName:a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e nodeName:}" failed. No retries permitted until 2026-05-29 02:29:47.053968476 +0000 UTC m=+130.743924129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls") pod "cluster-samples-operator-697587599-dfztq" (UID: "a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e") : secret "samples-operator-tls" not found
May 29 02:29:45.054209 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:45.054001    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls podName:1282036b-90ae-478b-a42e-45dc9b262d97 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:47.053992838 +0000 UTC m=+130.743948490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls") pod "image-registry-6bcfb9d58f-fbfzp" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97") : secret "image-registry-tls" not found
May 29 02:29:46.263823 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.263749    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6" event={"ID":"f8f12848-2295-4f43-8a22-ec853edd92e2","Type":"ContainerStarted","Data":"827a2dd77264c3be298d48e891d186f228581a8848eb86b4253d794cba2a9c79"}
May 29 02:29:46.266671 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.266578    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s" event={"ID":"8163df72-915b-4049-bd3d-c5ed3ca9c73f","Type":"ContainerStarted","Data":"96bd9f03d27d5c9aa1b7a6143b7e07036ebd564708e34a40dbaa1a9444a81697"}
May 29 02:29:46.268915 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.268862    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl" event={"ID":"d5dd1d23-c4c6-4383-9b4b-a083417c508d","Type":"ContainerStarted","Data":"47531544edbb27f109ea0ab9c50b1dc8114c84c248f79f30d56277bc694b8ca5"}
May 29 02:29:46.285446 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.285290    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6" podStartSLOduration=0.995121672 podStartE2EDuration="3.285244997s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:43.827986025 +0000 UTC m=+127.517941678" lastFinishedPulling="2026-05-29 02:29:46.118109349 +0000 UTC m=+129.808065003" observedRunningTime="2026-05-29 02:29:46.283460262 +0000 UTC m=+129.973415938" watchObservedRunningTime="2026-05-29 02:29:46.285244997 +0000 UTC m=+129.975200676"
May 29 02:29:46.322752 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.322628    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bjftl" podStartSLOduration=0.940905954 podStartE2EDuration="3.322596362s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:43.727647863 +0000 UTC m=+127.417603522" lastFinishedPulling="2026-05-29 02:29:46.109338275 +0000 UTC m=+129.799293930" observedRunningTime="2026-05-29 02:29:46.302785514 +0000 UTC m=+129.992741189" watchObservedRunningTime="2026-05-29 02:29:46.322596362 +0000 UTC m=+130.012552039"
May 29 02:29:46.669104 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:46.669041    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:29:46.669375 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:46.669278    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 02:29:46.669423 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:46.669386    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs podName:502a08f0-241a-424b-80f6-bd4840fc3be4 nodeName:}" failed. No retries permitted until 2026-05-29 02:31:48.669360226 +0000 UTC m=+252.359315883 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs") pod "network-metrics-daemon-lqs2h" (UID: "502a08f0-241a-424b-80f6-bd4840fc3be4") : secret "metrics-daemon-secret" not found
May 29 02:29:47.072621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.072547    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:47.072621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.072594    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:47.072831 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:47.072687    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 02:29:47.072831 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:47.072757    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls podName:a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e nodeName:}" failed. No retries permitted until 2026-05-29 02:29:51.072742439 +0000 UTC m=+134.762698091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls") pod "cluster-samples-operator-697587599-dfztq" (UID: "a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e") : secret "samples-operator-tls" not found
May 29 02:29:47.072831 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:47.072695    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:47.072831 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:47.072790    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfb9d58f-fbfzp: secret "image-registry-tls" not found
May 29 02:29:47.073033 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:47.072837    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls podName:1282036b-90ae-478b-a42e-45dc9b262d97 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:51.072825472 +0000 UTC m=+134.762781128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls") pod "image-registry-6bcfb9d58f-fbfzp" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97") : secret "image-registry-tls" not found
May 29 02:29:47.771131 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.771069    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s" podStartSLOduration=2.400147517 podStartE2EDuration="4.771054766s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:43.742608514 +0000 UTC m=+127.432564167" lastFinishedPulling="2026-05-29 02:29:46.113515762 +0000 UTC m=+129.803471416" observedRunningTime="2026-05-29 02:29:46.32141752 +0000 UTC m=+130.011373195" watchObservedRunningTime="2026-05-29 02:29:47.771054766 +0000 UTC m=+131.461010441"
May 29 02:29:47.771541 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.771191    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"]
May 29 02:29:47.774320 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.774304    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"
May 29 02:29:47.776699 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.776676    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5bd\" (UniqueName: \"kubernetes.io/projected/db9354d5-eea3-482f-bdbb-b9c7d2cac694-kube-api-access-zh5bd\") pod \"migrator-b985f5d89-h9c8h\" (UID: \"db9354d5-eea3-482f-bdbb-b9c7d2cac694\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"
May 29 02:29:47.776829 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.776817    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 29 02:29:47.776910 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.776893    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k5n6k\""
May 29 02:29:47.777818 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.777804    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 29 02:29:47.783288 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.783267    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"]
May 29 02:29:47.877677 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.877638    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5bd\" (UniqueName: \"kubernetes.io/projected/db9354d5-eea3-482f-bdbb-b9c7d2cac694-kube-api-access-zh5bd\") pod \"migrator-b985f5d89-h9c8h\" (UID: \"db9354d5-eea3-482f-bdbb-b9c7d2cac694\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"
May 29 02:29:47.885177 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:47.885155    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5bd\" (UniqueName: \"kubernetes.io/projected/db9354d5-eea3-482f-bdbb-b9c7d2cac694-kube-api-access-zh5bd\") pod \"migrator-b985f5d89-h9c8h\" (UID: \"db9354d5-eea3-482f-bdbb-b9c7d2cac694\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"
May 29 02:29:48.083797 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:48.083731    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"
May 29 02:29:48.213027 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:48.212993    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h"]
May 29 02:29:48.217003 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:29:48.216968    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9354d5_eea3_482f_bdbb_b9c7d2cac694.slice/crio-921141db4e6cb68dbf3d01425a3b89e1a0716820cac6e22f5aca4843bf9ee32c WatchSource:0}: Error finding container 921141db4e6cb68dbf3d01425a3b89e1a0716820cac6e22f5aca4843bf9ee32c: Status 404 returned error can't find the container with id 921141db4e6cb68dbf3d01425a3b89e1a0716820cac6e22f5aca4843bf9ee32c
May 29 02:29:48.274466 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:48.274437    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h" event={"ID":"db9354d5-eea3-482f-bdbb-b9c7d2cac694","Type":"ContainerStarted","Data":"921141db4e6cb68dbf3d01425a3b89e1a0716820cac6e22f5aca4843bf9ee32c"}
May 29 02:29:50.281447 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:50.281407    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h" event={"ID":"db9354d5-eea3-482f-bdbb-b9c7d2cac694","Type":"ContainerStarted","Data":"25ed861c12f7ef4b7891a23236582be4c19205a61b0e80ad1c5996033884e36f"}
May 29 02:29:50.281447 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:50.281448    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h" event={"ID":"db9354d5-eea3-482f-bdbb-b9c7d2cac694","Type":"ContainerStarted","Data":"ce5c4cfce3e49565d98bd278125a57be0231f6d9a7615786c1c066a2d6a28157"}
May 29 02:29:50.301286 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:50.301244    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-h9c8h" podStartSLOduration=2.1915593270000002 podStartE2EDuration="3.301232391s" podCreationTimestamp="2026-05-29 02:29:47 +0000 UTC" firstStartedPulling="2026-05-29 02:29:48.218710618 +0000 UTC m=+131.908666271" lastFinishedPulling="2026-05-29 02:29:49.328383683 +0000 UTC m=+133.018339335" observedRunningTime="2026-05-29 02:29:50.2999134 +0000 UTC m=+133.989869075" watchObservedRunningTime="2026-05-29 02:29:50.301232391 +0000 UTC m=+133.991188066"
May 29 02:29:50.918720 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:50.918693    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvf6f_fcb62fb6-4481-45c5-81e0-8b56ce82272a/dns-node-resolver/0.log"
May 29 02:29:51.104885 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:51.104856    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:51.105018 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:51.104909    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:51.105018 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:51.104998    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 02:29:51.105086 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:51.105013    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:51.105086 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:51.105033    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfb9d58f-fbfzp: secret "image-registry-tls" not found
May 29 02:29:51.105086 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:51.105047    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls podName:a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e nodeName:}" failed. No retries permitted until 2026-05-29 02:29:59.105034688 +0000 UTC m=+142.794990355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls") pod "cluster-samples-operator-697587599-dfztq" (UID: "a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e") : secret "samples-operator-tls" not found
May 29 02:29:51.105086 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:29:51.105080    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls podName:1282036b-90ae-478b-a42e-45dc9b262d97 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:59.105063576 +0000 UTC m=+142.795019245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls") pod "image-registry-6bcfb9d58f-fbfzp" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97") : secret "image-registry-tls" not found
May 29 02:29:51.517952 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:51.517925    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jqs96_daf3b546-2ad5-4170-8576-9ffeecbfa98d/node-ca/0.log"
May 29 02:29:52.917828 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:52.917796    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-h9c8h_db9354d5-eea3-482f-bdbb-b9c7d2cac694/migrator/0.log"
May 29 02:29:53.117382 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:53.117356    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-h9c8h_db9354d5-eea3-482f-bdbb-b9c7d2cac694/graceful-termination/0.log"
May 29 02:29:53.318382 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:53.318314    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c5c9s_8163df72-915b-4049-bd3d-c5ed3ca9c73f/kube-storage-version-migrator-operator/0.log"
May 29 02:29:59.164792 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.164735    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:59.165179 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.164821    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:59.167163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.167135    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dfztq\" (UID: \"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:59.167289 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.167167    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"image-registry-6bcfb9d58f-fbfzp\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") " pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:59.204264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.204226    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"
May 29 02:29:59.209020 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.208996    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:29:59.344956 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.344926    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:29:59.347876 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:29:59.347848    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1282036b_90ae_478b_a42e_45dc9b262d97.slice/crio-9aed648ca3cdc816b980df556b12ca20ee076e4ec42e65f3ba3470fac2a1b627 WatchSource:0}: Error finding container 9aed648ca3cdc816b980df556b12ca20ee076e4ec42e65f3ba3470fac2a1b627: Status 404 returned error can't find the container with id 9aed648ca3cdc816b980df556b12ca20ee076e4ec42e65f3ba3470fac2a1b627
May 29 02:29:59.356490 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:29:59.356468    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq"]
May 29 02:30:00.307855 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:00.307811    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" event={"ID":"1282036b-90ae-478b-a42e-45dc9b262d97","Type":"ContainerStarted","Data":"8705270ef26395acf9808e0495584bf176b9f10a9097c53b247b5cd83e056154"}
May 29 02:30:00.307855 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:00.307848    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" event={"ID":"1282036b-90ae-478b-a42e-45dc9b262d97","Type":"ContainerStarted","Data":"9aed648ca3cdc816b980df556b12ca20ee076e4ec42e65f3ba3470fac2a1b627"}
May 29 02:30:00.308364 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:00.307889    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:30:00.309277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:00.309254    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq" event={"ID":"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e","Type":"ContainerStarted","Data":"01d321740a990769cc8bd00a2c7ccf8449674b9b18a93e1ae4b7eb79c36cb042"}
May 29 02:30:00.329801 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:00.329759    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" podStartSLOduration=17.329747788 podStartE2EDuration="17.329747788s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:30:00.328809646 +0000 UTC m=+144.018765319" watchObservedRunningTime="2026-05-29 02:30:00.329747788 +0000 UTC m=+144.019703462"
May 29 02:30:01.313827 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:01.313786    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq" event={"ID":"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e","Type":"ContainerStarted","Data":"de05ab88e2fdf4a0dc92d370172ffbb7ec77b04f775eb13b0b50825125c60c6c"}
May 29 02:30:01.313827 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:01.313832    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq" event={"ID":"a382b8b5-0f3f-40a2-93ac-ee9b7a81c17e","Type":"ContainerStarted","Data":"7a6c13bb1258012a92e78c7ad99e808b091d98278b73c6b4180af06c37893169"}
May 29 02:30:01.332713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:01.332630    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dfztq" podStartSLOduration=16.651653731 podStartE2EDuration="18.332617297s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:59.396077353 +0000 UTC m=+143.086033006" lastFinishedPulling="2026-05-29 02:30:01.077040919 +0000 UTC m=+144.766996572" observedRunningTime="2026-05-29 02:30:01.332098928 +0000 UTC m=+145.022054599" watchObservedRunningTime="2026-05-29 02:30:01.332617297 +0000 UTC m=+145.022572972"
May 29 02:30:13.758327 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:30:13.758288    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8scw8" podUID="1c07db6d-7907-4d7d-8a61-859509226a07"
May 29 02:30:13.776585 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:30:13.776522    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g2dsh" podUID="d152cc93-674d-4780-8fdb-5b53d2182d79"
May 29 02:30:14.230518 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.230482    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:30:14.234683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.234644    2547 patch_prober.go:28] interesting pod/image-registry-6bcfb9d58f-fbfzp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 02:30:14.234803 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.234707    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 02:30:14.245414 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.245390    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qk6d5"]
May 29 02:30:14.250052 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.250033    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.252675 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.252656    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 02:30:14.253337 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.253317    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zxmms\""
May 29 02:30:14.253425 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.253322    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 02:30:14.253964 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.253943    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 02:30:14.254256 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.254237    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 02:30:14.273658 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.273638    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk6d5"]
May 29 02:30:14.347139 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.347118    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:14.347242 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.347118    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:30:14.359727 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.359700    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-558457cddc-qc6dk"]
May 29 02:30:14.362560 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.362543    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.376397 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.376380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-data-volume\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.376499 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.376406    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.376499 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.376431    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-crio-socket\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.376499 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.376491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfcm\" (UniqueName: \"kubernetes.io/projected/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-api-access-rsfcm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.376646 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.376577    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.380123 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.380101    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558457cddc-qc6dk"]
May 29 02:30:14.476929 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.476903    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-crio-socket\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477030 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.476943    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f64737d-09d3-4042-9584-ca5f17b46d18-ca-trust-extracted\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477030 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.476978    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfcm\" (UniqueName: \"kubernetes.io/projected/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-api-access-rsfcm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477030 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477021    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-crio-socket\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477182 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-installation-pull-secrets\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477182 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477105    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn55\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-kube-api-access-xcn55\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477182 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477125    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477182 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477144    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-bound-sa-token\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477182 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-image-registry-private-configuration\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477231    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-trusted-ca\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477322    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-tls\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477392    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-certificates\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.477500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477426    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-data-volume\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477488    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477766 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477722    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-data-volume\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.477946 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.477928    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.479464 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.479447    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.486948 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.486902    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfcm\" (UniqueName: \"kubernetes.io/projected/46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42-kube-api-access-rsfcm\") pod \"insights-runtime-extractor-qk6d5\" (UID: \"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42\") " pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.560053 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.560023    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk6d5"
May 29 02:30:14.577940 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.577918    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-installation-pull-secrets\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578054 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.577962    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn55\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-kube-api-access-xcn55\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578054 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.577984    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-bound-sa-token\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578054 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578014    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-image-registry-private-configuration\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578054 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578033    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-trusted-ca\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578323 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578062    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-tls\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578323 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578098    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-certificates\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578460 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578354    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f64737d-09d3-4042-9584-ca5f17b46d18-ca-trust-extracted\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.578692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.578670    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f64737d-09d3-4042-9584-ca5f17b46d18-ca-trust-extracted\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.579289 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.579257    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-trusted-ca\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.579381 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.579291    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-certificates\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.580398 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.580376    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-installation-pull-secrets\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.580729 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.580709    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f64737d-09d3-4042-9584-ca5f17b46d18-image-registry-private-configuration\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.581113 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.581092    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-registry-tls\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.591118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.591087    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-bound-sa-token\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.591355 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.591339    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn55\" (UniqueName: \"kubernetes.io/projected/9f64737d-09d3-4042-9584-ca5f17b46d18-kube-api-access-xcn55\") pod \"image-registry-558457cddc-qc6dk\" (UID: \"9f64737d-09d3-4042-9584-ca5f17b46d18\") " pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.670961 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.670933    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:14.686434 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.686399    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk6d5"]
May 29 02:30:14.690726 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:14.690698    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ada40c_e6d3_4f1c_b1c0_7eb054dc6b42.slice/crio-4c546e8c99c7f98c1fc8b3b72fdc98304e4f0eedfcfc6cbef0cdbbba29137d98 WatchSource:0}: Error finding container 4c546e8c99c7f98c1fc8b3b72fdc98304e4f0eedfcfc6cbef0cdbbba29137d98: Status 404 returned error can't find the container with id 4c546e8c99c7f98c1fc8b3b72fdc98304e4f0eedfcfc6cbef0cdbbba29137d98
May 29 02:30:14.805162 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:14.805135    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558457cddc-qc6dk"]
May 29 02:30:14.808280 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:14.808251    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f64737d_09d3_4042_9584_ca5f17b46d18.slice/crio-fae72117363704840d8f0f33e1e6ca8ab376c75b4eaac81288b4456d83804e51 WatchSource:0}: Error finding container fae72117363704840d8f0f33e1e6ca8ab376c75b4eaac81288b4456d83804e51: Status 404 returned error can't find the container with id fae72117363704840d8f0f33e1e6ca8ab376c75b4eaac81288b4456d83804e51
May 29 02:30:14.855226 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:30:14.855179    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lqs2h" podUID="502a08f0-241a-424b-80f6-bd4840fc3be4"
May 29 02:30:15.351314 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.351274    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558457cddc-qc6dk" event={"ID":"9f64737d-09d3-4042-9584-ca5f17b46d18","Type":"ContainerStarted","Data":"b0acf2667b0a5a2bf1b6191e1f877a7caa587c7c948591ba5f8207dd293c5da1"}
May 29 02:30:15.351314 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.351315    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558457cddc-qc6dk" event={"ID":"9f64737d-09d3-4042-9584-ca5f17b46d18","Type":"ContainerStarted","Data":"fae72117363704840d8f0f33e1e6ca8ab376c75b4eaac81288b4456d83804e51"}
May 29 02:30:15.351520 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.351346    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:15.352609 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.352586    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk6d5" event={"ID":"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42","Type":"ContainerStarted","Data":"3a4c6f1230ec8b3f56c423834b5ea7a246f71384ca7e4b91ab90f09dd42a6f3b"}
May 29 02:30:15.352609 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.352611    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk6d5" event={"ID":"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42","Type":"ContainerStarted","Data":"4c546e8c99c7f98c1fc8b3b72fdc98304e4f0eedfcfc6cbef0cdbbba29137d98"}
May 29 02:30:15.375442 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:15.375402    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-558457cddc-qc6dk" podStartSLOduration=1.375391872 podStartE2EDuration="1.375391872s" podCreationTimestamp="2026-05-29 02:30:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:30:15.374923861 +0000 UTC m=+159.064879537" watchObservedRunningTime="2026-05-29 02:30:15.375391872 +0000 UTC m=+159.065347578"
May 29 02:30:16.367627 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:16.367555    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk6d5" event={"ID":"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42","Type":"ContainerStarted","Data":"c7bfb787a6b033c5b0af7afaf5bb578c82b8e04d26c016fd5360ebb999276c11"}
May 29 02:30:17.371980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:17.371945    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk6d5" event={"ID":"46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42","Type":"ContainerStarted","Data":"5b0011c26c575c8c2aeb6abfb32ebaba25d179fbedcc71d2a3af4582744f3bd3"}
May 29 02:30:17.392844 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:17.392802    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qk6d5" podStartSLOduration=1.0020946 podStartE2EDuration="3.392789709s" podCreationTimestamp="2026-05-29 02:30:14 +0000 UTC" firstStartedPulling="2026-05-29 02:30:14.789630984 +0000 UTC m=+158.479586641" lastFinishedPulling="2026-05-29 02:30:17.180326084 +0000 UTC m=+160.870281750" observedRunningTime="2026-05-29 02:30:17.391558185 +0000 UTC m=+161.081513863" watchObservedRunningTime="2026-05-29 02:30:17.392789709 +0000 UTC m=+161.082745427"
May 29 02:30:18.711048 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.711014    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:18.711443 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.711056    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:30:18.713390 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.713361    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d152cc93-674d-4780-8fdb-5b53d2182d79-metrics-tls\") pod \"dns-default-g2dsh\" (UID: \"d152cc93-674d-4780-8fdb-5b53d2182d79\") " pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:18.713502 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.713417    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c07db6d-7907-4d7d-8a61-859509226a07-cert\") pod \"ingress-canary-8scw8\" (UID: \"1c07db6d-7907-4d7d-8a61-859509226a07\") " pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:30:18.852898 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.852876    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrg6b\""
May 29 02:30:18.853529 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.853507    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zl2l4\""
May 29 02:30:18.858687 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.858669    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:18.858748 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:18.858687    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8scw8"
May 29 02:30:19.002364 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.002157    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g2dsh"]
May 29 02:30:19.004650 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:19.004622    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd152cc93_674d_4780_8fdb_5b53d2182d79.slice/crio-181e0af3c4fb8ae26358e72f1b02efa1d6cbcee1c53e81c7d4db1ecce2a07cad WatchSource:0}: Error finding container 181e0af3c4fb8ae26358e72f1b02efa1d6cbcee1c53e81c7d4db1ecce2a07cad: Status 404 returned error can't find the container with id 181e0af3c4fb8ae26358e72f1b02efa1d6cbcee1c53e81c7d4db1ecce2a07cad
May 29 02:30:19.010284 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.010240    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8scw8"]
May 29 02:30:19.014985 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:19.014957    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c07db6d_7907_4d7d_8a61_859509226a07.slice/crio-2261b67d2d8b864a2efeba8c3eda6cd37150ec8a27ca56189e6e4416dbe56a70 WatchSource:0}: Error finding container 2261b67d2d8b864a2efeba8c3eda6cd37150ec8a27ca56189e6e4416dbe56a70: Status 404 returned error can't find the container with id 2261b67d2d8b864a2efeba8c3eda6cd37150ec8a27ca56189e6e4416dbe56a70
May 29 02:30:19.094702 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.094669    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" podUID="c463f486-62a1-41ad-865d-f1604eef8e37" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": read tcp 10.133.0.2:43066->10.133.0.8:8000: read: connection reset by peer"
May 29 02:30:19.378077 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.378051    2547 generic.go:358] "Generic (PLEG): container finished" podID="c463f486-62a1-41ad-865d-f1604eef8e37" containerID="52f5eeb658ad4aa1db284238e57bd3f726d40a6a8f795f0a72838551eb0ee243" exitCode=1
May 29 02:30:19.378185 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.378129    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" event={"ID":"c463f486-62a1-41ad-865d-f1604eef8e37","Type":"ContainerDied","Data":"52f5eeb658ad4aa1db284238e57bd3f726d40a6a8f795f0a72838551eb0ee243"}
May 29 02:30:19.378483 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.378465    2547 scope.go:117] "RemoveContainer" containerID="52f5eeb658ad4aa1db284238e57bd3f726d40a6a8f795f0a72838551eb0ee243"
May 29 02:30:19.379129 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.379097    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2dsh" event={"ID":"d152cc93-674d-4780-8fdb-5b53d2182d79","Type":"ContainerStarted","Data":"181e0af3c4fb8ae26358e72f1b02efa1d6cbcee1c53e81c7d4db1ecce2a07cad"}
May 29 02:30:19.379980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:19.379963    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8scw8" event={"ID":"1c07db6d-7907-4d7d-8a61-859509226a07","Type":"ContainerStarted","Data":"2261b67d2d8b864a2efeba8c3eda6cd37150ec8a27ca56189e6e4416dbe56a70"}
May 29 02:30:20.384664 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:20.384626    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2" event={"ID":"c463f486-62a1-41ad-865d-f1604eef8e37","Type":"ContainerStarted","Data":"323062727bb9f0289b258c69193625c04e27a01c8b02a2ba0d82ac0911d8e53b"}
May 29 02:30:20.385127 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:20.385101    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:30:20.385670 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:20.385646    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cdcdf586-k4nj2"
May 29 02:30:21.388335 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.388300    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2dsh" event={"ID":"d152cc93-674d-4780-8fdb-5b53d2182d79","Type":"ContainerStarted","Data":"cedff177496db050cba1cf6d3c149890f14f3135475e43332144d1836dbf927a"}
May 29 02:30:21.388335 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.388335    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2dsh" event={"ID":"d152cc93-674d-4780-8fdb-5b53d2182d79","Type":"ContainerStarted","Data":"ad1b506d0451277fdc02a3e14ab73f0a5da0b03f56ebf09bd910d2539be8def2"}
May 29 02:30:21.388830 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.388514    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:21.389543 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.389519    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8scw8" event={"ID":"1c07db6d-7907-4d7d-8a61-859509226a07","Type":"ContainerStarted","Data":"1cafad5ce6cbcd7192182f1de7176bd087a12fc1920523aea0b9e4aa049878b7"}
May 29 02:30:21.407722 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.407680    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-g2dsh" podStartSLOduration=129.623213095 podStartE2EDuration="2m11.407669768s" podCreationTimestamp="2026-05-29 02:28:10 +0000 UTC" firstStartedPulling="2026-05-29 02:30:19.006700635 +0000 UTC m=+162.696656288" lastFinishedPulling="2026-05-29 02:30:20.791157303 +0000 UTC m=+164.481112961" observedRunningTime="2026-05-29 02:30:21.406903185 +0000 UTC m=+165.096858861" watchObservedRunningTime="2026-05-29 02:30:21.407669768 +0000 UTC m=+165.097625478"
May 29 02:30:21.422632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:21.422596    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8scw8" podStartSLOduration=129.64502745 podStartE2EDuration="2m11.42258508s" podCreationTimestamp="2026-05-29 02:28:10 +0000 UTC" firstStartedPulling="2026-05-29 02:30:19.016699914 +0000 UTC m=+162.706655568" lastFinishedPulling="2026-05-29 02:30:20.794257542 +0000 UTC m=+164.484213198" observedRunningTime="2026-05-29 02:30:21.42189162 +0000 UTC m=+165.111847295" watchObservedRunningTime="2026-05-29 02:30:21.42258508 +0000 UTC m=+165.112540755"
May 29 02:30:24.234815 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:24.234737    2547 patch_prober.go:28] interesting pod/image-registry-6bcfb9d58f-fbfzp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 02:30:24.234815 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:24.234789    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 02:30:25.510948 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.510913    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f64c8"]
May 29 02:30:25.513533 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.513488    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.516173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.516151    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 02:30:25.516322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.516176    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 02:30:25.516322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.516231    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jnhk2\""
May 29 02:30:25.516322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.516313    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 02:30:25.517041 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.517025    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 02:30:25.517132 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.517071    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 02:30:25.517328 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.517315    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 02:30:25.664393 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664365    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-root\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664529 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664396    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-accelerators-collector-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664529 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664418    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-metrics-client-ca\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664529 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-wtmp\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664529 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-tls\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664530    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchcs\" (UniqueName: \"kubernetes.io/projected/f10a5f4a-1a60-4775-93b5-6ff208bc8030-kube-api-access-hchcs\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-textfile\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.664666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.664630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-sys\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765689 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765623    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-sys\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765689 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765660    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-root\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765689 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765681    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-accelerators-collector-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765701    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-metrics-client-ca\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765721    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-wtmp\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765736    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-sys\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765744    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-root\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765749    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-tls\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765802    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hchcs\" (UniqueName: \"kubernetes.io/projected/f10a5f4a-1a60-4775-93b5-6ff208bc8030-kube-api-access-hchcs\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.765872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765844    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-textfile\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.766222 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765873    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.766222 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.765885    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-wtmp\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.766222 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.766171    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-textfile\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.766332 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.766273    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-metrics-client-ca\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.766424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.766336    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-accelerators-collector-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.768084 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.768064    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-tls\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.768187 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.768167    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f10a5f4a-1a60-4775-93b5-6ff208bc8030-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.774624 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.774606    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchcs\" (UniqueName: \"kubernetes.io/projected/f10a5f4a-1a60-4775-93b5-6ff208bc8030-kube-api-access-hchcs\") pod \"node-exporter-f64c8\" (UID: \"f10a5f4a-1a60-4775-93b5-6ff208bc8030\") " pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.823296 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:25.823275    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f64c8"
May 29 02:30:25.832434 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:25.832405    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10a5f4a_1a60_4775_93b5_6ff208bc8030.slice/crio-9c22d8654a932121dda51a0470b1fb1ebefebb1758bb442d7ce130e2237f5770 WatchSource:0}: Error finding container 9c22d8654a932121dda51a0470b1fb1ebefebb1758bb442d7ce130e2237f5770: Status 404 returned error can't find the container with id 9c22d8654a932121dda51a0470b1fb1ebefebb1758bb442d7ce130e2237f5770
May 29 02:30:26.403317 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.403269    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f64c8" event={"ID":"f10a5f4a-1a60-4775-93b5-6ff208bc8030","Type":"ContainerStarted","Data":"9c22d8654a932121dda51a0470b1fb1ebefebb1758bb442d7ce130e2237f5770"}
May 29 02:30:26.565952 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.565918    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:30:26.569237 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.569208    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.574131 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574108    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 02:30:26.574391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574370    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 02:30:26.574391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574384    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 02:30:26.574555 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574541    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p4cvr\""
May 29 02:30:26.574712 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574696    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 02:30:26.574929 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.574913    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 02:30:26.575275 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.575254    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 02:30:26.575372 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.575263    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 02:30:26.576319 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.576297    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 02:30:26.580804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.580786    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 02:30:26.599432 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.599411    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:30:26.672555 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672555 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672713 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672679    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672735    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672778    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ltk\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.672911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672882    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.673113 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672908    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.673113 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.672937    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774030 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.773995    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774036    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774061    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774124    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774181    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774227    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774251    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774285    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774314    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774339    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774372    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774712 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774398    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ltk\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774712 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774445    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774712 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.774550    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.774855 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:30:26.774835    2547 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 29 02:30:26.774933 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:30:26.774911    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls podName:99ce4210-d779-4792-8310-5866e34099da nodeName:}" failed. No retries permitted until 2026-05-29 02:30:27.27489035 +0000 UTC m=+170.964846020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "99ce4210-d779-4792-8310-5866e34099da") : secret "alertmanager-main-tls" not found
May 29 02:30:26.775353 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.775302    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.775920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.775891    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.777825 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.777783    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.777923 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.777904    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.778487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.778444    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.778487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.778475    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.778630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.778534    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.778691 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.778637    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.779330 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.779310    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.780416 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.780399    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.796893 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.796869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ltk\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:26.842355 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:26.842330    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:30:27.278376 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.278313    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:27.280439 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.280422    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:27.407401 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.407368    2547 generic.go:358] "Generic (PLEG): container finished" podID="f10a5f4a-1a60-4775-93b5-6ff208bc8030" containerID="73ef587cf639cc8f0cec77ef23021fd977710edede3f3ae569de9c491211022c" exitCode=0
May 29 02:30:27.407500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.407425    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f64c8" event={"ID":"f10a5f4a-1a60-4775-93b5-6ff208bc8030","Type":"ContainerDied","Data":"73ef587cf639cc8f0cec77ef23021fd977710edede3f3ae569de9c491211022c"}
May 29 02:30:27.480002 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.479984    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:30:27.673025 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:27.672994    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:30:27.675743 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:27.675718    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ce4210_d779_4792_8310_5866e34099da.slice/crio-a7d873b355d1928dc38ac4ac1f2c81d41191a646cf5a3f7d138310d553eef07c WatchSource:0}: Error finding container a7d873b355d1928dc38ac4ac1f2c81d41191a646cf5a3f7d138310d553eef07c: Status 404 returned error can't find the container with id a7d873b355d1928dc38ac4ac1f2c81d41191a646cf5a3f7d138310d553eef07c
May 29 02:30:28.412392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:28.412350    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f64c8" event={"ID":"f10a5f4a-1a60-4775-93b5-6ff208bc8030","Type":"ContainerStarted","Data":"34fa8fc90b10f99b40a1da667407a9fe35d91323bdef25e12040c8d9ca72e5bf"}
May 29 02:30:28.412392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:28.412398    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f64c8" event={"ID":"f10a5f4a-1a60-4775-93b5-6ff208bc8030","Type":"ContainerStarted","Data":"2cd614b56f5b2325bb7830fa2e970345019be62ae7de5745337649b9cbaa57a3"}
May 29 02:30:28.413500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:28.413466    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"a7d873b355d1928dc38ac4ac1f2c81d41191a646cf5a3f7d138310d553eef07c"}
May 29 02:30:28.440836 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:28.440761    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f64c8" podStartSLOduration=2.388012642 podStartE2EDuration="3.440745618s" podCreationTimestamp="2026-05-29 02:30:25 +0000 UTC" firstStartedPulling="2026-05-29 02:30:25.834147178 +0000 UTC m=+169.524102830" lastFinishedPulling="2026-05-29 02:30:26.886880148 +0000 UTC m=+170.576835806" observedRunningTime="2026-05-29 02:30:28.440185617 +0000 UTC m=+172.130141293" watchObservedRunningTime="2026-05-29 02:30:28.440745618 +0000 UTC m=+172.130701296"
May 29 02:30:29.418381 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:29.418350    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8" exitCode=0
May 29 02:30:29.418739 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:29.418434    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"}
May 29 02:30:30.214120 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.214087    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"]
May 29 02:30:30.217254 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.217239    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:30.219733 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.219712    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-lvlt8\""
May 29 02:30:30.219733 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.219727    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 29 02:30:30.228610 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.228591    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"]
May 29 02:30:30.300690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.300658    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ea6570-33ea-449b-8cf0-ff78f0e5d081-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-g5wm2\" (UID: \"82ea6570-33ea-449b-8cf0-ff78f0e5d081\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:30.401842 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.401806    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ea6570-33ea-449b-8cf0-ff78f0e5d081-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-g5wm2\" (UID: \"82ea6570-33ea-449b-8cf0-ff78f0e5d081\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:30.404177 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.404153    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ea6570-33ea-449b-8cf0-ff78f0e5d081-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-g5wm2\" (UID: \"82ea6570-33ea-449b-8cf0-ff78f0e5d081\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:30.525428 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.525360    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:30.826441 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:30.826420    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"]
May 29 02:30:30.828737 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:30.828708    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ea6570_33ea_449b_8cf0_ff78f0e5d081.slice/crio-15fe818cc3713cc2144c38de6753174331d66a2d26b5326056dd33aa7fabb9ee WatchSource:0}: Error finding container 15fe818cc3713cc2144c38de6753174331d66a2d26b5326056dd33aa7fabb9ee: Status 404 returned error can't find the container with id 15fe818cc3713cc2144c38de6753174331d66a2d26b5326056dd33aa7fabb9ee
May 29 02:30:31.394828 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.394799    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g2dsh"
May 29 02:30:31.432804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.432667    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"}
May 29 02:30:31.432804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.432725    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"}
May 29 02:30:31.432804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.432740    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"}
May 29 02:30:31.432804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.432754    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"}
May 29 02:30:31.432804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.432766    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"}
May 29 02:30:31.435782 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:31.435695    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2" event={"ID":"82ea6570-33ea-449b-8cf0-ff78f0e5d081","Type":"ContainerStarted","Data":"15fe818cc3713cc2144c38de6753174331d66a2d26b5326056dd33aa7fabb9ee"}
May 29 02:30:32.441329 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.441241    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerStarted","Data":"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"}
May 29 02:30:32.442414 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.442394    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2" event={"ID":"82ea6570-33ea-449b-8cf0-ff78f0e5d081","Type":"ContainerStarted","Data":"32e23857741af101c03b7ddf531e43c19425321a71636ff9c5ca9ec509caf950"}
May 29 02:30:32.442583 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.442566    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:32.447161 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.447137    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2"
May 29 02:30:32.502667 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.502612    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.051180684 podStartE2EDuration="6.502597319s" podCreationTimestamp="2026-05-29 02:30:26 +0000 UTC" firstStartedPulling="2026-05-29 02:30:27.677526224 +0000 UTC m=+171.367481877" lastFinishedPulling="2026-05-29 02:30:32.128942852 +0000 UTC m=+175.818898512" observedRunningTime="2026-05-29 02:30:32.478898764 +0000 UTC m=+176.168854440" watchObservedRunningTime="2026-05-29 02:30:32.502597319 +0000 UTC m=+176.192552994"
May 29 02:30:32.504017 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:32.503980    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-g5wm2" podStartSLOduration=1.202856972 podStartE2EDuration="2.50397163s" podCreationTimestamp="2026-05-29 02:30:30 +0000 UTC" firstStartedPulling="2026-05-29 02:30:30.830591031 +0000 UTC m=+174.520546684" lastFinishedPulling="2026-05-29 02:30:32.131705676 +0000 UTC m=+175.821661342" observedRunningTime="2026-05-29 02:30:32.502169713 +0000 UTC m=+176.192125389" watchObservedRunningTime="2026-05-29 02:30:32.50397163 +0000 UTC m=+176.193927306"
May 29 02:30:34.235111 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:34.235076    2547 patch_prober.go:28] interesting pod/image-registry-6bcfb9d58f-fbfzp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 02:30:34.235461 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:34.235129    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 02:30:34.674906 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:34.674878    2547 patch_prober.go:28] interesting pod/image-registry-558457cddc-qc6dk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 02:30:34.675069 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:34.674928    2547 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-558457cddc-qc6dk" podUID="9f64737d-09d3-4042-9584-ca5f17b46d18" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 02:30:36.371605 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:36.371579    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-558457cddc-qc6dk"
May 29 02:30:39.249882 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.249819    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry" containerID="cri-o://8705270ef26395acf9808e0495584bf176b9f10a9097c53b247b5cd83e056154" gracePeriod=30
May 29 02:30:39.469469 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.469364    2547 generic.go:358] "Generic (PLEG): container finished" podID="1282036b-90ae-478b-a42e-45dc9b262d97" containerID="8705270ef26395acf9808e0495584bf176b9f10a9097c53b247b5cd83e056154" exitCode=0
May 29 02:30:39.469469 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.469418    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" event={"ID":"1282036b-90ae-478b-a42e-45dc9b262d97","Type":"ContainerDied","Data":"8705270ef26395acf9808e0495584bf176b9f10a9097c53b247b5cd83e056154"}
May 29 02:30:39.504123 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.504071    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:30:39.676171 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676133    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56gsl\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676352 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676172    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676352 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676256    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676352 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676296    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676369    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676401    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676432    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.676524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.676497    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") pod \"1282036b-90ae-478b-a42e-45dc9b262d97\" (UID: \"1282036b-90ae-478b-a42e-45dc9b262d97\") "
May 29 02:30:39.677111 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.677075    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:30:39.677338 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.677294    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:30:39.679393 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.679346    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl" (OuterVolumeSpecName: "kube-api-access-56gsl") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "kube-api-access-56gsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:30:39.680663 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.680605    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:30:39.680892 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.680866    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:30:39.680985 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.680929    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:30:39.681402 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.681375    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:30:39.685956 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.685931    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1282036b-90ae-478b-a42e-45dc9b262d97" (UID: "1282036b-90ae-478b-a42e-45dc9b262d97"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:30:39.777107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777055    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1282036b-90ae-478b-a42e-45dc9b262d97-ca-trust-extracted\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777076    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-registry-certificates\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777086    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1282036b-90ae-478b-a42e-45dc9b262d97-trusted-ca\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777094    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-bound-sa-token\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777103    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-registry-tls\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777348 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777111    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56gsl\" (UniqueName: \"kubernetes.io/projected/1282036b-90ae-478b-a42e-45dc9b262d97-kube-api-access-56gsl\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777348 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777120    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-image-registry-private-configuration\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:39.777348 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:39.777130    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1282036b-90ae-478b-a42e-45dc9b262d97-installation-pull-secrets\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:30:40.473709 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.473677    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp" event={"ID":"1282036b-90ae-478b-a42e-45dc9b262d97","Type":"ContainerDied","Data":"9aed648ca3cdc816b980df556b12ca20ee076e4ec42e65f3ba3470fac2a1b627"}
May 29 02:30:40.474133 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.473721    2547 scope.go:117] "RemoveContainer" containerID="8705270ef26395acf9808e0495584bf176b9f10a9097c53b247b5cd83e056154"
May 29 02:30:40.474133 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.473726    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"
May 29 02:30:40.496701 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.496679    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:30:40.504814 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.504794    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bcfb9d58f-fbfzp"]
May 29 02:30:40.839712 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:40.839637    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" path="/var/lib/kubelet/pods/1282036b-90ae-478b-a42e-45dc9b262d97/volumes"
May 29 02:30:52.507048 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:52.507014    2547 generic.go:358] "Generic (PLEG): container finished" podID="f8f12848-2295-4f43-8a22-ec853edd92e2" containerID="827a2dd77264c3be298d48e891d186f228581a8848eb86b4253d794cba2a9c79" exitCode=0
May 29 02:30:52.507456 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:52.507065    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6" event={"ID":"f8f12848-2295-4f43-8a22-ec853edd92e2","Type":"ContainerDied","Data":"827a2dd77264c3be298d48e891d186f228581a8848eb86b4253d794cba2a9c79"}
May 29 02:30:52.507456 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:52.507368    2547 scope.go:117] "RemoveContainer" containerID="827a2dd77264c3be298d48e891d186f228581a8848eb86b4253d794cba2a9c79"
May 29 02:30:53.511325 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:53.511292    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-j7gd6" event={"ID":"f8f12848-2295-4f43-8a22-ec853edd92e2","Type":"ContainerStarted","Data":"d723909a51f96683fb8d0013c4c2495c47e271a5f4da23a9aaaf8fa4b12d8990"}
May 29 02:30:58.112027 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.111984    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:30:58.112520 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.112412    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry"
May 29 02:30:58.112520 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.112432    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry"
May 29 02:30:58.112632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.112548    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="1282036b-90ae-478b-a42e-45dc9b262d97" containerName="registry"
May 29 02:30:58.114483 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.114461    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.117811 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.117791    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 02:30:58.117910 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.117803    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-468rk\""
May 29 02:30:58.118799 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.118781    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 02:30:58.118857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.118814    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 02:30:58.119060 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.119045    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 02:30:58.119135 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.119087    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 02:30:58.119135 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.119122    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 02:30:58.119274 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.119146    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 02:30:58.125186 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.125163    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 02:30:58.132279 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.132257    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:30:58.209580 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209755 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209608    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209755 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209755 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209703    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209755 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209728    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vm9\" (UniqueName: \"kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209755 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209747    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.209933 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.209764    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310283 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310242    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310283 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310286    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310316    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vm9\" (UniqueName: \"kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310335    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310351    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310389    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.310487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.310456    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.311127 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.311102    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.311279 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.311106    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.311279 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.311146    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.311356 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.311276    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.312901 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.312874    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.312999 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.312983    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.319414 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.319396    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vm9\" (UniqueName: \"kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9\") pod \"console-768d574785-4w74v\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") " pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.424054 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.424034    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768d574785-4w74v"
May 29 02:30:58.549875 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:58.549843    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:30:58.552643 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:30:58.552617    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8355b7f_f1ae_4ab5_bbc9_17a9a51279e6.slice/crio-b6516fe6895762d86afd390a75cef60931ae3a840500de8cc5308174f5ae3fa5 WatchSource:0}: Error finding container b6516fe6895762d86afd390a75cef60931ae3a840500de8cc5308174f5ae3fa5: Status 404 returned error can't find the container with id b6516fe6895762d86afd390a75cef60931ae3a840500de8cc5308174f5ae3fa5
May 29 02:30:59.532621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:30:59.532582    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768d574785-4w74v" event={"ID":"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6","Type":"ContainerStarted","Data":"b6516fe6895762d86afd390a75cef60931ae3a840500de8cc5308174f5ae3fa5"}
May 29 02:31:01.542633 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:01.542569    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768d574785-4w74v" event={"ID":"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6","Type":"ContainerStarted","Data":"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"}
May 29 02:31:01.574956 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:01.574853    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-768d574785-4w74v" podStartSLOduration=1.074705684 podStartE2EDuration="3.574818035s" podCreationTimestamp="2026-05-29 02:30:58 +0000 UTC" firstStartedPulling="2026-05-29 02:30:58.554338545 +0000 UTC m=+202.244294202" lastFinishedPulling="2026-05-29 02:31:01.054450883 +0000 UTC m=+204.744406553" observedRunningTime="2026-05-29 02:31:01.573288812 +0000 UTC m=+205.263244488" watchObservedRunningTime="2026-05-29 02:31:01.574818035 +0000 UTC m=+205.264773710"
May 29 02:31:02.546862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:02.546827    2547 generic.go:358] "Generic (PLEG): container finished" podID="8163df72-915b-4049-bd3d-c5ed3ca9c73f" containerID="96bd9f03d27d5c9aa1b7a6143b7e07036ebd564708e34a40dbaa1a9444a81697" exitCode=0
May 29 02:31:02.547322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:02.546903    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s" event={"ID":"8163df72-915b-4049-bd3d-c5ed3ca9c73f","Type":"ContainerDied","Data":"96bd9f03d27d5c9aa1b7a6143b7e07036ebd564708e34a40dbaa1a9444a81697"}
May 29 02:31:02.547322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:02.547313    2547 scope.go:117] "RemoveContainer" containerID="96bd9f03d27d5c9aa1b7a6143b7e07036ebd564708e34a40dbaa1a9444a81697"
May 29 02:31:03.553331 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:03.551703    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-c5c9s" event={"ID":"8163df72-915b-4049-bd3d-c5ed3ca9c73f","Type":"ContainerStarted","Data":"1953f911b7263848d9239d4a1d66c7fd79a20082d8a25ef736f95b9a1ce457fb"}
May 29 02:31:08.424941 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:08.424898    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-768d574785-4w74v"
May 29 02:31:08.424941 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:08.424946    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-768d574785-4w74v"
May 29 02:31:08.429751 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:08.429728    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-768d574785-4w74v"
May 29 02:31:08.568939 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:08.568910    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-768d574785-4w74v"
May 29 02:31:45.964447 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964413    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:45.964871 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964826    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="alertmanager" containerID="cri-o://68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1" gracePeriod=120
May 29 02:31:45.964949 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964885    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-metric" containerID="cri-o://91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49" gracePeriod=120
May 29 02:31:45.965003 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964927    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-web" containerID="cri-o://3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9" gracePeriod=120
May 29 02:31:45.965003 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964964    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="prom-label-proxy" containerID="cri-o://86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d" gracePeriod=120
May 29 02:31:45.965003 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964975    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy" containerID="cri-o://3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95" gracePeriod=120
May 29 02:31:45.965118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:45.964974    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="config-reloader" containerID="cri-o://ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883" gracePeriod=120
May 29 02:31:46.678180 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678146    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d" exitCode=0
May 29 02:31:46.678180 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678171    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95" exitCode=0
May 29 02:31:46.678180 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678179    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883" exitCode=0
May 29 02:31:46.678180 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678187    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1" exitCode=0
May 29 02:31:46.678450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678205    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"}
May 29 02:31:46.678450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678246    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"}
May 29 02:31:46.678450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678257    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"}
May 29 02:31:46.678450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:46.678266    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"}
May 29 02:31:47.204304 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.204281    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.283621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283554    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.283621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283617    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.283866 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283637    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.283866 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283657    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.283866 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283680    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.283866 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283709    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283921    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.283979    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284062    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284280 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284095    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5ltk\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284280 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284150    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284280 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284177    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:31:47.284280 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284246    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.284475 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284334    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out\") pod \"99ce4210-d779-4792-8310-5866e34099da\" (UID: \"99ce4210-d779-4792-8310-5866e34099da\") "
May 29 02:31:47.285361 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284683    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-metrics-client-ca\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.285361 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.284786    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:31:47.286138 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.286106    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:31:47.287907 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.287869    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume" (OuterVolumeSpecName: "config-volume") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.289480 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.289399    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:31:47.289480 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.289452    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.289714 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.289679    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.290060 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.290033    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk" (OuterVolumeSpecName: "kube-api-access-m5ltk") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "kube-api-access-m5ltk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:31:47.290656 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.290635    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.290984 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.290959    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.291447 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.291427    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out" (OuterVolumeSpecName: "config-out") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:31:47.293512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.293402    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.301808 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.301788    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config" (OuterVolumeSpecName: "web-config") pod "99ce4210-d779-4792-8310-5866e34099da" (UID: "99ce4210-d779-4792-8310-5866e34099da"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:47.385413 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385383    2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99ce4210-d779-4792-8310-5866e34099da-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385413 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385416    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5ltk\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-kube-api-access-m5ltk\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385431    2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385447    2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385462    2547 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-config-out\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385476    2547 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99ce4210-d779-4792-8310-5866e34099da-tls-assets\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385491    2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385504    2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-secret-alertmanager-main-tls\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385517    2547 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-web-config\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385529    2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99ce4210-d779-4792-8310-5866e34099da-alertmanager-main-db\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385542    2547 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-config-volume\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.385608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.385555    2547 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99ce4210-d779-4792-8310-5866e34099da-cluster-tls-config\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:31:47.683674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683643    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49" exitCode=0
May 29 02:31:47.683674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683667    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ce4210-d779-4792-8310-5866e34099da" containerID="3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9" exitCode=0
May 29 02:31:47.683849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683723    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"}
May 29 02:31:47.683849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683741    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.683849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683764    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"}
May 29 02:31:47.683849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683775    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99ce4210-d779-4792-8310-5866e34099da","Type":"ContainerDied","Data":"a7d873b355d1928dc38ac4ac1f2c81d41191a646cf5a3f7d138310d553eef07c"}
May 29 02:31:47.683849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.683791    2547 scope.go:117] "RemoveContainer" containerID="86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"
May 29 02:31:47.691158 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.691138    2547 scope.go:117] "RemoveContainer" containerID="91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"
May 29 02:31:47.697768 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.697753    2547 scope.go:117] "RemoveContainer" containerID="3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"
May 29 02:31:47.703946 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.703931    2547 scope.go:117] "RemoveContainer" containerID="3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"
May 29 02:31:47.710010 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.709992    2547 scope.go:117] "RemoveContainer" containerID="ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"
May 29 02:31:47.711189 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.711159    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:47.716417 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.716400    2547 scope.go:117] "RemoveContainer" containerID="68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"
May 29 02:31:47.718450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.718433    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:47.722288 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.722271    2547 scope.go:117] "RemoveContainer" containerID="bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"
May 29 02:31:47.728066 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728048    2547 scope.go:117] "RemoveContainer" containerID="86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"
May 29 02:31:47.728320 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.728300    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d\": container with ID starting with 86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d not found: ID does not exist" containerID="86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"
May 29 02:31:47.728368 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728330    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"} err="failed to get container status \"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d\": rpc error: code = NotFound desc = could not find container \"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d\": container with ID starting with 86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d not found: ID does not exist"
May 29 02:31:47.728368 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728358    2547 scope.go:117] "RemoveContainer" containerID="91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"
May 29 02:31:47.728564 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.728548    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49\": container with ID starting with 91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49 not found: ID does not exist" containerID="91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"
May 29 02:31:47.728602 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728569    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"} err="failed to get container status \"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49\": rpc error: code = NotFound desc = could not find container \"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49\": container with ID starting with 91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49 not found: ID does not exist"
May 29 02:31:47.728602 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728582    2547 scope.go:117] "RemoveContainer" containerID="3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"
May 29 02:31:47.728748 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.728733    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95\": container with ID starting with 3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95 not found: ID does not exist" containerID="3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"
May 29 02:31:47.728784 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728750    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"} err="failed to get container status \"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95\": rpc error: code = NotFound desc = could not find container \"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95\": container with ID starting with 3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95 not found: ID does not exist"
May 29 02:31:47.728784 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728774    2547 scope.go:117] "RemoveContainer" containerID="3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"
May 29 02:31:47.728971 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.728946    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9\": container with ID starting with 3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9 not found: ID does not exist" containerID="3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"
May 29 02:31:47.729012 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728975    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"} err="failed to get container status \"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9\": rpc error: code = NotFound desc = could not find container \"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9\": container with ID starting with 3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9 not found: ID does not exist"
May 29 02:31:47.729012 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.728988    2547 scope.go:117] "RemoveContainer" containerID="ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"
May 29 02:31:47.729266 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.729187    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883\": container with ID starting with ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883 not found: ID does not exist" containerID="ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"
May 29 02:31:47.729318 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729271    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"} err="failed to get container status \"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883\": rpc error: code = NotFound desc = could not find container \"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883\": container with ID starting with ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883 not found: ID does not exist"
May 29 02:31:47.729318 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729284    2547 scope.go:117] "RemoveContainer" containerID="68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"
May 29 02:31:47.729483 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.729469    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1\": container with ID starting with 68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1 not found: ID does not exist" containerID="68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"
May 29 02:31:47.729524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729486    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"} err="failed to get container status \"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1\": rpc error: code = NotFound desc = could not find container \"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1\": container with ID starting with 68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1 not found: ID does not exist"
May 29 02:31:47.729524 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729497    2547 scope.go:117] "RemoveContainer" containerID="bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"
May 29 02:31:47.729710 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:31:47.729692    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8\": container with ID starting with bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8 not found: ID does not exist" containerID="bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"
May 29 02:31:47.729754 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729715    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"} err="failed to get container status \"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8\": rpc error: code = NotFound desc = could not find container \"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8\": container with ID starting with bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8 not found: ID does not exist"
May 29 02:31:47.729754 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729730    2547 scope.go:117] "RemoveContainer" containerID="86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"
May 29 02:31:47.729915 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729900    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d"} err="failed to get container status \"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d\": rpc error: code = NotFound desc = could not find container \"86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d\": container with ID starting with 86c11d25d03bd86b5fdb6570c8e6aebabc7492333c6207dd38959b139817923d not found: ID does not exist"
May 29 02:31:47.729969 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.729916    2547 scope.go:117] "RemoveContainer" containerID="91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"
May 29 02:31:47.730117 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730102    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49"} err="failed to get container status \"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49\": rpc error: code = NotFound desc = could not find container \"91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49\": container with ID starting with 91ce8e304598a1af78e28b72c8aa975106e126ab2b580d9dd01ec25fb1eecc49 not found: ID does not exist"
May 29 02:31:47.730117 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730116    2547 scope.go:117] "RemoveContainer" containerID="3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"
May 29 02:31:47.730386 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730366    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95"} err="failed to get container status \"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95\": rpc error: code = NotFound desc = could not find container \"3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95\": container with ID starting with 3c4f6bf0afb52b35f648217b70e939c48fdcbda5c7e6c87e4e1cb402906c3c95 not found: ID does not exist"
May 29 02:31:47.730467 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730386    2547 scope.go:117] "RemoveContainer" containerID="3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"
May 29 02:31:47.730601 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730580    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9"} err="failed to get container status \"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9\": rpc error: code = NotFound desc = could not find container \"3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9\": container with ID starting with 3c55056968c5fa29ff2191d9c67d57363203fed5b8994a379cfd258f318753f9 not found: ID does not exist"
May 29 02:31:47.730645 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730601    2547 scope.go:117] "RemoveContainer" containerID="ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"
May 29 02:31:47.730794 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730778    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883"} err="failed to get container status \"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883\": rpc error: code = NotFound desc = could not find container \"ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883\": container with ID starting with ff0abee80991da84314fcd1b4469a3311ce58082fdb18427a3b74af19e73f883 not found: ID does not exist"
May 29 02:31:47.730845 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730796    2547 scope.go:117] "RemoveContainer" containerID="68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"
May 29 02:31:47.730984 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730969    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1"} err="failed to get container status \"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1\": rpc error: code = NotFound desc = could not find container \"68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1\": container with ID starting with 68fa75375f1b55e71c99bdad6c0e98ce94c05fffb79eb985d3815f6355893ee1 not found: ID does not exist"
May 29 02:31:47.731027 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.730984    2547 scope.go:117] "RemoveContainer" containerID="bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"
May 29 02:31:47.731211 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.731166    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8"} err="failed to get container status \"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8\": rpc error: code = NotFound desc = could not find container \"bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8\": container with ID starting with bbdb954e2586c241bdc69c8d1435d2c05afca61197aaf53e826af2fcebf8bbd8 not found: ID does not exist"
May 29 02:31:47.746902 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.746883    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747593    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="config-reloader"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747616    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="config-reloader"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747657    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="alertmanager"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747667    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="alertmanager"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747689    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="init-config-reloader"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747698    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="init-config-reloader"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747709    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-metric"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747719    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-metric"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747749    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-web"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747757    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-web"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747773    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="prom-label-proxy"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747794    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="prom-label-proxy"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747808    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747816    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747961    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="alertmanager"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747972    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="config-reloader"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747989    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-web"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.747999    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.748014    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="kube-rbac-proxy-metric"
May 29 02:31:47.750569 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.748024    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ce4210-d779-4792-8310-5866e34099da" containerName="prom-label-proxy"
May 29 02:31:47.753795 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.753767    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.756288 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756271    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p4cvr\""
May 29 02:31:47.756389 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756288    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 02:31:47.756536 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756518    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 02:31:47.756588 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756526    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 02:31:47.756763 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756735    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 02:31:47.756857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756778    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 02:31:47.756857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756788    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 02:31:47.756857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.756835    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 02:31:47.757170 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.757156    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 02:31:47.760806 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.760667    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 02:31:47.764097 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.764078    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:47.889355 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889328    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889477 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889360    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-config-out\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889477 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889379    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4tg\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-kube-api-access-cd4tg\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889477 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889504    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-config-volume\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889543    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889567    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889586 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889583    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-web-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889616    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889653    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.889725 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.889697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990261 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990153    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990261 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990223    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990261 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990242    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-config-out\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990263    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4tg\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-kube-api-access-cd4tg\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990285    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990314    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-config-volume\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990357    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990727 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990668    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990727 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990722    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-web-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990818 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990752    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990818 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990790    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990923 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990822    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.990923 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.990855    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.991578 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.991523    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.991753 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.991606    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.992063 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.992036    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4056b-ce05-43ee-afe4-181431890815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.993313 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.993286    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.993414 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.993329    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55d4056b-ce05-43ee-afe4-181431890815-config-out\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.993414 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.993382    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.993533 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.993488    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-config-volume\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.993690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.993663    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.994240 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.994216    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.994358 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.994338    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.994600 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.994580    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.995088 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.995072    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55d4056b-ce05-43ee-afe4-181431890815-web-config\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:47.997613 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:47.997598    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4tg\" (UniqueName: \"kubernetes.io/projected/55d4056b-ce05-43ee-afe4-181431890815-kube-api-access-cd4tg\") pod \"alertmanager-main-0\" (UID: \"55d4056b-ce05-43ee-afe4-181431890815\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:48.064013 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.063943    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:31:48.235700 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.235648    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:31:48.242908 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:31:48.242751    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d4056b_ce05_43ee_afe4_181431890815.slice/crio-2f0585af41bda7c3ea595d94b458de87de22fdd71118c6a8d2210811cd38bd44 WatchSource:0}: Error finding container 2f0585af41bda7c3ea595d94b458de87de22fdd71118c6a8d2210811cd38bd44: Status 404 returned error can't find the container with id 2f0585af41bda7c3ea595d94b458de87de22fdd71118c6a8d2210811cd38bd44
May 29 02:31:48.690678 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.690638    2547 generic.go:358] "Generic (PLEG): container finished" podID="55d4056b-ce05-43ee-afe4-181431890815" containerID="9e3d87e619f72747fe58f3dc7378bfda5f41c21a13ddd814eb60c7cb61eb071b" exitCode=0
May 29 02:31:48.690849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.690729    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerDied","Data":"9e3d87e619f72747fe58f3dc7378bfda5f41c21a13ddd814eb60c7cb61eb071b"}
May 29 02:31:48.690849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.690769    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"2f0585af41bda7c3ea595d94b458de87de22fdd71118c6a8d2210811cd38bd44"}
May 29 02:31:48.696549 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.696521    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:31:48.698818 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.698793    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/502a08f0-241a-424b-80f6-bd4840fc3be4-metrics-certs\") pod \"network-metrics-daemon-lqs2h\" (UID: \"502a08f0-241a-424b-80f6-bd4840fc3be4\") " pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:31:48.746466 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.746440    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2rwn\""
May 29 02:31:48.753618 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.753592    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lqs2h"
May 29 02:31:48.839690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.839666    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ce4210-d779-4792-8310-5866e34099da" path="/var/lib/kubelet/pods/99ce4210-d779-4792-8310-5866e34099da/volumes"
May 29 02:31:48.893246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:48.893225    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lqs2h"]
May 29 02:31:48.896150 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:31:48.896125    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502a08f0_241a_424b_80f6_bd4840fc3be4.slice/crio-bfb49407481a79467380d80d323a6c09c073b6589f4c55600808f22def125349 WatchSource:0}: Error finding container bfb49407481a79467380d80d323a6c09c073b6589f4c55600808f22def125349: Status 404 returned error can't find the container with id bfb49407481a79467380d80d323a6c09c073b6589f4c55600808f22def125349
May 29 02:31:49.697149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697108    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"edc392472296bf147130983df1ec6d5c9049cb8cf9ed26e39599f71c359caccb"}
May 29 02:31:49.697149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697154    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"0ffeeb26d45e49c2a2c0a9c31f843621ba61bf9075132c4a732cd85e1f87356d"}
May 29 02:31:49.697637 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697170    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"febd3391e3b259db1cdcb90442869999f04ca5acb8d99773bc50e33407308aaf"}
May 29 02:31:49.697637 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697183    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"5f9a3b51bb5ed0c695f4be079f9f36e07544471dc110011cf3b9d716afd72c13"}
May 29 02:31:49.697637 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697215    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"0c895eb6b43940269f1ef4966d3c75ed22f0cfbd169c4eb9a905cfd2d7673e97"}
May 29 02:31:49.697637 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.697229    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55d4056b-ce05-43ee-afe4-181431890815","Type":"ContainerStarted","Data":"50ee215cc479ee430676572391804f4ff3b5af851fa4d15bfbe48cbea95dfda2"}
May 29 02:31:49.698206 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.698168    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqs2h" event={"ID":"502a08f0-241a-424b-80f6-bd4840fc3be4","Type":"ContainerStarted","Data":"bfb49407481a79467380d80d323a6c09c073b6589f4c55600808f22def125349"}
May 29 02:31:49.726808 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:49.726765    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.726753317 podStartE2EDuration="2.726753317s" podCreationTimestamp="2026-05-29 02:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:31:49.725356258 +0000 UTC m=+253.415311948" watchObservedRunningTime="2026-05-29 02:31:49.726753317 +0000 UTC m=+253.416708992"
May 29 02:31:50.702789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:50.702743    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqs2h" event={"ID":"502a08f0-241a-424b-80f6-bd4840fc3be4","Type":"ContainerStarted","Data":"0fc579c87c4cb65e47803b153991ff7314e07806b10cbb9fc5fc4f05aad1609d"}
May 29 02:31:50.702789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:50.702792    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lqs2h" event={"ID":"502a08f0-241a-424b-80f6-bd4840fc3be4","Type":"ContainerStarted","Data":"9faa6de75f651fbdb2376c3d1c3aa1129ec9bbb1a974d5744b7edce8c237fea5"}
May 29 02:31:50.721366 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:50.721314    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lqs2h" podStartSLOduration=253.539110802 podStartE2EDuration="4m14.721296791s" podCreationTimestamp="2026-05-29 02:27:36 +0000 UTC" firstStartedPulling="2026-05-29 02:31:48.897959732 +0000 UTC m=+252.587915388" lastFinishedPulling="2026-05-29 02:31:50.08014572 +0000 UTC m=+253.770101377" observedRunningTime="2026-05-29 02:31:50.72067846 +0000 UTC m=+254.410634129" watchObservedRunningTime="2026-05-29 02:31:50.721296791 +0000 UTC m=+254.411252467"
May 29 02:31:57.900846 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:31:57.900776    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:32:22.919525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:22.919472    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-768d574785-4w74v" podUID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" containerName="console" containerID="cri-o://c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02" gracePeriod=15
May 29 02:32:23.156748 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.156721    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-768d574785-4w74v_a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6/console/0.log"
May 29 02:32:23.156852 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.156780    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768d574785-4w74v"
May 29 02:32:23.342368 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342282    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4vm9\" (UniqueName: \"kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342368 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342338    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342368 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342356    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342398    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342414    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342457    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342483    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca\") pod \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\" (UID: \"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6\") "
May 29 02:32:23.342950 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342920    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:32:23.343035 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.342938    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:32:23.343092 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.343051    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:32:23.343144 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.343101    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config" (OuterVolumeSpecName: "console-config") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:32:23.344647 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.344615    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:32:23.344743 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.344645    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9" (OuterVolumeSpecName: "kube-api-access-k4vm9") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "kube-api-access-k4vm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:32:23.344743 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.344674    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" (UID: "a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:32:23.443017 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.442989    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-oauth-serving-cert\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443017 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443014    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-serving-cert\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443023    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-config\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443033    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-service-ca\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443041    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4vm9\" (UniqueName: \"kubernetes.io/projected/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-kube-api-access-k4vm9\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443050    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-trusted-ca-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.443173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.443059    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6-console-oauth-config\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:32:23.802912 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.802883    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-768d574785-4w74v_a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6/console/0.log"
May 29 02:32:23.803093 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.802924    2547 generic.go:358] "Generic (PLEG): container finished" podID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" containerID="c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02" exitCode=2
May 29 02:32:23.803093 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.802951    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768d574785-4w74v" event={"ID":"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6","Type":"ContainerDied","Data":"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"}
May 29 02:32:23.803093 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.802987    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768d574785-4w74v" event={"ID":"a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6","Type":"ContainerDied","Data":"b6516fe6895762d86afd390a75cef60931ae3a840500de8cc5308174f5ae3fa5"}
May 29 02:32:23.803093 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.803003    2547 scope.go:117] "RemoveContainer" containerID="c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"
May 29 02:32:23.803093 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.803003    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768d574785-4w74v"
May 29 02:32:23.811041 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.811025    2547 scope.go:117] "RemoveContainer" containerID="c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"
May 29 02:32:23.811342 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:32:23.811322    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02\": container with ID starting with c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02 not found: ID does not exist" containerID="c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"
May 29 02:32:23.811423 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.811352    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02"} err="failed to get container status \"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02\": rpc error: code = NotFound desc = could not find container \"c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02\": container with ID starting with c2ba772dfcb8475ee07c935a069527dc467e6b629c9ccddca27c93e99dac6b02 not found: ID does not exist"
May 29 02:32:23.823272 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.823247    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:32:23.826940 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:23.826905    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-768d574785-4w74v"]
May 29 02:32:24.838934 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:24.838902    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" path="/var/lib/kubelet/pods/a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6/volumes"
May 29 02:32:36.724803 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:36.724760    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:32:36.725666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:36.725638    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:32:36.736685 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:36.736634    2547 kubelet.go:1628] "Image garbage collection succeeded"
May 29 02:32:50.520189 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.520151    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"]
May 29 02:32:50.522665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.520547    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" containerName="console"
May 29 02:32:50.522665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.520564    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" containerName="console"
May 29 02:32:50.522665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.520645    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8355b7f-f1ae-4ab5-bbc9-17a9a51279e6" containerName="console"
May 29 02:32:50.523457 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.523439    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.526142 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.526109    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2sxzk\""
May 29 02:32:50.526268 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.526212    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 02:32:50.527090 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.527075    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 02:32:50.536320 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.536298    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"]
May 29 02:32:50.627557 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.627532    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.627695 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.627566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5lqb\" (UniqueName: \"kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.627695 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.627600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.728149 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.728124    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.728268 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.728154    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5lqb\" (UniqueName: \"kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.728268 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.728185    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.728582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.728565    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.728616 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.728570    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.736922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.736892    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5lqb\" (UniqueName: \"kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.832939 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.832889    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:32:50.959115 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.959087    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"]
May 29 02:32:50.962376 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:32:50.962348    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a819b1f_a7a7_48bf_b74c_1f183972d767.slice/crio-0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa WatchSource:0}: Error finding container 0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa: Status 404 returned error can't find the container with id 0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa
May 29 02:32:50.964111 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:50.964095    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:32:51.886256 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:51.886162    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r" event={"ID":"8a819b1f-a7a7-48bf-b74c-1f183972d767","Type":"ContainerStarted","Data":"0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa"}
May 29 02:32:56.901930 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:56.901893    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerID="b63897b87b35bc55baaa3b22a9a61fc21a4b172154b736f53b6418d5b7dfe0bf" exitCode=0
May 29 02:32:56.902309 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:56.901936    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r" event={"ID":"8a819b1f-a7a7-48bf-b74c-1f183972d767","Type":"ContainerDied","Data":"b63897b87b35bc55baaa3b22a9a61fc21a4b172154b736f53b6418d5b7dfe0bf"}
May 29 02:32:59.913029 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:59.912984    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerID="5b7c2250bb57786bf6784432778479147b104423c2dcc9de9e1bacd94510f669" exitCode=0
May 29 02:32:59.913029 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:32:59.913025    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r" event={"ID":"8a819b1f-a7a7-48bf-b74c-1f183972d767","Type":"ContainerDied","Data":"5b7c2250bb57786bf6784432778479147b104423c2dcc9de9e1bacd94510f669"}
May 29 02:33:06.940557 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:06.940523    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerID="2aa09a12ce1c5199a61cee8b240e6e1313131e1ce20086fbb5a97e946099b4a2" exitCode=0
May 29 02:33:06.940896 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:06.940563    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r" event={"ID":"8a819b1f-a7a7-48bf-b74c-1f183972d767","Type":"ContainerDied","Data":"2aa09a12ce1c5199a61cee8b240e6e1313131e1ce20086fbb5a97e946099b4a2"}
May 29 02:33:08.064570 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.064548    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:33:08.168651 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.168618    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util\") pod \"8a819b1f-a7a7-48bf-b74c-1f183972d767\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") "
May 29 02:33:08.168827 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.168676    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5lqb\" (UniqueName: \"kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb\") pod \"8a819b1f-a7a7-48bf-b74c-1f183972d767\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") "
May 29 02:33:08.168827 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.168723    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle\") pod \"8a819b1f-a7a7-48bf-b74c-1f183972d767\" (UID: \"8a819b1f-a7a7-48bf-b74c-1f183972d767\") "
May 29 02:33:08.169404 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.169379    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle" (OuterVolumeSpecName: "bundle") pod "8a819b1f-a7a7-48bf-b74c-1f183972d767" (UID: "8a819b1f-a7a7-48bf-b74c-1f183972d767"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:08.170851 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.170828    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb" (OuterVolumeSpecName: "kube-api-access-n5lqb") pod "8a819b1f-a7a7-48bf-b74c-1f183972d767" (UID: "8a819b1f-a7a7-48bf-b74c-1f183972d767"). InnerVolumeSpecName "kube-api-access-n5lqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:33:08.172635 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.172616    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util" (OuterVolumeSpecName: "util") pod "8a819b1f-a7a7-48bf-b74c-1f183972d767" (UID: "8a819b1f-a7a7-48bf-b74c-1f183972d767"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:08.270040 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.269964    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5lqb\" (UniqueName: \"kubernetes.io/projected/8a819b1f-a7a7-48bf-b74c-1f183972d767-kube-api-access-n5lqb\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:08.270040 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.269993    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:08.270040 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.270003    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a819b1f-a7a7-48bf-b74c-1f183972d767-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:08.946979 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.946946    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r" event={"ID":"8a819b1f-a7a7-48bf-b74c-1f183972d767","Type":"ContainerDied","Data":"0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa"}
May 29 02:33:08.946979 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.946966    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh7v5r"
May 29 02:33:08.946979 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:08.946980    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d1aefa88b661aa64b1c4f3acfa17bca2c9da54e423bc9d2cde372c3da1619fa"
May 29 02:33:13.682110 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682079    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"]
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682508    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="pull"
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682527    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="pull"
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682548    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="util"
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682557    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="util"
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682568    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="extract"
May 29 02:33:13.682623 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682577    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="extract"
May 29 02:33:13.682936 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.682650    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a819b1f-a7a7-48bf-b74c-1f183972d767" containerName="extract"
May 29 02:33:13.687698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.687679    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.690126 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.690102    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 29 02:33:13.690275 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.690111    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-skfss\""
May 29 02:33:13.690275 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.690266    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 29 02:33:13.696621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.696599    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"]
May 29 02:33:13.808690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.808634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqn8k\" (UniqueName: \"kubernetes.io/projected/bf69506b-66d6-4616-b040-225fde095e0f-kube-api-access-tqn8k\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.808800 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.808697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf69506b-66d6-4616-b040-225fde095e0f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.909422 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.909398    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf69506b-66d6-4616-b040-225fde095e0f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.909520 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.909437    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqn8k\" (UniqueName: \"kubernetes.io/projected/bf69506b-66d6-4616-b040-225fde095e0f-kube-api-access-tqn8k\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.909766 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.909748    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf69506b-66d6-4616-b040-225fde095e0f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.917989 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.917968    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqn8k\" (UniqueName: \"kubernetes.io/projected/bf69506b-66d6-4616-b040-225fde095e0f-kube-api-access-tqn8k\") pod \"cert-manager-operator-controller-manager-54b9655956-zr5jd\" (UID: \"bf69506b-66d6-4616-b040-225fde095e0f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:13.997127 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:13.997078    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"
May 29 02:33:14.126946 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:14.126920    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd"]
May 29 02:33:14.128435 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:14.128411    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf69506b_66d6_4616_b040_225fde095e0f.slice/crio-34fd022bd72056b2d27d2564fe1b7c9cff520c6a33fb610f617b75b97ce4fba3 WatchSource:0}: Error finding container 34fd022bd72056b2d27d2564fe1b7c9cff520c6a33fb610f617b75b97ce4fba3: Status 404 returned error can't find the container with id 34fd022bd72056b2d27d2564fe1b7c9cff520c6a33fb610f617b75b97ce4fba3
May 29 02:33:14.965299 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:14.965259    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd" event={"ID":"bf69506b-66d6-4616-b040-225fde095e0f","Type":"ContainerStarted","Data":"34fd022bd72056b2d27d2564fe1b7c9cff520c6a33fb610f617b75b97ce4fba3"}
May 29 02:33:15.970971 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:15.970894    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd" event={"ID":"bf69506b-66d6-4616-b040-225fde095e0f","Type":"ContainerStarted","Data":"2e4281069e156374b5afd81de01bf1a2ede48efbf71a44f01634aaec7d2789df"}
May 29 02:33:15.994701 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:15.994655    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zr5jd" podStartSLOduration=1.4960806 podStartE2EDuration="2.994641906s" podCreationTimestamp="2026-05-29 02:33:13 +0000 UTC" firstStartedPulling="2026-05-29 02:33:14.130832972 +0000 UTC m=+337.820788626" lastFinishedPulling="2026-05-29 02:33:15.629394276 +0000 UTC m=+339.319349932" observedRunningTime="2026-05-29 02:33:15.992838465 +0000 UTC m=+339.682794153" watchObservedRunningTime="2026-05-29 02:33:15.994641906 +0000 UTC m=+339.684597580"
May 29 02:33:17.234674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.234642    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"]
May 29 02:33:17.237075 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.237053    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.239626 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.239605    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 02:33:17.239756 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.239648    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 02:33:17.239814 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.239766    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2sxzk\""
May 29 02:33:17.247966 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.247946    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"]
May 29 02:33:17.335512 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.335488    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.335606 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.335543    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.335606 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.335586    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2l5t\" (UniqueName: \"kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.435869 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.435841    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.435967 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.435883    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2l5t\" (UniqueName: \"kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.435967 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.435912    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.436215 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.436181    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.436270 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.436238    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.444279 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.444262    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2l5t\" (UniqueName: \"kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.545589 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.545533    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:17.669795 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.669770    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"]
May 29 02:33:17.672303 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:17.672274    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a34e256_a69d_4441_8065_ce436bb9d9a0.slice/crio-f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1 WatchSource:0}: Error finding container f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1: Status 404 returned error can't find the container with id f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1
May 29 02:33:17.978123 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.978088    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerID="7ebe38b44a6babb54c447e2ea3e2fb49a8912850851196661b26b3c8b269fa78" exitCode=0
May 29 02:33:17.978285 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.978165    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht" event={"ID":"8a34e256-a69d-4441-8065-ce436bb9d9a0","Type":"ContainerDied","Data":"7ebe38b44a6babb54c447e2ea3e2fb49a8912850851196661b26b3c8b269fa78"}
May 29 02:33:17.978285 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:17.978220    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht" event={"ID":"8a34e256-a69d-4441-8065-ce436bb9d9a0","Type":"ContainerStarted","Data":"f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1"}
May 29 02:33:20.992240 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:20.992206    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerID="eb9222be8ae91acc5fd4f3f65a4ce890c9296deb7b19674c4ce0e05ec783ed9b" exitCode=0
May 29 02:33:20.992628 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:20.992293    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht" event={"ID":"8a34e256-a69d-4441-8065-ce436bb9d9a0","Type":"ContainerDied","Data":"eb9222be8ae91acc5fd4f3f65a4ce890c9296deb7b19674c4ce0e05ec783ed9b"}
May 29 02:33:21.886246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.886209    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v5f72"]
May 29 02:33:21.888565 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.888545    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:21.891308 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.891286    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 29 02:33:21.891444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.891346    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-44zmr\""
May 29 02:33:21.891444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.891408    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 29 02:33:21.899546 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.899525    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v5f72"]
May 29 02:33:21.973040 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.973005    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vxs\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-kube-api-access-s6vxs\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:21.973248 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.973057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:21.997542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.997513    2547 generic.go:358] "Generic (PLEG): container finished" podID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerID="6ce90b0b204a1d81ce689181ded6f06c92b4eb94b48dc81e7ad94f37072f6532" exitCode=0
May 29 02:33:21.997874 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:21.997589    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht" event={"ID":"8a34e256-a69d-4441-8065-ce436bb9d9a0","Type":"ContainerDied","Data":"6ce90b0b204a1d81ce689181ded6f06c92b4eb94b48dc81e7ad94f37072f6532"}
May 29 02:33:22.073952 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.073904    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vxs\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-kube-api-access-s6vxs\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:22.074117 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.073969    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:22.082496 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.082467    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:22.082684 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.082664    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vxs\" (UniqueName: \"kubernetes.io/projected/aae2e021-93e3-4407-83ca-60280618a4ba-kube-api-access-s6vxs\") pod \"cert-manager-webhook-587ccfb98-v5f72\" (UID: \"aae2e021-93e3-4407-83ca-60280618a4ba\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:22.210606 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.210518    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:22.332550 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:22.332522    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v5f72"]
May 29 02:33:22.334433 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:22.334407    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaae2e021_93e3_4407_83ca_60280618a4ba.slice/crio-e9d7ee64004e51bbb649b1b3284ec554881ac119a157f0262a087095e780862c WatchSource:0}: Error finding container e9d7ee64004e51bbb649b1b3284ec554881ac119a157f0262a087095e780862c: Status 404 returned error can't find the container with id e9d7ee64004e51bbb649b1b3284ec554881ac119a157f0262a087095e780862c
May 29 02:33:23.006594 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.006541    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72" event={"ID":"aae2e021-93e3-4407-83ca-60280618a4ba","Type":"ContainerStarted","Data":"e9d7ee64004e51bbb649b1b3284ec554881ac119a157f0262a087095e780862c"}
May 29 02:33:23.148425 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.148397    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:23.284618 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.284544    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util\") pod \"8a34e256-a69d-4441-8065-ce436bb9d9a0\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") "
May 29 02:33:23.284618 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.284586    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle\") pod \"8a34e256-a69d-4441-8065-ce436bb9d9a0\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") "
May 29 02:33:23.284618 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.284608    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2l5t\" (UniqueName: \"kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t\") pod \"8a34e256-a69d-4441-8065-ce436bb9d9a0\" (UID: \"8a34e256-a69d-4441-8065-ce436bb9d9a0\") "
May 29 02:33:23.285145 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.285113    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle" (OuterVolumeSpecName: "bundle") pod "8a34e256-a69d-4441-8065-ce436bb9d9a0" (UID: "8a34e256-a69d-4441-8065-ce436bb9d9a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:23.286980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.286950    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t" (OuterVolumeSpecName: "kube-api-access-j2l5t") pod "8a34e256-a69d-4441-8065-ce436bb9d9a0" (UID: "8a34e256-a69d-4441-8065-ce436bb9d9a0"). InnerVolumeSpecName "kube-api-access-j2l5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:33:23.289984 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.289957    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util" (OuterVolumeSpecName: "util") pod "8a34e256-a69d-4441-8065-ce436bb9d9a0" (UID: "8a34e256-a69d-4441-8065-ce436bb9d9a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:23.385698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.385669    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:23.385698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.385699    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a34e256-a69d-4441-8065-ce436bb9d9a0-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:23.385871 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:23.385714    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2l5t\" (UniqueName: \"kubernetes.io/projected/8a34e256-a69d-4441-8065-ce436bb9d9a0-kube-api-access-j2l5t\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:24.011020 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:24.010989    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht" event={"ID":"8a34e256-a69d-4441-8065-ce436bb9d9a0","Type":"ContainerDied","Data":"f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1"}
May 29 02:33:24.011020 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:24.011012    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8znht"
May 29 02:33:24.011020 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:24.011022    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f48b92098d1c4cf65b7cc05b95e3bb8165925dc82783d49ffc95b1de17aa54d1"
May 29 02:33:25.015249 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:25.015220    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72" event={"ID":"aae2e021-93e3-4407-83ca-60280618a4ba","Type":"ContainerStarted","Data":"49de6bf5da1e56ec0e3c2ee57b2479d5454eacce6821bbbe5044a00ae43dc727"}
May 29 02:33:25.015555 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:25.015258    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:25.046857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:25.046815    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72" podStartSLOduration=1.49861699 podStartE2EDuration="4.046800201s" podCreationTimestamp="2026-05-29 02:33:21 +0000 UTC" firstStartedPulling="2026-05-29 02:33:22.336480734 +0000 UTC m=+346.026436401" lastFinishedPulling="2026-05-29 02:33:24.884663956 +0000 UTC m=+348.574619612" observedRunningTime="2026-05-29 02:33:25.044032258 +0000 UTC m=+348.733987932" watchObservedRunningTime="2026-05-29 02:33:25.046800201 +0000 UTC m=+348.736755876"
May 29 02:33:28.029440 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029408    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"]
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029701    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="pull"
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029712    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="pull"
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029732    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="extract"
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029738    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="extract"
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029746    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="util"
May 29 02:33:28.029789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029751    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="util"
May 29 02:33:28.029969 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.029801    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a34e256-a69d-4441-8065-ce436bb9d9a0" containerName="extract"
May 29 02:33:28.031804 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.031784    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.034666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.034648    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mwg7h\""
May 29 02:33:28.035509 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.035489    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 29 02:33:28.035509 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.035502    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 29 02:33:28.043924 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.043901    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"]
May 29 02:33:28.117502 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.117475    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.117625 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.117545    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hzz\" (UniqueName: \"kubernetes.io/projected/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-kube-api-access-m6hzz\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.217940 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.217909    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.218066 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.217971    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hzz\" (UniqueName: \"kubernetes.io/projected/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-kube-api-access-m6hzz\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.218295 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.218277    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.227235 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.227216    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hzz\" (UniqueName: \"kubernetes.io/projected/d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c-kube-api-access-m6hzz\") pod \"openshift-lws-operator-bfc7f696d-dqc8w\" (UID: \"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.340297 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.340236    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"
May 29 02:33:28.463745 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:28.463716    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w"]
May 29 02:33:28.467154 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:28.467125    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b6bdcd_61bf_4e8b_8d3d_61cd214f596c.slice/crio-2f092fdbd7b90ddb59b8c2c1f06eb7d0587f2559c59737939042311298897abc WatchSource:0}: Error finding container 2f092fdbd7b90ddb59b8c2c1f06eb7d0587f2559c59737939042311298897abc: Status 404 returned error can't find the container with id 2f092fdbd7b90ddb59b8c2c1f06eb7d0587f2559c59737939042311298897abc
May 29 02:33:29.028835 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:29.028797    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w" event={"ID":"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c","Type":"ContainerStarted","Data":"2f092fdbd7b90ddb59b8c2c1f06eb7d0587f2559c59737939042311298897abc"}
May 29 02:33:31.021101 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:31.021031    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v5f72"
May 29 02:33:36.053775 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:36.053734    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w" event={"ID":"d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c","Type":"ContainerStarted","Data":"e5d2dc6f666621f0fcceabddfd9a1a0814906097a1fd4c3867199d8a2ae22826"}
May 29 02:33:36.070046 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:36.069945    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqc8w" podStartSLOduration=1.079578432 podStartE2EDuration="8.069931655s" podCreationTimestamp="2026-05-29 02:33:28 +0000 UTC" firstStartedPulling="2026-05-29 02:33:28.468783464 +0000 UTC m=+352.158739117" lastFinishedPulling="2026-05-29 02:33:35.459136684 +0000 UTC m=+359.149092340" observedRunningTime="2026-05-29 02:33:36.069327053 +0000 UTC m=+359.759282729" watchObservedRunningTime="2026-05-29 02:33:36.069931655 +0000 UTC m=+359.759887332"
May 29 02:33:38.461829 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.461787    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"]
May 29 02:33:38.464488 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.464455    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.467147 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.467127    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 02:33:38.468131 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.468084    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 02:33:38.468185 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.468127    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2sxzk\""
May 29 02:33:38.474601 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.474583    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"]
May 29 02:33:38.597740 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.597716    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxcf\" (UniqueName: \"kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.597830 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.597753    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.597870 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.597852    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.698887 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.698855    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.698999 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.698903    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxcf\" (UniqueName: \"kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.698999 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.698947    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.699340 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.699318    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.699389 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.699348    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.716420 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.716347    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxcf\" (UniqueName: \"kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.773798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.773775    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:38.906981 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:38.906949    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"]
May 29 02:33:38.909378 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:38.909348    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a25c654_b002_4841_a0e6_2f1ff16c5b42.slice/crio-cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b WatchSource:0}: Error finding container cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b: Status 404 returned error can't find the container with id cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b
May 29 02:33:39.064582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:39.064558    2547 generic.go:358] "Generic (PLEG): container finished" podID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerID="da4b605d84b7b4b2bdb08962b5c71f9bdef03c14193df043030cce4b16461d45" exitCode=0
May 29 02:33:39.064692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:39.064628    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp" event={"ID":"9a25c654-b002-4841-a0e6-2f1ff16c5b42","Type":"ContainerDied","Data":"da4b605d84b7b4b2bdb08962b5c71f9bdef03c14193df043030cce4b16461d45"}
May 29 02:33:39.064692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:39.064663    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp" event={"ID":"9a25c654-b002-4841-a0e6-2f1ff16c5b42","Type":"ContainerStarted","Data":"cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b"}
May 29 02:33:41.072277 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:41.072245    2547 generic.go:358] "Generic (PLEG): container finished" podID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerID="15bee86c60324694ffc121e9ec5de69f149f10a60023d8783f5f9b9f5e806e8b" exitCode=0
May 29 02:33:41.072675 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:41.072308    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp" event={"ID":"9a25c654-b002-4841-a0e6-2f1ff16c5b42","Type":"ContainerDied","Data":"15bee86c60324694ffc121e9ec5de69f149f10a60023d8783f5f9b9f5e806e8b"}
May 29 02:33:42.077522 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:42.077490    2547 generic.go:358] "Generic (PLEG): container finished" podID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerID="b7c79bb198bfb2208ad0bd11224eb77222a56aa80c07286c3d02c8d98a244fd9" exitCode=0
May 29 02:33:42.077861 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:42.077540    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp" event={"ID":"9a25c654-b002-4841-a0e6-2f1ff16c5b42","Type":"ContainerDied","Data":"b7c79bb198bfb2208ad0bd11224eb77222a56aa80c07286c3d02c8d98a244fd9"}
May 29 02:33:43.198595 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.198575    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:43.335666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.335575    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util\") pod \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") "
May 29 02:33:43.335666 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.335622    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle\") pod \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") "
May 29 02:33:43.335855 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.335674    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjxcf\" (UniqueName: \"kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf\") pod \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\" (UID: \"9a25c654-b002-4841-a0e6-2f1ff16c5b42\") "
May 29 02:33:43.336392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.336361    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle" (OuterVolumeSpecName: "bundle") pod "9a25c654-b002-4841-a0e6-2f1ff16c5b42" (UID: "9a25c654-b002-4841-a0e6-2f1ff16c5b42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:43.337692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.337669    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf" (OuterVolumeSpecName: "kube-api-access-mjxcf") pod "9a25c654-b002-4841-a0e6-2f1ff16c5b42" (UID: "9a25c654-b002-4841-a0e6-2f1ff16c5b42"). InnerVolumeSpecName "kube-api-access-mjxcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:33:43.341033 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.341005    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util" (OuterVolumeSpecName: "util") pod "9a25c654-b002-4841-a0e6-2f1ff16c5b42" (UID: "9a25c654-b002-4841-a0e6-2f1ff16c5b42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:33:43.436698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.436665    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:43.436698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.436692    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a25c654-b002-4841-a0e6-2f1ff16c5b42-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:43.436698 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:43.436702    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjxcf\" (UniqueName: \"kubernetes.io/projected/9a25c654-b002-4841-a0e6-2f1ff16c5b42-kube-api-access-mjxcf\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:33:44.084922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:44.084888    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp" event={"ID":"9a25c654-b002-4841-a0e6-2f1ff16c5b42","Type":"ContainerDied","Data":"cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b"}
May 29 02:33:44.084922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:44.084912    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxtdpp"
May 29 02:33:44.084922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:44.084923    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb4e73ed0b4352a7b963cb138596c4fd8255d0bc1d94444d28d8aa7d23ad308b"
May 29 02:33:51.370860 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.370825    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"]
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371110    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="util"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371120    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="util"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371128    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="extract"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371134    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="extract"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371142    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="pull"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371158    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="pull"
May 29 02:33:51.371391 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.371222    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a25c654-b002-4841-a0e6-2f1ff16c5b42" containerName="extract"
May 29 02:33:51.377009 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.376994    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.379862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.379842    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kf466\""
May 29 02:33:51.380192 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.380169    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 29 02:33:51.380309 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.380236    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 29 02:33:51.380309 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.380295    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 29 02:33:51.380550 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.380533    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 29 02:33:51.387332 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.387311    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"]
May 29 02:33:51.388270 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.388249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.388362 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.388278    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhsvh\" (UniqueName: \"kubernetes.io/projected/3b08e103-05c1-444a-9343-9f6817d48c46-kube-api-access-zhsvh\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.388362 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.388309    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.388457 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.388371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.388457 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.388403    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.488857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.488823    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.488857 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.488861    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhsvh\" (UniqueName: \"kubernetes.io/projected/3b08e103-05c1-444a-9343-9f6817d48c46-kube-api-access-zhsvh\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.489073 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.488935    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.489073 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.488979    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.489073 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.489001    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.489480 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.489462    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.491432 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.491408    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b08e103-05c1-444a-9343-9f6817d48c46-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.491582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.491564    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.491582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.491576    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b08e103-05c1-444a-9343-9f6817d48c46-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.496736 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.496715    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhsvh\" (UniqueName: \"kubernetes.io/projected/3b08e103-05c1-444a-9343-9f6817d48c46-kube-api-access-zhsvh\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-p2blq\" (UID: \"3b08e103-05c1-444a-9343-9f6817d48c46\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.687218 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.687107    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:51.847310 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:51.847272    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"]
May 29 02:33:51.856543 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:33:51.854071    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b08e103_05c1_444a_9343_9f6817d48c46.slice/crio-44fbc6e4043a2f80165a3d4adf68bb42d66a96c7c7ef34adafc256e64ffbb121 WatchSource:0}: Error finding container 44fbc6e4043a2f80165a3d4adf68bb42d66a96c7c7ef34adafc256e64ffbb121: Status 404 returned error can't find the container with id 44fbc6e4043a2f80165a3d4adf68bb42d66a96c7c7ef34adafc256e64ffbb121
May 29 02:33:52.109501 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:52.109425    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq" event={"ID":"3b08e103-05c1-444a-9343-9f6817d48c46","Type":"ContainerStarted","Data":"44fbc6e4043a2f80165a3d4adf68bb42d66a96c7c7ef34adafc256e64ffbb121"}
May 29 02:33:55.121926 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:55.121892    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq" event={"ID":"3b08e103-05c1-444a-9343-9f6817d48c46","Type":"ContainerStarted","Data":"4a865a5c21e88f3be2eb35f08c31cc88f8f4a10bde016e18b03a333687439dfe"}
May 29 02:33:56.125914 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:56.125882    2547 generic.go:358] "Generic (PLEG): container finished" podID="3b08e103-05c1-444a-9343-9f6817d48c46" containerID="4a865a5c21e88f3be2eb35f08c31cc88f8f4a10bde016e18b03a333687439dfe" exitCode=0
May 29 02:33:56.126245 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:56.125931    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq" event={"ID":"3b08e103-05c1-444a-9343-9f6817d48c46","Type":"ContainerDied","Data":"4a865a5c21e88f3be2eb35f08c31cc88f8f4a10bde016e18b03a333687439dfe"}
May 29 02:33:57.130630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:57.130593    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq" event={"ID":"3b08e103-05c1-444a-9343-9f6817d48c46","Type":"ContainerStarted","Data":"25b12490152291e6196e6b74faf90b8493c50727085c2a9e50a40b604abcb9f7"}
May 29 02:33:57.130975 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:57.130714    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:33:57.160976 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:33:57.160923    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq" podStartSLOduration=1.538442906 podStartE2EDuration="6.160908787s" podCreationTimestamp="2026-05-29 02:33:51 +0000 UTC" firstStartedPulling="2026-05-29 02:33:51.857483971 +0000 UTC m=+375.547439636" lastFinishedPulling="2026-05-29 02:33:56.479949844 +0000 UTC m=+380.169905517" observedRunningTime="2026-05-29 02:33:57.158466191 +0000 UTC m=+380.848421866" watchObservedRunningTime="2026-05-29 02:33:57.160908787 +0000 UTC m=+380.850864465"
May 29 02:34:08.136408 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:08.136375    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-p2blq"
May 29 02:34:11.159685 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.159647    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-s5khr"]
May 29 02:34:11.164914 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.164891    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.167828 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.167802    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 29 02:34:11.167828 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.167807    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7mrrk\""
May 29 02:34:11.175783 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.175760    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-s5khr"]
May 29 02:34:11.236157 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.236129    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qbh\" (UniqueName: \"kubernetes.io/projected/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-kube-api-access-x4qbh\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.236305 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.236166    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.336511 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.336481    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qbh\" (UniqueName: \"kubernetes.io/projected/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-kube-api-access-x4qbh\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.336655 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.336522    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.336655 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:11.336646    2547 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 29 02:34:11.336725 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:11.336705    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert podName:33e716f6-8dcc-4fac-af8e-4ef8a9fadda2 nodeName:}" failed. No retries permitted until 2026-05-29 02:34:11.836688429 +0000 UTC m=+395.526644081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert") pod "odh-model-controller-76588b95-s5khr" (UID: "33e716f6-8dcc-4fac-af8e-4ef8a9fadda2") : secret "odh-model-controller-webhook-cert" not found
May 29 02:34:11.368582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.368554    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qbh\" (UniqueName: \"kubernetes.io/projected/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-kube-api-access-x4qbh\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.840969 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.840932    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.843246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.843223    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e716f6-8dcc-4fac-af8e-4ef8a9fadda2-cert\") pod \"odh-model-controller-76588b95-s5khr\" (UID: \"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2\") " pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:11.909917 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.909881    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vp4zw"]
May 29 02:34:11.912485 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.912465    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:11.915317 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.915296    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
May 29 02:34:11.921796 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.921773    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vp4zw"]
May 29 02:34:11.942287 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.942254    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hwc\" (UniqueName: \"kubernetes.io/projected/62701a67-4edc-41ba-8dba-6696f3bbefbf-kube-api-access-r9hwc\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:11.942400 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:11.942366    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:12.043675 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.043649    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:12.043756 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.043727    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hwc\" (UniqueName: \"kubernetes.io/projected/62701a67-4edc-41ba-8dba-6696f3bbefbf-kube-api-access-r9hwc\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:12.043796 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.043774    2547 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
May 29 02:34:12.043855 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.043844    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs podName:62701a67-4edc-41ba-8dba-6696f3bbefbf nodeName:}" failed. No retries permitted until 2026-05-29 02:34:12.54382581 +0000 UTC m=+396.233781482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs") pod "model-serving-api-6577596cd5-vp4zw" (UID: "62701a67-4edc-41ba-8dba-6696f3bbefbf") : secret "model-serving-api-tls" not found
May 29 02:34:12.052754 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.052726    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hwc\" (UniqueName: \"kubernetes.io/projected/62701a67-4edc-41ba-8dba-6696f3bbefbf-kube-api-access-r9hwc\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:12.075536 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.075519    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:12.200582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.200559    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-s5khr"]
May 29 02:34:12.202489 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:12.202465    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e716f6_8dcc_4fac_af8e_4ef8a9fadda2.slice/crio-67b565f2e6c65975b3fbbe075506c4af670e90402070fa151f9bd0bb8c6343d5 WatchSource:0}: Error finding container 67b565f2e6c65975b3fbbe075506c4af670e90402070fa151f9bd0bb8c6343d5: Status 404 returned error can't find the container with id 67b565f2e6c65975b3fbbe075506c4af670e90402070fa151f9bd0bb8c6343d5
May 29 02:34:12.410656 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.410598    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"]
May 29 02:34:12.413936 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.413918    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.417957 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.417936    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 02:34:12.417957 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.417951    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2sxzk\""
May 29 02:34:12.417957 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.417936    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 02:34:12.423384 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.423365    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"]
May 29 02:34:12.447937 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.447917    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.448036 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.447963    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.448079 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.448045    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gh8\" (UniqueName: \"kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.549447 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549416    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.549559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549453    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:12.549559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549486    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.549559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549541    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gh8\" (UniqueName: \"kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.549670 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.549568    2547 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
May 29 02:34:12.549670 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.549623    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs podName:62701a67-4edc-41ba-8dba-6696f3bbefbf nodeName:}" failed. No retries permitted until 2026-05-29 02:34:13.549607853 +0000 UTC m=+397.239563505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs") pod "model-serving-api-6577596cd5-vp4zw" (UID: "62701a67-4edc-41ba-8dba-6696f3bbefbf") : secret "model-serving-api-tls" not found
May 29 02:34:12.549862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549839    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.549862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.549854    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.558238 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.558184    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gh8\" (UniqueName: \"kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.601487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.601443    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-szg7b"]
May 29 02:34:12.604004 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.603983    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.607284 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.607249    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 29 02:34:12.607284 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.607251    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 29 02:34:12.607526 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.607337    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r8frr\""
May 29 02:34:12.607526 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.607337    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 29 02:34:12.607526 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.607399    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 29 02:34:12.614922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.614892    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-szg7b"]
May 29 02:34:12.650372 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.650321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.650372 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.650371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c74mb\" (UniqueName: \"kubernetes.io/projected/c2744b59-cce3-487e-9516-1a3eafe3de6d-kube-api-access-c74mb\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.650614 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.650502    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2744b59-cce3-487e-9516-1a3eafe3de6d-tmp\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.723417 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.723325    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:12.751583 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.751541    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.751727 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.751598    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c74mb\" (UniqueName: \"kubernetes.io/projected/c2744b59-cce3-487e-9516-1a3eafe3de6d-kube-api-access-c74mb\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.751727 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.751687    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2744b59-cce3-487e-9516-1a3eafe3de6d-tmp\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.751727 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.751708    2547 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 29 02:34:12.751886 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:12.751790    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs podName:c2744b59-cce3-487e-9516-1a3eafe3de6d nodeName:}" failed. No retries permitted until 2026-05-29 02:34:13.251766882 +0000 UTC m=+396.941722552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs") pod "kube-auth-proxy-79cf786587-szg7b" (UID: "c2744b59-cce3-487e-9516-1a3eafe3de6d") : secret "kube-auth-proxy-tls" not found
May 29 02:34:12.754609 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.754567    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2744b59-cce3-487e-9516-1a3eafe3de6d-tmp\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.761286 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.761260    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c74mb\" (UniqueName: \"kubernetes.io/projected/c2744b59-cce3-487e-9516-1a3eafe3de6d-kube-api-access-c74mb\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:12.866633 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:12.866325    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"]
May 29 02:34:12.870643 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:12.870608    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63640f7_25ad_4d31_9396_551af2372f8e.slice/crio-786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef WatchSource:0}: Error finding container 786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef: Status 404 returned error can't find the container with id 786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef
May 29 02:34:13.185806 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.185755    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-s5khr" event={"ID":"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2","Type":"ContainerStarted","Data":"67b565f2e6c65975b3fbbe075506c4af670e90402070fa151f9bd0bb8c6343d5"}
May 29 02:34:13.187681 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.187650    2547 generic.go:358] "Generic (PLEG): container finished" podID="a63640f7-25ad-4d31-9396-551af2372f8e" containerID="968015d252372830a56c8b3a586f3223aab46764817ba7508165c34b489b28b8" exitCode=0
May 29 02:34:13.187798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.187705    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd" event={"ID":"a63640f7-25ad-4d31-9396-551af2372f8e","Type":"ContainerDied","Data":"968015d252372830a56c8b3a586f3223aab46764817ba7508165c34b489b28b8"}
May 29 02:34:13.187798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.187731    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd" event={"ID":"a63640f7-25ad-4d31-9396-551af2372f8e","Type":"ContainerStarted","Data":"786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef"}
May 29 02:34:13.257699 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.257551    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:13.260219 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.260174    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2744b59-cce3-487e-9516-1a3eafe3de6d-tls-certs\") pod \"kube-auth-proxy-79cf786587-szg7b\" (UID: \"c2744b59-cce3-487e-9516-1a3eafe3de6d\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:13.516692 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.516664    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b"
May 29 02:34:13.560934 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.560885    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:13.564015 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.563992    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62701a67-4edc-41ba-8dba-6696f3bbefbf-tls-certs\") pod \"model-serving-api-6577596cd5-vp4zw\" (UID: \"62701a67-4edc-41ba-8dba-6696f3bbefbf\") " pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:13.723772 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:13.723725    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:14.143059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:14.143029    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-szg7b"]
May 29 02:34:14.163891 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:14.163866    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vp4zw"]
May 29 02:34:14.182897 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:14.182866    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2744b59_cce3_487e_9516_1a3eafe3de6d.slice/crio-2a33033761acb0ef48bbb16becfcec6adb220ea7499137c5505a1b1186b4e637 WatchSource:0}: Error finding container 2a33033761acb0ef48bbb16becfcec6adb220ea7499137c5505a1b1186b4e637: Status 404 returned error can't find the container with id 2a33033761acb0ef48bbb16becfcec6adb220ea7499137c5505a1b1186b4e637
May 29 02:34:14.183695 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:14.183676    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62701a67_4edc_41ba_8dba_6696f3bbefbf.slice/crio-923d7b666bee5d7277b71e36f1aafb1ee212e30613493d3756b1ab47ede21d23 WatchSource:0}: Error finding container 923d7b666bee5d7277b71e36f1aafb1ee212e30613493d3756b1ab47ede21d23: Status 404 returned error can't find the container with id 923d7b666bee5d7277b71e36f1aafb1ee212e30613493d3756b1ab47ede21d23
May 29 02:34:14.193079 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:14.193035    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-vp4zw" event={"ID":"62701a67-4edc-41ba-8dba-6696f3bbefbf","Type":"ContainerStarted","Data":"923d7b666bee5d7277b71e36f1aafb1ee212e30613493d3756b1ab47ede21d23"}
May 29 02:34:14.194356 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:14.194328    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b" event={"ID":"c2744b59-cce3-487e-9516-1a3eafe3de6d","Type":"ContainerStarted","Data":"2a33033761acb0ef48bbb16becfcec6adb220ea7499137c5505a1b1186b4e637"}
May 29 02:34:15.202218 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:15.202106    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-s5khr" event={"ID":"33e716f6-8dcc-4fac-af8e-4ef8a9fadda2","Type":"ContainerStarted","Data":"fa01eece41f177f1d1b1210e6849a695ed1c55ea1f54cf6bf17ecf4fcf6bf30e"}
May 29 02:34:15.202651 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:15.202374    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:15.205010 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:15.204982    2547 generic.go:358] "Generic (PLEG): container finished" podID="a63640f7-25ad-4d31-9396-551af2372f8e" containerID="41f5b6852e8d9cb11551e1b69ffebb3ba94330adb5956b80dd10b16de0c0a650" exitCode=0
May 29 02:34:15.205130 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:15.205045    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd" event={"ID":"a63640f7-25ad-4d31-9396-551af2372f8e","Type":"ContainerDied","Data":"41f5b6852e8d9cb11551e1b69ffebb3ba94330adb5956b80dd10b16de0c0a650"}
May 29 02:34:15.223690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:15.223381    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-s5khr" podStartSLOduration=1.5494220570000001 podStartE2EDuration="4.223364005s" podCreationTimestamp="2026-05-29 02:34:11 +0000 UTC" firstStartedPulling="2026-05-29 02:34:12.203690371 +0000 UTC m=+395.893646024" lastFinishedPulling="2026-05-29 02:34:14.877632319 +0000 UTC m=+398.567587972" observedRunningTime="2026-05-29 02:34:15.220021424 +0000 UTC m=+398.909977099" watchObservedRunningTime="2026-05-29 02:34:15.223364005 +0000 UTC m=+398.913319681"
May 29 02:34:16.225125 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:16.225071    2547 generic.go:358] "Generic (PLEG): container finished" podID="a63640f7-25ad-4d31-9396-551af2372f8e" containerID="63460ca190fb1583fc889a45b629df2097133e5b9006e936078856d9d1c74950" exitCode=0
May 29 02:34:16.225792 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:16.225768    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd" event={"ID":"a63640f7-25ad-4d31-9396-551af2372f8e","Type":"ContainerDied","Data":"63460ca190fb1583fc889a45b629df2097133e5b9006e936078856d9d1c74950"}
May 29 02:34:17.754995 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.754965    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:17.801322 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.801291    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle\") pod \"a63640f7-25ad-4d31-9396-551af2372f8e\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") "
May 29 02:34:17.801496 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.801338    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util\") pod \"a63640f7-25ad-4d31-9396-551af2372f8e\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") "
May 29 02:34:17.801496 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.801364    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7gh8\" (UniqueName: \"kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8\") pod \"a63640f7-25ad-4d31-9396-551af2372f8e\" (UID: \"a63640f7-25ad-4d31-9396-551af2372f8e\") "
May 29 02:34:17.802466 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.802432    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle" (OuterVolumeSpecName: "bundle") pod "a63640f7-25ad-4d31-9396-551af2372f8e" (UID: "a63640f7-25ad-4d31-9396-551af2372f8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:34:17.803675 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.803647    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8" (OuterVolumeSpecName: "kube-api-access-j7gh8") pod "a63640f7-25ad-4d31-9396-551af2372f8e" (UID: "a63640f7-25ad-4d31-9396-551af2372f8e"). InnerVolumeSpecName "kube-api-access-j7gh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:34:17.806720 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.806695    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util" (OuterVolumeSpecName: "util") pod "a63640f7-25ad-4d31-9396-551af2372f8e" (UID: "a63640f7-25ad-4d31-9396-551af2372f8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:34:17.902764 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.902731    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:17.902764 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.902757    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a63640f7-25ad-4d31-9396-551af2372f8e-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:17.902764 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:17.902767    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7gh8\" (UniqueName: \"kubernetes.io/projected/a63640f7-25ad-4d31-9396-551af2372f8e-kube-api-access-j7gh8\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:18.234043 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.234014    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd"
May 29 02:34:18.234245 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.234008    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbfsd" event={"ID":"a63640f7-25ad-4d31-9396-551af2372f8e","Type":"ContainerDied","Data":"786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef"}
May 29 02:34:18.234245 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.234124    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="786e6d8c3200d48f98e541c28aae8f82a5f4f64a5b306fd53147ccf8858afdef"
May 29 02:34:18.235390 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.235363    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-vp4zw" event={"ID":"62701a67-4edc-41ba-8dba-6696f3bbefbf","Type":"ContainerStarted","Data":"5f0ab0e1b60d7f0c7c4e8288b58295eace1d5d591363fc4f9b368ca05fd4a09f"}
May 29 02:34:18.235518 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.235490    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:18.236660 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.236635    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b" event={"ID":"c2744b59-cce3-487e-9516-1a3eafe3de6d","Type":"ContainerStarted","Data":"38c8cbf0b7725009cb99da824c54f4b5077b6b74e761a78037a7bdcb34dee16f"}
May 29 02:34:18.259486 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.259440    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-vp4zw" podStartSLOduration=3.68314418 podStartE2EDuration="7.259426648s" podCreationTimestamp="2026-05-29 02:34:11 +0000 UTC" firstStartedPulling="2026-05-29 02:34:14.185635448 +0000 UTC m=+397.875591100" lastFinishedPulling="2026-05-29 02:34:17.76191791 +0000 UTC m=+401.451873568" observedRunningTime="2026-05-29 02:34:18.258137815 +0000 UTC m=+401.948093491" watchObservedRunningTime="2026-05-29 02:34:18.259426648 +0000 UTC m=+401.949382324"
May 29 02:34:18.286781 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:18.286747    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79cf786587-szg7b" podStartSLOduration=2.700367746 podStartE2EDuration="6.286737122s" podCreationTimestamp="2026-05-29 02:34:12 +0000 UTC" firstStartedPulling="2026-05-29 02:34:14.185016495 +0000 UTC m=+397.874972147" lastFinishedPulling="2026-05-29 02:34:17.771385871 +0000 UTC m=+401.461341523" observedRunningTime="2026-05-29 02:34:18.28503021 +0000 UTC m=+401.974985885" watchObservedRunningTime="2026-05-29 02:34:18.286737122 +0000 UTC m=+401.976692796"
May 29 02:34:22.193899 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.193845    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"]
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194339    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="extract"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194356    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="extract"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194369    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="pull"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194374    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="pull"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194388    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="util"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194395    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="util"
May 29 02:34:22.194517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.194478    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a63640f7-25ad-4d31-9396-551af2372f8e" containerName="extract"
May 29 02:34:22.197174 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.197139    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.198105 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.198070    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"]
May 29 02:34:22.200608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.200579    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 29 02:34:22.200801 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.200763    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dvjt4\""
May 29 02:34:22.200994 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.200972    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.207920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.207888    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
May 29 02:34:22.208358 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.207976    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lqzsr\""
May 29 02:34:22.212554 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.212520    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"]
May 29 02:34:22.216037 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.215998    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"]
May 29 02:34:22.338973 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.338938    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8kzg\" (UniqueName: \"kubernetes.io/projected/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-kube-api-access-d8kzg\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.339163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.339008    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.339163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.339064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jx8b\" (UniqueName: \"kubernetes.io/projected/42ff4f6e-0224-4c3d-a78c-2c7117735c29-kube-api-access-6jx8b\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.339163 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.339123    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.440005 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.439962    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jx8b\" (UniqueName: \"kubernetes.io/projected/42ff4f6e-0224-4c3d-a78c-2c7117735c29-kube-api-access-6jx8b\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.440005 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.440008    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.440293 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.440034    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8kzg\" (UniqueName: \"kubernetes.io/projected/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-kube-api-access-d8kzg\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.440293 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.440063    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.440293 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:22.440162    2547 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
May 29 02:34:22.440293 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:34:22.440251    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert podName:42ff4f6e-0224-4c3d-a78c-2c7117735c29 nodeName:}" failed. No retries permitted until 2026-05-29 02:34:22.940228073 +0000 UTC m=+406.630183739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert") pod "llmisvc-controller-manager-c6b9847d7-f5567" (UID: "42ff4f6e-0224-4c3d-a78c-2c7117735c29") : secret "llmisvc-webhook-server-cert" not found
May 29 02:34:22.442631 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.442613    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.452318 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.452265    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jx8b\" (UniqueName: \"kubernetes.io/projected/42ff4f6e-0224-4c3d-a78c-2c7117735c29-kube-api-access-6jx8b\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.458685 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.458667    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8kzg\" (UniqueName: \"kubernetes.io/projected/f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5-kube-api-access-d8kzg\") pod \"kserve-controller-manager-7c99ffcdcd-dgjw6\" (UID: \"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.512823 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.512778    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:22.641040 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.641014    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"]
May 29 02:34:22.642546 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:22.642514    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ed2e85_37cf_4b4d_b9e1_1cb624838cc5.slice/crio-b8a1e335be33875a01f97bf5d18500409335af6c65664722c31940d186529e88 WatchSource:0}: Error finding container b8a1e335be33875a01f97bf5d18500409335af6c65664722c31940d186529e88: Status 404 returned error can't find the container with id b8a1e335be33875a01f97bf5d18500409335af6c65664722c31940d186529e88
May 29 02:34:22.944475 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.944425    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:22.946911 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:22.946873    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ff4f6e-0224-4c3d-a78c-2c7117735c29-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f5567\" (UID: \"42ff4f6e-0224-4c3d-a78c-2c7117735c29\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:23.121034 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:23.121002    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:23.255260 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:23.255226    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6" event={"ID":"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5","Type":"ContainerStarted","Data":"b8a1e335be33875a01f97bf5d18500409335af6c65664722c31940d186529e88"}
May 29 02:34:23.258397 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:23.258378    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"]
May 29 02:34:23.259975 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:23.259948    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42ff4f6e_0224_4c3d_a78c_2c7117735c29.slice/crio-10c2279a24954e0713e9f574611c3f4809d17be05f199146055e1746160f960a WatchSource:0}: Error finding container 10c2279a24954e0713e9f574611c3f4809d17be05f199146055e1746160f960a: Status 404 returned error can't find the container with id 10c2279a24954e0713e9f574611c3f4809d17be05f199146055e1746160f960a
May 29 02:34:24.259809 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:24.259776    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567" event={"ID":"42ff4f6e-0224-4c3d-a78c-2c7117735c29","Type":"ContainerStarted","Data":"10c2279a24954e0713e9f574611c3f4809d17be05f199146055e1746160f960a"}
May 29 02:34:26.228674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:26.228641    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-s5khr"
May 29 02:34:27.274980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.274935    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6" event={"ID":"f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5","Type":"ContainerStarted","Data":"1ff9e4ad5daa27bc1ee3c70f055837cd9ac4dc4e6e42815d8b83354434fbe386"}
May 29 02:34:27.275415 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.275037    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:34:27.276282 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.276253    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567" event={"ID":"42ff4f6e-0224-4c3d-a78c-2c7117735c29","Type":"ContainerStarted","Data":"82854e6849013efb3a863114927598421a3ddea15285ca2b7a589e7dbcc2879a"}
May 29 02:34:27.276442 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.276425    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:27.372881 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.372840    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6" podStartSLOduration=1.672463675 podStartE2EDuration="5.372829687s" podCreationTimestamp="2026-05-29 02:34:22 +0000 UTC" firstStartedPulling="2026-05-29 02:34:22.643822279 +0000 UTC m=+406.333777933" lastFinishedPulling="2026-05-29 02:34:26.344188277 +0000 UTC m=+410.034143945" observedRunningTime="2026-05-29 02:34:27.36047574 +0000 UTC m=+411.050431415" watchObservedRunningTime="2026-05-29 02:34:27.372829687 +0000 UTC m=+411.062785360"
May 29 02:34:27.374467 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.374449    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"]
May 29 02:34:27.377118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.377103    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.380424 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.380407    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 29 02:34:27.384389 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.384372    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2sxzk\""
May 29 02:34:27.384543 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.384525    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 29 02:34:27.396409 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.396386    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"]
May 29 02:34:27.416686 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.416648    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567" podStartSLOduration=2.33023142 podStartE2EDuration="5.416637621s" podCreationTimestamp="2026-05-29 02:34:22 +0000 UTC" firstStartedPulling="2026-05-29 02:34:23.261128617 +0000 UTC m=+406.951084270" lastFinishedPulling="2026-05-29 02:34:26.347534812 +0000 UTC m=+410.037490471" observedRunningTime="2026-05-29 02:34:27.413936962 +0000 UTC m=+411.103892636" watchObservedRunningTime="2026-05-29 02:34:27.416637621 +0000 UTC m=+411.106593296"
May 29 02:34:27.486232 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.486187    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.486327 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.486255    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.486327 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.486288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkklg\" (UniqueName: \"kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.587099 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.587030    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkklg\" (UniqueName: \"kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.587099 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.587080    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.587260 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.587111    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.587438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.587423    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.587515 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.587497    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.600885 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.600863    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkklg\" (UniqueName: \"kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.686823 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.686789    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:27.882924 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:27.882895    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"]
May 29 02:34:27.887728 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:27.887701    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50baf08e_458b_45da_ab53_9b4a663b0016.slice/crio-91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1 WatchSource:0}: Error finding container 91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1: Status 404 returned error can't find the container with id 91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1
May 29 02:34:28.281295 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.281182    2547 generic.go:358] "Generic (PLEG): container finished" podID="50baf08e-458b-45da-ab53-9b4a663b0016" containerID="f2f5b8023518e59552d166daf7a1dd5505e49df0a02b6c6eedd0789b8a0f87a1" exitCode=0
May 29 02:34:28.281295 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.281228    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s" event={"ID":"50baf08e-458b-45da-ab53-9b4a663b0016","Type":"ContainerDied","Data":"f2f5b8023518e59552d166daf7a1dd5505e49df0a02b6c6eedd0789b8a0f87a1"}
May 29 02:34:28.281295 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.281270    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s" event={"ID":"50baf08e-458b-45da-ab53-9b4a663b0016","Type":"ContainerStarted","Data":"91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1"}
May 29 02:34:28.818810 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.818778    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-55b468f665-f4fvq"]
May 29 02:34:28.821398 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.821379    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:28.857874 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.857802    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
May 29 02:34:28.857980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.857966    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7nqz7\""
May 29 02:34:28.898266 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.898242    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l4xx\" (UniqueName: \"kubernetes.io/projected/85cf0541-617f-42d2-b97f-2091153f15fa-kube-api-access-7l4xx\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:28.898354 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.898298    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85cf0541-617f-42d2-b97f-2091153f15fa-redirect-config\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:28.923344 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.923172    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55b468f665-f4fvq"]
May 29 02:34:28.999351 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.999318    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7l4xx\" (UniqueName: \"kubernetes.io/projected/85cf0541-617f-42d2-b97f-2091153f15fa-kube-api-access-7l4xx\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:28.999517 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:28.999390    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85cf0541-617f-42d2-b97f-2091153f15fa-redirect-config\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:29.000094 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.000074    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85cf0541-617f-42d2-b97f-2091153f15fa-redirect-config\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:29.051916 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.051885    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l4xx\" (UniqueName: \"kubernetes.io/projected/85cf0541-617f-42d2-b97f-2091153f15fa-kube-api-access-7l4xx\") pod \"dashboard-redirect-55b468f665-f4fvq\" (UID: \"85cf0541-617f-42d2-b97f-2091153f15fa\") " pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:29.131098 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.131075    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55b468f665-f4fvq"
May 29 02:34:29.244984 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.244957    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-vp4zw"
May 29 02:34:29.281729 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.281700    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55b468f665-f4fvq"]
May 29 02:34:29.284611 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:29.284581    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cf0541_617f_42d2_b97f_2091153f15fa.slice/crio-2fcce25e153718626e99b9a57f8818096fe26ff306d86d44901770044a60c754 WatchSource:0}: Error finding container 2fcce25e153718626e99b9a57f8818096fe26ff306d86d44901770044a60c754: Status 404 returned error can't find the container with id 2fcce25e153718626e99b9a57f8818096fe26ff306d86d44901770044a60c754
May 29 02:34:29.286559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.286534    2547 generic.go:358] "Generic (PLEG): container finished" podID="50baf08e-458b-45da-ab53-9b4a663b0016" containerID="122fbe0a669ec64d02b38880ba1f2d1c7e47cc74a747114f27dc574b479b0f55" exitCode=0
May 29 02:34:29.286635 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.286614    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s" event={"ID":"50baf08e-458b-45da-ab53-9b4a663b0016","Type":"ContainerDied","Data":"122fbe0a669ec64d02b38880ba1f2d1c7e47cc74a747114f27dc574b479b0f55"}
May 29 02:34:29.595874 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.595842    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"]
May 29 02:34:29.598240 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.598225    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.601293 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.601263    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 29 02:34:29.601293 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.601265    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 29 02:34:29.601490 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.601359    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8qgzs\""
May 29 02:34:29.617630 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.617608    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"]
May 29 02:34:29.704629 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.704598    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjp5x\" (UniqueName: \"kubernetes.io/projected/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-kube-api-access-bjp5x\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.704778 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.704645    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.805845 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.805758    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjp5x\" (UniqueName: \"kubernetes.io/projected/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-kube-api-access-bjp5x\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.805845 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.805807    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.808250 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.808219    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.830259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.830228    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjp5x\" (UniqueName: \"kubernetes.io/projected/8f7f7805-9b8f-402b-8c2a-e07ba098e8c7-kube-api-access-bjp5x\") pod \"servicemesh-operator3-55f49c5f94-xdvcv\" (UID: \"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:29.914662 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:29.914633    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:30.089003 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:30.088921    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"]
May 29 02:34:30.095106 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:30.095007    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7f7805_9b8f_402b_8c2a_e07ba098e8c7.slice/crio-68a90ea7c18e968db52a8c4dedb0e9273fdb0c1ce3e5dbc63eba415c2954e0ff WatchSource:0}: Error finding container 68a90ea7c18e968db52a8c4dedb0e9273fdb0c1ce3e5dbc63eba415c2954e0ff: Status 404 returned error can't find the container with id 68a90ea7c18e968db52a8c4dedb0e9273fdb0c1ce3e5dbc63eba415c2954e0ff
May 29 02:34:30.296507 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:30.296467    2547 generic.go:358] "Generic (PLEG): container finished" podID="50baf08e-458b-45da-ab53-9b4a663b0016" containerID="7d952c84be7e15c444cb80c34327ed1b5a55b88c8175bef141212515d1d812ef" exitCode=0
May 29 02:34:30.296950 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:30.296567    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s" event={"ID":"50baf08e-458b-45da-ab53-9b4a663b0016","Type":"ContainerDied","Data":"7d952c84be7e15c444cb80c34327ed1b5a55b88c8175bef141212515d1d812ef"}
May 29 02:34:30.298574 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:30.298514    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv" event={"ID":"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7","Type":"ContainerStarted","Data":"68a90ea7c18e968db52a8c4dedb0e9273fdb0c1ce3e5dbc63eba415c2954e0ff"}
May 29 02:34:30.299729 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:30.299705    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55b468f665-f4fvq" event={"ID":"85cf0541-617f-42d2-b97f-2091153f15fa","Type":"ContainerStarted","Data":"2fcce25e153718626e99b9a57f8818096fe26ff306d86d44901770044a60c754"}
May 29 02:34:31.467700 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.467578    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:31.622798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.622769    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle\") pod \"50baf08e-458b-45da-ab53-9b4a663b0016\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") "
May 29 02:34:31.622969 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.622856    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkklg\" (UniqueName: \"kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg\") pod \"50baf08e-458b-45da-ab53-9b4a663b0016\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") "
May 29 02:34:31.622969 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.622892    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util\") pod \"50baf08e-458b-45da-ab53-9b4a663b0016\" (UID: \"50baf08e-458b-45da-ab53-9b4a663b0016\") "
May 29 02:34:31.624169 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.624127    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle" (OuterVolumeSpecName: "bundle") pod "50baf08e-458b-45da-ab53-9b4a663b0016" (UID: "50baf08e-458b-45da-ab53-9b4a663b0016"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:34:31.625513 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.625486    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg" (OuterVolumeSpecName: "kube-api-access-mkklg") pod "50baf08e-458b-45da-ab53-9b4a663b0016" (UID: "50baf08e-458b-45da-ab53-9b4a663b0016"). InnerVolumeSpecName "kube-api-access-mkklg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:34:31.630468 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.630443    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util" (OuterVolumeSpecName: "util") pod "50baf08e-458b-45da-ab53-9b4a663b0016" (UID: "50baf08e-458b-45da-ab53-9b4a663b0016"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:34:31.724379 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.724345    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:31.724516 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.724381    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkklg\" (UniqueName: \"kubernetes.io/projected/50baf08e-458b-45da-ab53-9b4a663b0016-kube-api-access-mkklg\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:31.724516 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:31.724399    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50baf08e-458b-45da-ab53-9b4a663b0016-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:34:32.311110 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:32.311076    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s" event={"ID":"50baf08e-458b-45da-ab53-9b4a663b0016","Type":"ContainerDied","Data":"91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1"}
May 29 02:34:32.311110 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:32.311113    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91627b34c5383343e3bb1596b623152e917dfe0f2f513a7fddc2cdcdbafe5ba1"
May 29 02:34:32.311359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:32.311187    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aq486s"
May 29 02:34:35.325555 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:35.325457    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv" event={"ID":"8f7f7805-9b8f-402b-8c2a-e07ba098e8c7","Type":"ContainerStarted","Data":"48554a5512d24999aec42e04a8f6162f0e1865021a6a46bb70c4ff88570b132b"}
May 29 02:34:35.326006 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:35.325594    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:35.326914 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:35.326893    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55b468f665-f4fvq" event={"ID":"85cf0541-617f-42d2-b97f-2091153f15fa","Type":"ContainerStarted","Data":"7f915f2f1c91c260e640ad8dd883fed1b699b404f796fb0855f927ce4749dfdd"}
May 29 02:34:35.395434 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:35.395392    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv" podStartSLOduration=1.515693113 podStartE2EDuration="6.395378595s" podCreationTimestamp="2026-05-29 02:34:29 +0000 UTC" firstStartedPulling="2026-05-29 02:34:30.099388267 +0000 UTC m=+413.789343936" lastFinishedPulling="2026-05-29 02:34:34.979073751 +0000 UTC m=+418.669029418" observedRunningTime="2026-05-29 02:34:35.366821928 +0000 UTC m=+419.056777603" watchObservedRunningTime="2026-05-29 02:34:35.395378595 +0000 UTC m=+419.085334271"
May 29 02:34:35.395888 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:35.395860    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-55b468f665-f4fvq" podStartSLOduration=1.6829539310000001 podStartE2EDuration="7.395852875s" podCreationTimestamp="2026-05-29 02:34:28 +0000 UTC" firstStartedPulling="2026-05-29 02:34:29.285779736 +0000 UTC m=+412.975735389" lastFinishedPulling="2026-05-29 02:34:34.998678666 +0000 UTC m=+418.688634333" observedRunningTime="2026-05-29 02:34:35.393435363 +0000 UTC m=+419.083391155" watchObservedRunningTime="2026-05-29 02:34:35.395852875 +0000 UTC m=+419.085808549"
May 29 02:34:46.333118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.333085    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xdvcv"
May 29 02:34:46.504709 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.504674    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"]
May 29 02:34:46.505016 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505004    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="util"
May 29 02:34:46.505059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505018    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="util"
May 29 02:34:46.505059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505031    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="extract"
May 29 02:34:46.505059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505036    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="extract"
May 29 02:34:46.505059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505044    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="pull"
May 29 02:34:46.505059 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505049    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="pull"
May 29 02:34:46.505229 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.505107    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="50baf08e-458b-45da-ab53-9b4a663b0016" containerName="extract"
May 29 02:34:46.509616 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.509598    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.512914 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.512892    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 29 02:34:46.513221 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.513192    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 29 02:34:46.513557 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.513545    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dbdsk\""
May 29 02:34:46.513710 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.513686    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 29 02:34:46.513941 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.513926    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 29 02:34:46.542429 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.542404    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"]
May 29 02:34:46.561994 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.561970    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562089 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562012    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562089 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562053    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562167 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562091    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562167 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562137    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvdv8\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-kube-api-access-cvdv8\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562167 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562155    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c43041-7cfa-48c2-97be-0f2273d4dc26-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.562286 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.562217    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663424    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663553 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663465    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdv8\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-kube-api-access-cvdv8\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663553 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663484    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c43041-7cfa-48c2-97be-0f2273d4dc26-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663553 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663512    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663669 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663553    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663669 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663603    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.663669 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.663636    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.664101 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.664078    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.666057 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.666037    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.666148 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.666085    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94c43041-7cfa-48c2-97be-0f2273d4dc26-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.666148 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.666124    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.666274 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.666157    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.671701 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.671681    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.671985 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.671968    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvdv8\" (UniqueName: \"kubernetes.io/projected/94c43041-7cfa-48c2-97be-0f2273d4dc26-kube-api-access-cvdv8\") pod \"istiod-openshift-gateway-798958bb55-hf4wf\" (UID: \"94c43041-7cfa-48c2-97be-0f2273d4dc26\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.821813 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.821783    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:46.971490 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:46.971461    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"]
May 29 02:34:46.973082 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:34:46.973050    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c43041_7cfa_48c2_97be_0f2273d4dc26.slice/crio-bbf420878ed14378c79ed2d554037a92d919b4c1e59f3aecb97e451b878e2da1 WatchSource:0}: Error finding container bbf420878ed14378c79ed2d554037a92d919b4c1e59f3aecb97e451b878e2da1: Status 404 returned error can't find the container with id bbf420878ed14378c79ed2d554037a92d919b4c1e59f3aecb97e451b878e2da1
May 29 02:34:47.369456 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:47.369427    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf" event={"ID":"94c43041-7cfa-48c2-97be-0f2273d4dc26","Type":"ContainerStarted","Data":"bbf420878ed14378c79ed2d554037a92d919b4c1e59f3aecb97e451b878e2da1"}
May 29 02:34:50.111035 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:50.110989    2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 29 02:34:50.111389 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:50.111063    2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 29 02:34:50.386165 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:50.386134    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf" event={"ID":"94c43041-7cfa-48c2-97be-0f2273d4dc26","Type":"ContainerStarted","Data":"88b5766f7aa3e9cd1d309026e57009336cc0253d934417dae5ac24b85ae4c437"}
May 29 02:34:50.386449 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:50.386345    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:50.411164 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:50.411095    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf" podStartSLOduration=1.2769394059999999 podStartE2EDuration="4.411080025s" podCreationTimestamp="2026-05-29 02:34:46 +0000 UTC" firstStartedPulling="2026-05-29 02:34:46.976606997 +0000 UTC m=+430.666562663" lastFinishedPulling="2026-05-29 02:34:50.110747626 +0000 UTC m=+433.800703282" observedRunningTime="2026-05-29 02:34:50.41022742 +0000 UTC m=+434.100183096" watchObservedRunningTime="2026-05-29 02:34:50.411080025 +0000 UTC m=+434.101035702"
May 29 02:34:51.391846 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:51.391814    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hf4wf"
May 29 02:34:58.283496 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:58.283414    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f5567"
May 29 02:34:58.286597 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:34:58.286572    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dgjw6"
May 29 02:35:27.809590 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.809551    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"]
May 29 02:35:27.813496 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.813477    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.816132 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.816107    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 02:35:27.816951 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.816933    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 02:35:27.817044 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.816956    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5vts\""
May 29 02:35:27.822775 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.822751    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"]
May 29 02:35:27.896392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.896357    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.896567 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.896407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tczwd\" (UniqueName: \"kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.896567 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.896427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.997495 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.997468    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.997633 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.997510    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tczwd\" (UniqueName: \"kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.997633 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.997540    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.997946 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.997924    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:27.997990 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:27.997958    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:28.007427 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.007400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tczwd\" (UniqueName: \"kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:28.124005 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.123982    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:28.210146 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.210112    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"]
May 29 02:35:28.216877 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.216846    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.221257 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.221149    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"]
May 29 02:35:28.261260 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.261186    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"]
May 29 02:35:28.263765 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:35:28.263732    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95aca2e_9273_4d8c_9fae_c406abe36f96.slice/crio-76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14 WatchSource:0}: Error finding container 76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14: Status 404 returned error can't find the container with id 76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14
May 29 02:35:28.299048 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.299023    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.299176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.299064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.299176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.299081    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdhv\" (UniqueName: \"kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.399679 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.399614    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.399679 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.399658    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.399679 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.399677    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdhv\" (UniqueName: \"kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.399991 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.399968    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.400029 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.399996    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.409597 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.409574    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdhv\" (UniqueName: \"kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.530118 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.530096    2547 generic.go:358] "Generic (PLEG): container finished" podID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerID="bdd818f807177a8f766f6a2ac9a37dbc1c8ecc36417563a8ca8df66b52c03e7e" exitCode=0
May 29 02:35:28.530246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.530127    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7" event={"ID":"e95aca2e-9273-4d8c-9fae-c406abe36f96","Type":"ContainerDied","Data":"bdd818f807177a8f766f6a2ac9a37dbc1c8ecc36417563a8ca8df66b52c03e7e"}
May 29 02:35:28.530246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.530149    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7" event={"ID":"e95aca2e-9273-4d8c-9fae-c406abe36f96","Type":"ContainerStarted","Data":"76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14"}
May 29 02:35:28.530387 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.530370    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:28.610469 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.610322    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"]
May 29 02:35:28.615719 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.615692    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.622691 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.622666    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"]
May 29 02:35:28.663646 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.663616    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"]
May 29 02:35:28.666007 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:35:28.665981    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575698ca_0f51_447e_9e82_b85c9ca00302.slice/crio-bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c WatchSource:0}: Error finding container bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c: Status 404 returned error can't find the container with id bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c
May 29 02:35:28.703082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.703061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48x25\" (UniqueName: \"kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.703185 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.703107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.703185 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.703122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.803990 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.803960    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48x25\" (UniqueName: \"kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.804092 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.804002    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.804092 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.804021    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.804334 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.804319    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.804402 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.804384    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.813166 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.813147    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48x25\" (UniqueName: \"kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:28.928393 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:28.928341    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:29.005444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.005419    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"]
May 29 02:35:29.010753 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.010727    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.022356 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.022293    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"]
May 29 02:35:29.061783 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.061760    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"]
May 29 02:35:29.063534 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:35:29.063503    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39bcd756_78d0_4b36_8753_2197dee2a286.slice/crio-64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910 WatchSource:0}: Error finding container 64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910: Status 404 returned error can't find the container with id 64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910
May 29 02:35:29.106265 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.106237    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcp6s\" (UniqueName: \"kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.106362 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.106292    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.106426 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.106412    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.207568 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.207513    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.207568 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.207559    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcp6s\" (UniqueName: \"kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.207744 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.207579    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.207904 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.207882    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.207962 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.207901    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.217537 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.217518    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcp6s\" (UniqueName: \"kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.336925 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.336891    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:29.467686 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.467650    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"]
May 29 02:35:29.469080 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:35:29.469053    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51f43b6_8903_44de_875f_9024bacf1c13.slice/crio-85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c WatchSource:0}: Error finding container 85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c: Status 404 returned error can't find the container with id 85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c
May 29 02:35:29.535264 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.535238    2547 generic.go:358] "Generic (PLEG): container finished" podID="39bcd756-78d0-4b36-8753-2197dee2a286" containerID="62b2345c8e42cc520a0e5de43931132e103b2910c7ac39501605abed2b048282" exitCode=0
May 29 02:35:29.535380 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.535286    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv" event={"ID":"39bcd756-78d0-4b36-8753-2197dee2a286","Type":"ContainerDied","Data":"62b2345c8e42cc520a0e5de43931132e103b2910c7ac39501605abed2b048282"}
May 29 02:35:29.535380 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.535320    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv" event={"ID":"39bcd756-78d0-4b36-8753-2197dee2a286","Type":"ContainerStarted","Data":"64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910"}
May 29 02:35:29.536794 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.536769    2547 generic.go:358] "Generic (PLEG): container finished" podID="575698ca-0f51-447e-9e82-b85c9ca00302" containerID="6dca45a09c818c825a6f14ac451c979cc686418f66be1c8ff23f5773f09fd359" exitCode=0
May 29 02:35:29.536872 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.536842    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c" event={"ID":"575698ca-0f51-447e-9e82-b85c9ca00302","Type":"ContainerDied","Data":"6dca45a09c818c825a6f14ac451c979cc686418f66be1c8ff23f5773f09fd359"}
May 29 02:35:29.536938 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.536871    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c" event={"ID":"575698ca-0f51-447e-9e82-b85c9ca00302","Type":"ContainerStarted","Data":"bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c"}
May 29 02:35:29.537975 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.537953    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4" event={"ID":"a51f43b6-8903-44de-875f-9024bacf1c13","Type":"ContainerStarted","Data":"85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c"}
May 29 02:35:29.539680 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.539656    2547 generic.go:358] "Generic (PLEG): container finished" podID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerID="8b22ede41df0bb8e0bb788b9b6eec3a46997bb3d9bd2632d4d6dc8fc92608515" exitCode=0
May 29 02:35:29.539766 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:29.539691    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7" event={"ID":"e95aca2e-9273-4d8c-9fae-c406abe36f96","Type":"ContainerDied","Data":"8b22ede41df0bb8e0bb788b9b6eec3a46997bb3d9bd2632d4d6dc8fc92608515"}
May 29 02:35:30.548136 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.548045    2547 generic.go:358] "Generic (PLEG): container finished" podID="39bcd756-78d0-4b36-8753-2197dee2a286" containerID="6008fa1f333e0d2412b4da2d2a53d23ed3d2e104a0321c9cfaa8c6cac9e15df9" exitCode=0
May 29 02:35:30.548570 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.548139    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv" event={"ID":"39bcd756-78d0-4b36-8753-2197dee2a286","Type":"ContainerDied","Data":"6008fa1f333e0d2412b4da2d2a53d23ed3d2e104a0321c9cfaa8c6cac9e15df9"}
May 29 02:35:30.549836 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.549789    2547 generic.go:358] "Generic (PLEG): container finished" podID="575698ca-0f51-447e-9e82-b85c9ca00302" containerID="91aae3001ca988e88025461869d4cc112ec659b99d25a6b3fffaf23251440b4f" exitCode=0
May 29 02:35:30.549882 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.549863    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c" event={"ID":"575698ca-0f51-447e-9e82-b85c9ca00302","Type":"ContainerDied","Data":"91aae3001ca988e88025461869d4cc112ec659b99d25a6b3fffaf23251440b4f"}
May 29 02:35:30.551303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.551180    2547 generic.go:358] "Generic (PLEG): container finished" podID="a51f43b6-8903-44de-875f-9024bacf1c13" containerID="a5fa704c2fa55115d3f535b4bcd3678f5e84c2cfb68a94df4bd69cd708a2983e" exitCode=0
May 29 02:35:30.551303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.551230    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4" event={"ID":"a51f43b6-8903-44de-875f-9024bacf1c13","Type":"ContainerDied","Data":"a5fa704c2fa55115d3f535b4bcd3678f5e84c2cfb68a94df4bd69cd708a2983e"}
May 29 02:35:30.553404 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.553313    2547 generic.go:358] "Generic (PLEG): container finished" podID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerID="e807dcf30154f958cdd5925174887b0fac8552405f7e8593206794c2a78390df" exitCode=0
May 29 02:35:30.553404 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:30.553350    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7" event={"ID":"e95aca2e-9273-4d8c-9fae-c406abe36f96","Type":"ContainerDied","Data":"e807dcf30154f958cdd5925174887b0fac8552405f7e8593206794c2a78390df"}
May 29 02:35:31.559184 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.559109    2547 generic.go:358] "Generic (PLEG): container finished" podID="39bcd756-78d0-4b36-8753-2197dee2a286" containerID="10c594139a5956ce4647760e9fd4e4ed13cff87f856f909ac145eb3207d6ebe2" exitCode=0
May 29 02:35:31.559576 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.559191    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv" event={"ID":"39bcd756-78d0-4b36-8753-2197dee2a286","Type":"ContainerDied","Data":"10c594139a5956ce4647760e9fd4e4ed13cff87f856f909ac145eb3207d6ebe2"}
May 29 02:35:31.560948 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.560927    2547 generic.go:358] "Generic (PLEG): container finished" podID="575698ca-0f51-447e-9e82-b85c9ca00302" containerID="bef43062ed7b380deaae86dc63085b3695438335d9b1760cb53e632f3f97b0b2" exitCode=0
May 29 02:35:31.561028 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.561008    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c" event={"ID":"575698ca-0f51-447e-9e82-b85c9ca00302","Type":"ContainerDied","Data":"bef43062ed7b380deaae86dc63085b3695438335d9b1760cb53e632f3f97b0b2"}
May 29 02:35:31.562608 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.562588    2547 generic.go:358] "Generic (PLEG): container finished" podID="a51f43b6-8903-44de-875f-9024bacf1c13" containerID="5166f5883837cad9a8298bc98c67a2b447d99b9897420b222a35c1cebedf5bf8" exitCode=0
May 29 02:35:31.562697 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.562654    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4" event={"ID":"a51f43b6-8903-44de-875f-9024bacf1c13","Type":"ContainerDied","Data":"5166f5883837cad9a8298bc98c67a2b447d99b9897420b222a35c1cebedf5bf8"}
May 29 02:35:31.695902 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.695880    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:31.834145 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.834082    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle\") pod \"e95aca2e-9273-4d8c-9fae-c406abe36f96\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") "
May 29 02:35:31.834276 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.834157    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util\") pod \"e95aca2e-9273-4d8c-9fae-c406abe36f96\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") "
May 29 02:35:31.834276 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.834222    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tczwd\" (UniqueName: \"kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd\") pod \"e95aca2e-9273-4d8c-9fae-c406abe36f96\" (UID: \"e95aca2e-9273-4d8c-9fae-c406abe36f96\") "
May 29 02:35:31.834506 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.834479    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle" (OuterVolumeSpecName: "bundle") pod "e95aca2e-9273-4d8c-9fae-c406abe36f96" (UID: "e95aca2e-9273-4d8c-9fae-c406abe36f96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:31.836266 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.836237    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd" (OuterVolumeSpecName: "kube-api-access-tczwd") pod "e95aca2e-9273-4d8c-9fae-c406abe36f96" (UID: "e95aca2e-9273-4d8c-9fae-c406abe36f96"). InnerVolumeSpecName "kube-api-access-tczwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:35:31.839674 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.839641    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util" (OuterVolumeSpecName: "util") pod "e95aca2e-9273-4d8c-9fae-c406abe36f96" (UID: "e95aca2e-9273-4d8c-9fae-c406abe36f96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:31.935542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.935510    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:31.935542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.935535    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95aca2e-9273-4d8c-9fae-c406abe36f96-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:31.935542 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:31.935545    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tczwd\" (UniqueName: \"kubernetes.io/projected/e95aca2e-9273-4d8c-9fae-c406abe36f96-kube-api-access-tczwd\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.569669 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.569636    2547 generic.go:358] "Generic (PLEG): container finished" podID="a51f43b6-8903-44de-875f-9024bacf1c13" containerID="4e41b1a015167badcf5ef50e10d475ac1d8c6d1a3a989e3460691b93aadb5cc8" exitCode=0
May 29 02:35:32.570113 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.569721    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4" event={"ID":"a51f43b6-8903-44de-875f-9024bacf1c13","Type":"ContainerDied","Data":"4e41b1a015167badcf5ef50e10d475ac1d8c6d1a3a989e3460691b93aadb5cc8"}
May 29 02:35:32.574334 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.574304    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7" event={"ID":"e95aca2e-9273-4d8c-9fae-c406abe36f96","Type":"ContainerDied","Data":"76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14"}
May 29 02:35:32.574491 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.574338    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76c665ca579e26eb5f9aa818f9012a785d20455c53f3e44689e60ec7280b6e14"
May 29 02:35:32.574491 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.574363    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7"
May 29 02:35:32.705947 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.705926    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:32.731849 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.731826    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:32.844656 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.844537    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48x25\" (UniqueName: \"kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25\") pod \"39bcd756-78d0-4b36-8753-2197dee2a286\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") "
May 29 02:35:32.844831 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.844810    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util\") pod \"575698ca-0f51-447e-9e82-b85c9ca00302\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") "
May 29 02:35:32.845132 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.845107    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util\") pod \"39bcd756-78d0-4b36-8753-2197dee2a286\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") "
May 29 02:35:32.845292 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.845163    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle\") pod \"39bcd756-78d0-4b36-8753-2197dee2a286\" (UID: \"39bcd756-78d0-4b36-8753-2197dee2a286\") "
May 29 02:35:32.845292 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.845271    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhdhv\" (UniqueName: \"kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv\") pod \"575698ca-0f51-447e-9e82-b85c9ca00302\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") "
May 29 02:35:32.845394 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.845305    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle\") pod \"575698ca-0f51-447e-9e82-b85c9ca00302\" (UID: \"575698ca-0f51-447e-9e82-b85c9ca00302\") "
May 29 02:35:32.845809 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.845633    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle" (OuterVolumeSpecName: "bundle") pod "39bcd756-78d0-4b36-8753-2197dee2a286" (UID: "39bcd756-78d0-4b36-8753-2197dee2a286"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:32.846298 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.846263    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle" (OuterVolumeSpecName: "bundle") pod "575698ca-0f51-447e-9e82-b85c9ca00302" (UID: "575698ca-0f51-447e-9e82-b85c9ca00302"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:32.847255 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.847233    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25" (OuterVolumeSpecName: "kube-api-access-48x25") pod "39bcd756-78d0-4b36-8753-2197dee2a286" (UID: "39bcd756-78d0-4b36-8753-2197dee2a286"). InnerVolumeSpecName "kube-api-access-48x25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:35:32.847672 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.847644    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv" (OuterVolumeSpecName: "kube-api-access-lhdhv") pod "575698ca-0f51-447e-9e82-b85c9ca00302" (UID: "575698ca-0f51-447e-9e82-b85c9ca00302"). InnerVolumeSpecName "kube-api-access-lhdhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:35:32.850579 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.850556    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util" (OuterVolumeSpecName: "util") pod "39bcd756-78d0-4b36-8753-2197dee2a286" (UID: "39bcd756-78d0-4b36-8753-2197dee2a286"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:32.851078 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.851060    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util" (OuterVolumeSpecName: "util") pod "575698ca-0f51-447e-9e82-b85c9ca00302" (UID: "575698ca-0f51-447e-9e82-b85c9ca00302"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:32.946594 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946564    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhdhv\" (UniqueName: \"kubernetes.io/projected/575698ca-0f51-447e-9e82-b85c9ca00302-kube-api-access-lhdhv\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.946594 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946591    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.946797 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946601    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48x25\" (UniqueName: \"kubernetes.io/projected/39bcd756-78d0-4b36-8753-2197dee2a286-kube-api-access-48x25\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.946797 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946611    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575698ca-0f51-447e-9e82-b85c9ca00302-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.946797 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946620    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:32.946797 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:32.946628    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39bcd756-78d0-4b36-8753-2197dee2a286-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:33.583690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.583639    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv" event={"ID":"39bcd756-78d0-4b36-8753-2197dee2a286","Type":"ContainerDied","Data":"64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910"}
May 29 02:35:33.583690 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.583691    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64b06c8bf7b6b5cc24661c4277c27065559c7bd9b9e77b9455bb2e78421e1910"
May 29 02:35:33.584546 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.583788    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv"
May 29 02:35:33.586957 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.586887    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c" event={"ID":"575698ca-0f51-447e-9e82-b85c9ca00302","Type":"ContainerDied","Data":"bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c"}
May 29 02:35:33.586957 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.586957    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bde67356a1ba8e4451f1c63598264c08d84aa086c60a25b47796a48b4bc7fa5c"
May 29 02:35:33.587303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.586997    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c"
May 29 02:35:33.779444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.779391    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:33.958109 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.958051    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle\") pod \"a51f43b6-8903-44de-875f-9024bacf1c13\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") "
May 29 02:35:33.958332 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.958140    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcp6s\" (UniqueName: \"kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s\") pod \"a51f43b6-8903-44de-875f-9024bacf1c13\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") "
May 29 02:35:33.958332 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.958273    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util\") pod \"a51f43b6-8903-44de-875f-9024bacf1c13\" (UID: \"a51f43b6-8903-44de-875f-9024bacf1c13\") "
May 29 02:35:33.958774 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.958747    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle" (OuterVolumeSpecName: "bundle") pod "a51f43b6-8903-44de-875f-9024bacf1c13" (UID: "a51f43b6-8903-44de-875f-9024bacf1c13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:33.960487 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.960451    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s" (OuterVolumeSpecName: "kube-api-access-hcp6s") pod "a51f43b6-8903-44de-875f-9024bacf1c13" (UID: "a51f43b6-8903-44de-875f-9024bacf1c13"). InnerVolumeSpecName "kube-api-access-hcp6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:35:33.966681 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:33.966634    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util" (OuterVolumeSpecName: "util") pod "a51f43b6-8903-44de-875f-9024bacf1c13" (UID: "a51f43b6-8903-44de-875f-9024bacf1c13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:35:34.059772 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.059738    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-bundle\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:34.059772 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.059769    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcp6s\" (UniqueName: \"kubernetes.io/projected/a51f43b6-8903-44de-875f-9024bacf1c13-kube-api-access-hcp6s\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:34.059772 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.059781    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a51f43b6-8903-44de-875f-9024bacf1c13-util\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:35:34.592638 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.592613    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4"
May 29 02:35:34.592638 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.592620    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4" event={"ID":"a51f43b6-8903-44de-875f-9024bacf1c13","Type":"ContainerDied","Data":"85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c"}
May 29 02:35:34.593082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:34.592650    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f67de9db2db41418dd2fc985962497579b9591b0fbdef636bcc14c4a35a04c"
May 29 02:35:48.646668 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.646637    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"]
May 29 02:35:48.647230 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647185    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="util"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647233    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="util"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647245    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="util"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647252    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="util"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647264    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="extract"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647271    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="extract"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647282    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="extract"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647290    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="extract"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647305    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="pull"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647313    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="pull"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647322    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="util"
May 29 02:35:48.647341 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647330    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="util"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647347    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647355    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647372    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="util"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647381    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="util"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647390    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647398    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647407    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647416    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647428    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647436    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="pull"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647447    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647455    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647550    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="39bcd756-78d0-4b36-8753-2197dee2a286" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647563    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="e95aca2e-9273-4d8c-9fae-c406abe36f96" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647576    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a51f43b6-8903-44de-875f-9024bacf1c13" containerName="extract"
May 29 02:35:48.647832 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.647588    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="575698ca-0f51-447e-9e82-b85c9ca00302" containerName="extract"
May 29 02:35:48.652335 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.652309    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.654814 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.654794    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 02:35:48.654919 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.654796    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 02:35:48.654919 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.654859    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8tkjk\""
May 29 02:35:48.662814 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.662792    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"]
May 29 02:35:48.675649 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.675625    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.675750 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.675693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.776282 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.776244    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.776458 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.776321    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.776581 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.776561    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.787491 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.787456    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:48.963360 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:48.963265    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:49.098882 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:49.098858    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"]
May 29 02:35:49.100628 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:35:49.100601    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5ca1e4_4955_4399_bc31_b93ba295d4ee.slice/crio-cc3f2c755f80409a77d3aab1bccd827b9bebb5cc265ba99975c1cc265165b71a WatchSource:0}: Error finding container cc3f2c755f80409a77d3aab1bccd827b9bebb5cc265ba99975c1cc265165b71a: Status 404 returned error can't find the container with id cc3f2c755f80409a77d3aab1bccd827b9bebb5cc265ba99975c1cc265165b71a
May 29 02:35:49.652303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:49.652261    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" event={"ID":"dd5ca1e4-4955-4399-bc31-b93ba295d4ee","Type":"ContainerStarted","Data":"cc3f2c755f80409a77d3aab1bccd827b9bebb5cc265ba99975c1cc265165b71a"}
May 29 02:35:54.672561 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:54.672525    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" event={"ID":"dd5ca1e4-4955-4399-bc31-b93ba295d4ee","Type":"ContainerStarted","Data":"755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e"}
May 29 02:35:54.672934 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:54.672605    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:35:54.698218 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:35:54.698164    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" podStartSLOduration=1.818950397 podStartE2EDuration="6.69815209s" podCreationTimestamp="2026-05-29 02:35:48 +0000 UTC" firstStartedPulling="2026-05-29 02:35:49.102728699 +0000 UTC m=+492.792684366" lastFinishedPulling="2026-05-29 02:35:53.981930405 +0000 UTC m=+497.671886059" observedRunningTime="2026-05-29 02:35:54.692713914 +0000 UTC m=+498.382669588" watchObservedRunningTime="2026-05-29 02:35:54.69815209 +0000 UTC m=+498.388107817"
May 29 02:36:05.678980 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:05.678945    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:36:07.294814 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.294779    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"]
May 29 02:36:07.295226 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.294981    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" containerName="manager" containerID="cri-o://755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e" gracePeriod=2
May 29 02:36:07.305100 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.305066    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"]
May 29 02:36:07.320272 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.320238    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:07.320776 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.320759    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" containerName="manager"
May 29 02:36:07.320862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.320778    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" containerName="manager"
May 29 02:36:07.320915 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.320876    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" containerName="manager"
May 29 02:36:07.324246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.324226    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.327791 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.327748    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:07.335420 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.335396    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:07.428728 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.428686    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.428891 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.428817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48k55\" (UniqueName: \"kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.523862 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.523838    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:36:07.526259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.526235    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:07.530078 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.530053    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48k55\" (UniqueName: \"kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.530231 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.530104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.530427 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.530413    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.539099 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.539080    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48k55\" (UniqueName: \"kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dhvzc\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.630821 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.630794    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume\") pod \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") "
May 29 02:36:07.630955 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.630828    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69\") pod \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\" (UID: \"dd5ca1e4-4955-4399-bc31-b93ba295d4ee\") "
May 29 02:36:07.631396 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.631370    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dd5ca1e4-4955-4399-bc31-b93ba295d4ee" (UID: "dd5ca1e4-4955-4399-bc31-b93ba295d4ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:36:07.632820 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.632793    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69" (OuterVolumeSpecName: "kube-api-access-88k69") pod "dd5ca1e4-4955-4399-bc31-b93ba295d4ee" (UID: "dd5ca1e4-4955-4399-bc31-b93ba295d4ee"). InnerVolumeSpecName "kube-api-access-88k69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:36:07.672133 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.672108    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:07.723643 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.723597    2547 generic.go:358] "Generic (PLEG): container finished" podID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" containerID="755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e" exitCode=0
May 29 02:36:07.723798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.723678    2547 scope.go:117] "RemoveContainer" containerID="755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e"
May 29 02:36:07.723798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.723731    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd"
May 29 02:36:07.726312 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.726281    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:07.731901 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.731874    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-extensions-socket-volume\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:36:07.732005 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.731905    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/dd5ca1e4-4955-4399-bc31-b93ba295d4ee-kube-api-access-88k69\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:36:07.734789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.734769    2547 scope.go:117] "RemoveContainer" containerID="755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e"
May 29 02:36:07.735544 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:36:07.735358    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e\": container with ID starting with 755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e not found: ID does not exist" containerID="755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e"
May 29 02:36:07.735544 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.735394    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e"} err="failed to get container status \"755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e\": rpc error: code = NotFound desc = could not find container \"755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e\": container with ID starting with 755fbe36ddd22e11d20e1e3aca693f7776d18b6e86e9f1186d95a890fabf276e not found: ID does not exist"
May 29 02:36:07.738305 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.738278    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:07.808507 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:07.808482    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:07.811265 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:36:07.811236    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15838fbf_8e41_4ce0_824a_02c21034b102.slice/crio-2b8cb4b0b417e79f97e802f1853897fbcbdec677e1712995ecd43c08890cf173 WatchSource:0}: Error finding container 2b8cb4b0b417e79f97e802f1853897fbcbdec677e1712995ecd43c08890cf173: Status 404 returned error can't find the container with id 2b8cb4b0b417e79f97e802f1853897fbcbdec677e1712995ecd43c08890cf173
May 29 02:36:08.279323 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.279292    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:36:08.282795 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.282775    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.287994 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.287967    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:08.304359 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.304334    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:36:08.337736 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.337705    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.337865 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.337763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vk7j\" (UniqueName: \"kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.438525 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.438495    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vk7j\" (UniqueName: \"kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.438703 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.438675    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.439003 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.438986    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.452595 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.452569    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vk7j\" (UniqueName: \"kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dnstj\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.592737 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.592664    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:08.729265 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.729182    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" event={"ID":"15838fbf-8e41-4ce0-824a-02c21034b102","Type":"ContainerStarted","Data":"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"}
May 29 02:36:08.729265 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.729239    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" event={"ID":"15838fbf-8e41-4ce0-824a-02c21034b102","Type":"ContainerStarted","Data":"2b8cb4b0b417e79f97e802f1853897fbcbdec677e1712995ecd43c08890cf173"}
May 29 02:36:08.729530 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.729276    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:08.736627 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.736604    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:36:08.737498 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:36:08.737476    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6b5b9c_b0e7_4c96_91e9_d19c3bc0fb9e.slice/crio-6f4849b605cff6f655e01cab55a1d59ce013ab18dfeebdb34186aa3cf3988b23 WatchSource:0}: Error finding container 6f4849b605cff6f655e01cab55a1d59ce013ab18dfeebdb34186aa3cf3988b23: Status 404 returned error can't find the container with id 6f4849b605cff6f655e01cab55a1d59ce013ab18dfeebdb34186aa3cf3988b23
May 29 02:36:08.770796 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.770759    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" podStartSLOduration=1.770746912 podStartE2EDuration="1.770746912s" podCreationTimestamp="2026-05-29 02:36:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:36:08.766270617 +0000 UTC m=+512.456226292" watchObservedRunningTime="2026-05-29 02:36:08.770746912 +0000 UTC m=+512.460702587"
May 29 02:36:08.775583 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.775556    2547 status_manager.go:895] "Failed to get status for pod" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-t7vdd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-t7vdd\" is forbidden: User \"system:node:ip-10-0-131-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-78.ec2.internal' and this object"
May 29 02:36:08.840245 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:08.840209    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd5ca1e4-4955-4399-bc31-b93ba295d4ee" path="/var/lib/kubelet/pods/dd5ca1e4-4955-4399-bc31-b93ba295d4ee/volumes"
May 29 02:36:09.735559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:09.735521    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" event={"ID":"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e","Type":"ContainerStarted","Data":"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"}
May 29 02:36:09.735559 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:09.735558    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" event={"ID":"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e","Type":"ContainerStarted","Data":"6f4849b605cff6f655e01cab55a1d59ce013ab18dfeebdb34186aa3cf3988b23"}
May 29 02:36:09.736047 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:09.735606    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:09.765486 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:09.765440    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" podStartSLOduration=1.7654257370000002 podStartE2EDuration="1.765425737s" podCreationTimestamp="2026-05-29 02:36:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:36:09.763810982 +0000 UTC m=+513.453766657" watchObservedRunningTime="2026-05-29 02:36:09.765425737 +0000 UTC m=+513.455381411"
May 29 02:36:19.738527 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:19.738494    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:20.741930 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:20.741896    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:36:20.792038 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:20.792003    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:20.792620 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:20.792354    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" podUID="15838fbf-8e41-4ce0-824a-02c21034b102" containerName="manager" containerID="cri-o://c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7" gracePeriod=10
May 29 02:36:21.046940 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.046918    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:21.146252 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.146216    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume\") pod \"15838fbf-8e41-4ce0-824a-02c21034b102\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") "
May 29 02:36:21.146438 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.146295    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48k55\" (UniqueName: \"kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55\") pod \"15838fbf-8e41-4ce0-824a-02c21034b102\" (UID: \"15838fbf-8e41-4ce0-824a-02c21034b102\") "
May 29 02:36:21.146574 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.146551    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15838fbf-8e41-4ce0-824a-02c21034b102" (UID: "15838fbf-8e41-4ce0-824a-02c21034b102"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:36:21.148390 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.148365    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55" (OuterVolumeSpecName: "kube-api-access-48k55") pod "15838fbf-8e41-4ce0-824a-02c21034b102" (UID: "15838fbf-8e41-4ce0-824a-02c21034b102"). InnerVolumeSpecName "kube-api-access-48k55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:36:21.247537 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.247514    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15838fbf-8e41-4ce0-824a-02c21034b102-extensions-socket-volume\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:36:21.247537 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.247534    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48k55\" (UniqueName: \"kubernetes.io/projected/15838fbf-8e41-4ce0-824a-02c21034b102-kube-api-access-48k55\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:36:21.784158 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.784121    2547 generic.go:358] "Generic (PLEG): container finished" podID="15838fbf-8e41-4ce0-824a-02c21034b102" containerID="c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7" exitCode=0
May 29 02:36:21.784562 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.784191    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"
May 29 02:36:21.784562 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.784217    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" event={"ID":"15838fbf-8e41-4ce0-824a-02c21034b102","Type":"ContainerDied","Data":"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"}
May 29 02:36:21.784562 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.784255    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc" event={"ID":"15838fbf-8e41-4ce0-824a-02c21034b102","Type":"ContainerDied","Data":"2b8cb4b0b417e79f97e802f1853897fbcbdec677e1712995ecd43c08890cf173"}
May 29 02:36:21.784562 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.784270    2547 scope.go:117] "RemoveContainer" containerID="c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"
May 29 02:36:21.793299 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.793036    2547 scope.go:117] "RemoveContainer" containerID="c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"
May 29 02:36:21.793370 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:36:21.793317    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7\": container with ID starting with c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7 not found: ID does not exist" containerID="c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"
May 29 02:36:21.793370 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.793345    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7"} err="failed to get container status \"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7\": rpc error: code = NotFound desc = could not find container \"c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7\": container with ID starting with c06fb7cf00ba6bbf9a12f800be20d63598231c781dddfc4c975f8283376079b7 not found: ID does not exist"
May 29 02:36:21.811304 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.811282    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:21.815173 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:21.815141    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dhvzc"]
May 29 02:36:22.839601 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:22.839570    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15838fbf-8e41-4ce0-824a-02c21034b102" path="/var/lib/kubelet/pods/15838fbf-8e41-4ce0-824a-02c21034b102/volumes"
May 29 02:36:41.479842 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.479807    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:36:41.480227 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.480151    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15838fbf-8e41-4ce0-824a-02c21034b102" containerName="manager"
May 29 02:36:41.480227 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.480161    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="15838fbf-8e41-4ce0-824a-02c21034b102" containerName="manager"
May 29 02:36:41.480303 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.480257    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="15838fbf-8e41-4ce0-824a-02c21034b102" containerName="manager"
May 29 02:36:41.484619 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.484601    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.487136 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.487116    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 29 02:36:41.487385 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.487371    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5vts\""
May 29 02:36:41.493842 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.493823    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:36:41.569881 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.569848    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:36:41.612921 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.612893    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.613075 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.612939    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvzd\" (UniqueName: \"kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.714058 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.714027    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvzd\" (UniqueName: \"kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.714219 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.714098    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.714708 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.714689    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.725663 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.725641    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvzd\" (UniqueName: \"kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd\") pod \"limitador-limitador-7d549b5b-g9rkj\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.796590 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.796537    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:41.926990 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:41.926964    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:36:41.928539 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:36:41.928509    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a4274b_4dd3_4db1_ba24_1a026afa331e.slice/crio-0bc4c014f830a9e290f955e098221249518d7dbf03026501f1ed131c8550385e WatchSource:0}: Error finding container 0bc4c014f830a9e290f955e098221249518d7dbf03026501f1ed131c8550385e: Status 404 returned error can't find the container with id 0bc4c014f830a9e290f955e098221249518d7dbf03026501f1ed131c8550385e
May 29 02:36:42.869457 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:42.869420    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" event={"ID":"d0a4274b-4dd3-4db1-ba24-1a026afa331e","Type":"ContainerStarted","Data":"0bc4c014f830a9e290f955e098221249518d7dbf03026501f1ed131c8550385e"}
May 29 02:36:44.878645 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:44.878615    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" event={"ID":"d0a4274b-4dd3-4db1-ba24-1a026afa331e","Type":"ContainerStarted","Data":"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"}
May 29 02:36:44.879058 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:44.878658    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:44.897434 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:44.897392    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" podStartSLOduration=1.275366836 podStartE2EDuration="3.897379359s" podCreationTimestamp="2026-05-29 02:36:41 +0000 UTC" firstStartedPulling="2026-05-29 02:36:41.930129472 +0000 UTC m=+545.620085128" lastFinishedPulling="2026-05-29 02:36:44.552141995 +0000 UTC m=+548.242097651" observedRunningTime="2026-05-29 02:36:44.896036006 +0000 UTC m=+548.585991681" watchObservedRunningTime="2026-05-29 02:36:44.897379359 +0000 UTC m=+548.587335033"
May 29 02:36:55.882835 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:55.882807    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:36:59.828558 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:59.828516    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:36:59.829157 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:36:59.828842    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" podUID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" containerName="limitador" containerID="cri-o://e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9" gracePeriod=30
May 29 02:37:00.368103 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.368079    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:37:00.456337 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.456277    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mvzd\" (UniqueName: \"kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd\") pod \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") "
May 29 02:37:00.456337 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.456329    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file\") pod \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\" (UID: \"d0a4274b-4dd3-4db1-ba24-1a026afa331e\") "
May 29 02:37:00.456710 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.456684    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file" (OuterVolumeSpecName: "config-file") pod "d0a4274b-4dd3-4db1-ba24-1a026afa331e" (UID: "d0a4274b-4dd3-4db1-ba24-1a026afa331e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:37:00.458206 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.458178    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd" (OuterVolumeSpecName: "kube-api-access-7mvzd") pod "d0a4274b-4dd3-4db1-ba24-1a026afa331e" (UID: "d0a4274b-4dd3-4db1-ba24-1a026afa331e"). InnerVolumeSpecName "kube-api-access-7mvzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:37:00.557042 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.557017    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mvzd\" (UniqueName: \"kubernetes.io/projected/d0a4274b-4dd3-4db1-ba24-1a026afa331e-kube-api-access-7mvzd\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:37:00.557042 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.557039    2547 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d0a4274b-4dd3-4db1-ba24-1a026afa331e-config-file\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:37:00.944805 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.944774    2547 generic.go:358] "Generic (PLEG): container finished" podID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" containerID="e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9" exitCode=0
May 29 02:37:00.945155 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.944840    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj"
May 29 02:37:00.945155 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.944857    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" event={"ID":"d0a4274b-4dd3-4db1-ba24-1a026afa331e","Type":"ContainerDied","Data":"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"}
May 29 02:37:00.945155 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.944897    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g9rkj" event={"ID":"d0a4274b-4dd3-4db1-ba24-1a026afa331e","Type":"ContainerDied","Data":"0bc4c014f830a9e290f955e098221249518d7dbf03026501f1ed131c8550385e"}
May 29 02:37:00.945155 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.944914    2547 scope.go:117] "RemoveContainer" containerID="e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"
May 29 02:37:00.953582 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.953566    2547 scope.go:117] "RemoveContainer" containerID="e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"
May 29 02:37:00.953826 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:37:00.953806    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9\": container with ID starting with e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9 not found: ID does not exist" containerID="e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"
May 29 02:37:00.953868 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.953833    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9"} err="failed to get container status \"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9\": rpc error: code = NotFound desc = could not find container \"e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9\": container with ID starting with e34c91786606a100e35ccee9adc2c7f214299332bef70ffec088930a732033c9 not found: ID does not exist"
May 29 02:37:00.963792 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.963771    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:37:00.967638 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:00.967610    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g9rkj"]
May 29 02:37:02.683086 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.683053    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cq958"]
May 29 02:37:02.683642 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.683618    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" containerName="limitador"
May 29 02:37:02.683795 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.683777    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" containerName="limitador"
May 29 02:37:02.683961 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.683937    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" containerName="limitador"
May 29 02:37:02.688332 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.688307    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.690780 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.690759    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 29 02:37:02.698107 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.698077    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cq958"]
May 29 02:37:02.778077 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.778055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbswf\" (UniqueName: \"kubernetes.io/projected/9bbd43c0-4f08-45d7-8015-7663bcd01731-kube-api-access-nbswf\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.778187 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.778101    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9bbd43c0-4f08-45d7-8015-7663bcd01731-data\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.841070 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.841039    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a4274b-4dd3-4db1-ba24-1a026afa331e" path="/var/lib/kubelet/pods/d0a4274b-4dd3-4db1-ba24-1a026afa331e/volumes"
May 29 02:37:02.879371 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.879344    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbswf\" (UniqueName: \"kubernetes.io/projected/9bbd43c0-4f08-45d7-8015-7663bcd01731-kube-api-access-nbswf\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.879489 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.879405    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9bbd43c0-4f08-45d7-8015-7663bcd01731-data\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.879758 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.879743    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9bbd43c0-4f08-45d7-8015-7663bcd01731-data\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:02.890366 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:02.890349    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbswf\" (UniqueName: \"kubernetes.io/projected/9bbd43c0-4f08-45d7-8015-7663bcd01731-kube-api-access-nbswf\") pod \"postgres-68c4fbbd6f-cq958\" (UID: \"9bbd43c0-4f08-45d7-8015-7663bcd01731\") " pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:03.001467 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:03.001398    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:03.133392 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:03.133367    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cq958"]
May 29 02:37:03.135591 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:37:03.135561    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbd43c0_4f08_45d7_8015_7663bcd01731.slice/crio-3815e7786fad714fb6044a0855f14bd470b4d214c4ec4f712f9815194b443e44 WatchSource:0}: Error finding container 3815e7786fad714fb6044a0855f14bd470b4d214c4ec4f712f9815194b443e44: Status 404 returned error can't find the container with id 3815e7786fad714fb6044a0855f14bd470b4d214c4ec4f712f9815194b443e44
May 29 02:37:03.958806 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:03.958772    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-cq958" event={"ID":"9bbd43c0-4f08-45d7-8015-7663bcd01731","Type":"ContainerStarted","Data":"3815e7786fad714fb6044a0855f14bd470b4d214c4ec4f712f9815194b443e44"}
May 29 02:37:05.971850 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:05.971748    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-cq958" event={"ID":"9bbd43c0-4f08-45d7-8015-7663bcd01731","Type":"ContainerStarted","Data":"870a776a8505f923447cee68e23127c09796a2fe2360a0d36f53a806f3e64437"}
May 29 02:37:05.972285 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:05.971879    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:05.989887 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:05.989841    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-cq958" podStartSLOduration=1.469111133 podStartE2EDuration="3.989827716s" podCreationTimestamp="2026-05-29 02:37:02 +0000 UTC" firstStartedPulling="2026-05-29 02:37:03.13725317 +0000 UTC m=+566.827208824" lastFinishedPulling="2026-05-29 02:37:05.657969754 +0000 UTC m=+569.347925407" observedRunningTime="2026-05-29 02:37:05.987834483 +0000 UTC m=+569.677790160" watchObservedRunningTime="2026-05-29 02:37:05.989827716 +0000 UTC m=+569.679783391"
May 29 02:37:12.003811 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:12.003783    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-cq958"
May 29 02:37:17.694439 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.694404    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:17.752803 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.752774    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:17.752946 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.752880    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:17.756789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.756768    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lxtsz\""
May 29 02:37:17.756975 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.756962    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 29 02:37:17.808155 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.808128    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phbpx\" (UniqueName: \"kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx\") pod \"maas-controller-7b468c647d-l9qkz\" (UID: \"590170fc-925d-43ce-9a63-1dbfe30f26c5\") " pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:17.894403 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.894376    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:37:17.909218 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.908754    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phbpx\" (UniqueName: \"kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx\") pod \"maas-controller-7b468c647d-l9qkz\" (UID: \"590170fc-925d-43ce-9a63-1dbfe30f26c5\") " pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:17.910404 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.910381    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:17.910527 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.910446    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:37:17.919990 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:17.919969    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phbpx\" (UniqueName: \"kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx\") pod \"maas-controller-7b468c647d-l9qkz\" (UID: \"590170fc-925d-43ce-9a63-1dbfe30f26c5\") " pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:18.010029 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.009969    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbrw\" (UniqueName: \"kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw\") pod \"maas-controller-8768cff59-pd9c6\" (UID: \"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2\") " pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:18.063077 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.063048    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:18.110709 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.110677    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbrw\" (UniqueName: \"kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw\") pod \"maas-controller-8768cff59-pd9c6\" (UID: \"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2\") " pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:18.120472 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.120443    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbrw\" (UniqueName: \"kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw\") pod \"maas-controller-8768cff59-pd9c6\" (UID: \"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2\") " pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:18.202340 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.202314    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:18.204042 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:37:18.204012    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590170fc_925d_43ce_9a63_1dbfe30f26c5.slice/crio-72be5cba022beda462eeab71acc33b223e2d4f10a3cacf5172836b73e3728a3a WatchSource:0}: Error finding container 72be5cba022beda462eeab71acc33b223e2d4f10a3cacf5172836b73e3728a3a: Status 404 returned error can't find the container with id 72be5cba022beda462eeab71acc33b223e2d4f10a3cacf5172836b73e3728a3a
May 29 02:37:18.231767 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.231736    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:18.356962 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:18.356935    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:37:18.358649 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:37:18.358628    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7747e1cd_4be4_4cd4_a5ce_3b454dd9f5f2.slice/crio-18a7312e180323b6ecb5cc9ee4c776416dc0b76e115c616136dcb7cbc2ee679f WatchSource:0}: Error finding container 18a7312e180323b6ecb5cc9ee4c776416dc0b76e115c616136dcb7cbc2ee679f: Status 404 returned error can't find the container with id 18a7312e180323b6ecb5cc9ee4c776416dc0b76e115c616136dcb7cbc2ee679f
May 29 02:37:19.025458 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:19.025423    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b468c647d-l9qkz" event={"ID":"590170fc-925d-43ce-9a63-1dbfe30f26c5","Type":"ContainerStarted","Data":"72be5cba022beda462eeab71acc33b223e2d4f10a3cacf5172836b73e3728a3a"}
May 29 02:37:19.027055 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:19.027023    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-pd9c6" event={"ID":"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2","Type":"ContainerStarted","Data":"18a7312e180323b6ecb5cc9ee4c776416dc0b76e115c616136dcb7cbc2ee679f"}
May 29 02:37:21.036976 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.036907    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b468c647d-l9qkz" event={"ID":"590170fc-925d-43ce-9a63-1dbfe30f26c5","Type":"ContainerStarted","Data":"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"}
May 29 02:37:21.037671 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.037646    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:21.038652 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.038629    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-pd9c6" event={"ID":"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2","Type":"ContainerStarted","Data":"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"}
May 29 02:37:21.038758 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.038674    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:21.054168 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.054131    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7b468c647d-l9qkz" podStartSLOduration=1.386140111 podStartE2EDuration="4.054120186s" podCreationTimestamp="2026-05-29 02:37:17 +0000 UTC" firstStartedPulling="2026-05-29 02:37:18.205540346 +0000 UTC m=+581.895495999" lastFinishedPulling="2026-05-29 02:37:20.873520419 +0000 UTC m=+584.563476074" observedRunningTime="2026-05-29 02:37:21.052879332 +0000 UTC m=+584.742835019" watchObservedRunningTime="2026-05-29 02:37:21.054120186 +0000 UTC m=+584.744075860"
May 29 02:37:21.071112 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:21.071073    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8768cff59-pd9c6" podStartSLOduration=1.5676528589999998 podStartE2EDuration="4.071062692s" podCreationTimestamp="2026-05-29 02:37:17 +0000 UTC" firstStartedPulling="2026-05-29 02:37:18.359922396 +0000 UTC m=+582.049878048" lastFinishedPulling="2026-05-29 02:37:20.863332225 +0000 UTC m=+584.553287881" observedRunningTime="2026-05-29 02:37:21.068803999 +0000 UTC m=+584.758759678" watchObservedRunningTime="2026-05-29 02:37:21.071062692 +0000 UTC m=+584.761018367"
May 29 02:37:32.051175 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.051136    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:37:32.098013 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.097981    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:32.098325 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.098274    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7b468c647d-l9qkz" podUID="590170fc-925d-43ce-9a63-1dbfe30f26c5" containerName="manager" containerID="cri-o://863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94" gracePeriod=30
May 29 02:37:32.106548 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.106526    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:32.349992 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.349967    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:32.416262 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.416238    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phbpx\" (UniqueName: \"kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx\") pod \"590170fc-925d-43ce-9a63-1dbfe30f26c5\" (UID: \"590170fc-925d-43ce-9a63-1dbfe30f26c5\") "
May 29 02:37:32.418214 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.418180    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx" (OuterVolumeSpecName: "kube-api-access-phbpx") pod "590170fc-925d-43ce-9a63-1dbfe30f26c5" (UID: "590170fc-925d-43ce-9a63-1dbfe30f26c5"). InnerVolumeSpecName "kube-api-access-phbpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:37:32.517269 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:32.517249    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phbpx\" (UniqueName: \"kubernetes.io/projected/590170fc-925d-43ce-9a63-1dbfe30f26c5-kube-api-access-phbpx\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:37:33.083921 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.083891    2547 generic.go:358] "Generic (PLEG): container finished" podID="590170fc-925d-43ce-9a63-1dbfe30f26c5" containerID="863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94" exitCode=0
May 29 02:37:33.084273 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.083976    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b468c647d-l9qkz"
May 29 02:37:33.084273 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.083972    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b468c647d-l9qkz" event={"ID":"590170fc-925d-43ce-9a63-1dbfe30f26c5","Type":"ContainerDied","Data":"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"}
May 29 02:37:33.084273 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.084079    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b468c647d-l9qkz" event={"ID":"590170fc-925d-43ce-9a63-1dbfe30f26c5","Type":"ContainerDied","Data":"72be5cba022beda462eeab71acc33b223e2d4f10a3cacf5172836b73e3728a3a"}
May 29 02:37:33.084273 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.084095    2547 scope.go:117] "RemoveContainer" containerID="863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"
May 29 02:37:33.092070 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.092055    2547 scope.go:117] "RemoveContainer" containerID="863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"
May 29 02:37:33.092386 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:37:33.092367    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94\": container with ID starting with 863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94 not found: ID does not exist" containerID="863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"
May 29 02:37:33.092450 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.092396    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94"} err="failed to get container status \"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94\": rpc error: code = NotFound desc = could not find container \"863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94\": container with ID starting with 863f809632206c140ac1fd0bad167d029753549727f276dba028b1b8c32c3d94 not found: ID does not exist"
May 29 02:37:33.101564 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.101508    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:33.105430 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:33.105405    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b468c647d-l9qkz"]
May 29 02:37:34.839842 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:34.839810    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="590170fc-925d-43ce-9a63-1dbfe30f26c5" path="/var/lib/kubelet/pods/590170fc-925d-43ce-9a63-1dbfe30f26c5/volumes"
May 29 02:37:36.763275 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:36.763252    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:37:36.763854 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:36.763835    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:37:51.556231 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.556180    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-55bf6c96fc-2cvp6"]
May 29 02:37:51.558665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.556562    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590170fc-925d-43ce-9a63-1dbfe30f26c5" containerName="manager"
May 29 02:37:51.558665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.556574    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="590170fc-925d-43ce-9a63-1dbfe30f26c5" containerName="manager"
May 29 02:37:51.558665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.556643    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="590170fc-925d-43ce-9a63-1dbfe30f26c5" containerName="manager"
May 29 02:37:51.559634 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.559617    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.561897 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.561877    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 29 02:37:51.562000 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.561935    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z2m7m\""
May 29 02:37:51.569548 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.569524    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-55bf6c96fc-2cvp6"]
May 29 02:37:51.670962 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.670930    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.671115 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.670975    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgcs\" (UniqueName: \"kubernetes.io/projected/ab080c84-8f53-441d-b5fb-345fe400c44e-kube-api-access-dkgcs\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.771995 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.771950    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.772174 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.772018    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgcs\" (UniqueName: \"kubernetes.io/projected/ab080c84-8f53-441d-b5fb-345fe400c44e-kube-api-access-dkgcs\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.772174 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:37:51.772103    2547 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 29 02:37:51.772341 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:37:51.772182    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls podName:ab080c84-8f53-441d-b5fb-345fe400c44e nodeName:}" failed. No retries permitted until 2026-05-29 02:37:52.2721621 +0000 UTC m=+615.962117761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls") pod "maas-api-55bf6c96fc-2cvp6" (UID: "ab080c84-8f53-441d-b5fb-345fe400c44e") : secret "maas-api-serving-cert" not found
May 29 02:37:51.783018 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.782993    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgcs\" (UniqueName: \"kubernetes.io/projected/ab080c84-8f53-441d-b5fb-345fe400c44e-kube-api-access-dkgcs\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:51.956190 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.956145    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"]
May 29 02:37:51.959888 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.959860    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:51.962665 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.962637    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 29 02:37:51.962803 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.962680    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2mlqr\""
May 29 02:37:51.968271 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:51.968236    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"]
May 29 02:37:52.075157 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.075084    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4j5\" (UniqueName: \"kubernetes.io/projected/c833824a-51ad-4925-8256-212b9a4daf88-kube-api-access-2s4j5\") pod \"payload-processing-58b6c8fdc7-qt9rw\" (UID: \"c833824a-51ad-4925-8256-212b9a4daf88\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:52.176604 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.176568    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4j5\" (UniqueName: \"kubernetes.io/projected/c833824a-51ad-4925-8256-212b9a4daf88-kube-api-access-2s4j5\") pod \"payload-processing-58b6c8fdc7-qt9rw\" (UID: \"c833824a-51ad-4925-8256-212b9a4daf88\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:52.187119 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.187088    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4j5\" (UniqueName: \"kubernetes.io/projected/c833824a-51ad-4925-8256-212b9a4daf88-kube-api-access-2s4j5\") pod \"payload-processing-58b6c8fdc7-qt9rw\" (UID: \"c833824a-51ad-4925-8256-212b9a4daf88\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:52.272796 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.272702    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:52.277785 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.277760    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:52.280306 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.280283    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab080c84-8f53-441d-b5fb-345fe400c44e-maas-api-tls\") pod \"maas-api-55bf6c96fc-2cvp6\" (UID: \"ab080c84-8f53-441d-b5fb-345fe400c44e\") " pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:52.430786 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.430753    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"]
May 29 02:37:52.432820 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:37:52.432789    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc833824a_51ad_4925_8256_212b9a4daf88.slice/crio-f7923eaab192e35584034b49888ffc8b39aacee56ae573ae0be375bae3738dd5 WatchSource:0}: Error finding container f7923eaab192e35584034b49888ffc8b39aacee56ae573ae0be375bae3738dd5: Status 404 returned error can't find the container with id f7923eaab192e35584034b49888ffc8b39aacee56ae573ae0be375bae3738dd5
May 29 02:37:52.434979 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.434959    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:37:52.471125 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.471104    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:52.603210 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:52.603177    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-55bf6c96fc-2cvp6"]
May 29 02:37:52.605160 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:37:52.605135    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab080c84_8f53_441d_b5fb_345fe400c44e.slice/crio-67ccbbc26eda47f18bacc432df08bafc88c5adb3ba1952d9e7976552af56b80b WatchSource:0}: Error finding container 67ccbbc26eda47f18bacc432df08bafc88c5adb3ba1952d9e7976552af56b80b: Status 404 returned error can't find the container with id 67ccbbc26eda47f18bacc432df08bafc88c5adb3ba1952d9e7976552af56b80b
May 29 02:37:53.160560 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:53.160529    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw" event={"ID":"c833824a-51ad-4925-8256-212b9a4daf88","Type":"ContainerStarted","Data":"f7923eaab192e35584034b49888ffc8b39aacee56ae573ae0be375bae3738dd5"}
May 29 02:37:53.161627 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:53.161598    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-55bf6c96fc-2cvp6" event={"ID":"ab080c84-8f53-441d-b5fb-345fe400c44e","Type":"ContainerStarted","Data":"67ccbbc26eda47f18bacc432df08bafc88c5adb3ba1952d9e7976552af56b80b"}
May 29 02:37:55.171082 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.171051    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw" event={"ID":"c833824a-51ad-4925-8256-212b9a4daf88","Type":"ContainerStarted","Data":"4047e5833f599734af1af4afd3373162ea708505f0fa14a683ac39c4c9c18628"}
May 29 02:37:55.171647 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.171147    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:37:55.172580 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.172558    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-55bf6c96fc-2cvp6" event={"ID":"ab080c84-8f53-441d-b5fb-345fe400c44e","Type":"ContainerStarted","Data":"6d4ead4f230551b20b7362b28482c933de71ff1b26dc23d0437b3f83203dd4bd"}
May 29 02:37:55.172678 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.172656    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:37:55.189596 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.189556    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw" podStartSLOduration=2.216603956 podStartE2EDuration="4.18954219s" podCreationTimestamp="2026-05-29 02:37:51 +0000 UTC" firstStartedPulling="2026-05-29 02:37:52.435085983 +0000 UTC m=+616.125041636" lastFinishedPulling="2026-05-29 02:37:54.408024213 +0000 UTC m=+618.097979870" observedRunningTime="2026-05-29 02:37:55.187392021 +0000 UTC m=+618.877347696" watchObservedRunningTime="2026-05-29 02:37:55.18954219 +0000 UTC m=+618.879497865"
May 29 02:37:55.204671 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:37:55.204630    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-55bf6c96fc-2cvp6" podStartSLOduration=2.451102883 podStartE2EDuration="4.204620053s" podCreationTimestamp="2026-05-29 02:37:51 +0000 UTC" firstStartedPulling="2026-05-29 02:37:52.606484693 +0000 UTC m=+616.296440346" lastFinishedPulling="2026-05-29 02:37:54.360001856 +0000 UTC m=+618.049957516" observedRunningTime="2026-05-29 02:37:55.202970169 +0000 UTC m=+618.892925846" watchObservedRunningTime="2026-05-29 02:37:55.204620053 +0000 UTC m=+618.894575727"
May 29 02:38:01.182453 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:01.182424    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-55bf6c96fc-2cvp6"
May 29 02:38:06.178751 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:06.178719    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qt9rw"
May 29 02:38:28.686829 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.686792    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"]
May 29 02:38:28.691031 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.691014    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.695115 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.695089    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 29 02:38:28.695115 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.695108    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qbjgj\""
May 29 02:38:28.695326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.695212    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 29 02:38:28.695326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.695096    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 29 02:38:28.704621 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.704589    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"]
May 29 02:38:28.775567 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775537    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.775702 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775575    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c10008d6-b1e1-4688-be61-0f31430f6aef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.775702 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775636    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7str\" (UniqueName: \"kubernetes.io/projected/c10008d6-b1e1-4688-be61-0f31430f6aef-kube-api-access-z7str\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.775702 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775678    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.775702 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775701    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.775845 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.775721    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877027 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.876987    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c10008d6-b1e1-4688-be61-0f31430f6aef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877186 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877046    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7str\" (UniqueName: \"kubernetes.io/projected/c10008d6-b1e1-4688-be61-0f31430f6aef-kube-api-access-z7str\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877186 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877080    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877186 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877111    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877186 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877140    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877433 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877271    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877504 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877489    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877610    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.877695 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.877616    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.879251 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.879233    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c10008d6-b1e1-4688-be61-0f31430f6aef-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.879535 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.879521    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c10008d6-b1e1-4688-be61-0f31430f6aef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:28.887568 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:28.887546    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7str\" (UniqueName: \"kubernetes.io/projected/c10008d6-b1e1-4688-be61-0f31430f6aef-kube-api-access-z7str\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd\" (UID: \"c10008d6-b1e1-4688-be61-0f31430f6aef\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:29.003683 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:29.003616    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:29.138599 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:29.138569    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"]
May 29 02:38:29.140576 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:38:29.140547    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10008d6_b1e1_4688_be61_0f31430f6aef.slice/crio-34f0d78aa486cb1872c844af3a39ed92729c3d3f64649d45eff551a008954b7e WatchSource:0}: Error finding container 34f0d78aa486cb1872c844af3a39ed92729c3d3f64649d45eff551a008954b7e: Status 404 returned error can't find the container with id 34f0d78aa486cb1872c844af3a39ed92729c3d3f64649d45eff551a008954b7e
May 29 02:38:29.309706 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:29.309639    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd" event={"ID":"c10008d6-b1e1-4688-be61-0f31430f6aef","Type":"ContainerStarted","Data":"34f0d78aa486cb1872c844af3a39ed92729c3d3f64649d45eff551a008954b7e"}
May 29 02:38:32.326013 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:32.325926    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd" event={"ID":"c10008d6-b1e1-4688-be61-0f31430f6aef","Type":"ContainerStarted","Data":"6201634692f5c61599d255cef23ca73479286a09fbc043fc15691f335ce89d46"}
May 29 02:38:34.336110 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:34.336074    2547 generic.go:358] "Generic (PLEG): container finished" podID="c10008d6-b1e1-4688-be61-0f31430f6aef" containerID="6201634692f5c61599d255cef23ca73479286a09fbc043fc15691f335ce89d46" exitCode=0
May 29 02:38:34.336581 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:34.336145    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd" event={"ID":"c10008d6-b1e1-4688-be61-0f31430f6aef","Type":"ContainerDied","Data":"6201634692f5c61599d255cef23ca73479286a09fbc043fc15691f335ce89d46"}
May 29 02:38:36.346203 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:36.346158    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd" event={"ID":"c10008d6-b1e1-4688-be61-0f31430f6aef","Type":"ContainerStarted","Data":"051881e5f8e0ef1d9c2c68990baaa697f4a899e5735f6b3b19b0e2215fc7c518"}
May 29 02:38:36.365587 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:36.365527    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd" podStartSLOduration=2.140095476 podStartE2EDuration="8.365511823s" podCreationTimestamp="2026-05-29 02:38:28 +0000 UTC" firstStartedPulling="2026-05-29 02:38:29.142454739 +0000 UTC m=+652.832410393" lastFinishedPulling="2026-05-29 02:38:35.367871082 +0000 UTC m=+659.057826740" observedRunningTime="2026-05-29 02:38:36.364789422 +0000 UTC m=+660.054745098" watchObservedRunningTime="2026-05-29 02:38:36.365511823 +0000 UTC m=+660.055467499"
May 29 02:38:39.004061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:39.004027    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:39.004061 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:39.004067    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:39.016434 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:39.016412    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:38:39.371444 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:38:39.371421    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd"
May 29 02:42:13.195459 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.195420    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:42:13.196307 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.195653    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-8768cff59-pd9c6" podUID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" containerName="manager" containerID="cri-o://351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93" gracePeriod=30
May 29 02:42:13.443632 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.443608    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:42:13.560250 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.560220    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxbrw\" (UniqueName: \"kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw\") pod \"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2\" (UID: \"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2\") "
May 29 02:42:13.562189 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.562169    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw" (OuterVolumeSpecName: "kube-api-access-mxbrw") pod "7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" (UID: "7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2"). InnerVolumeSpecName "kube-api-access-mxbrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:42:13.661785 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:13.661754    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxbrw\" (UniqueName: \"kubernetes.io/projected/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2-kube-api-access-mxbrw\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:42:14.210153 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.210124    2547 generic.go:358] "Generic (PLEG): container finished" podID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" containerID="351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93" exitCode=0
May 29 02:42:14.210572 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.210187    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-pd9c6"
May 29 02:42:14.210572 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.210218    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-pd9c6" event={"ID":"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2","Type":"ContainerDied","Data":"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"}
May 29 02:42:14.210572 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.210254    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-pd9c6" event={"ID":"7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2","Type":"ContainerDied","Data":"18a7312e180323b6ecb5cc9ee4c776416dc0b76e115c616136dcb7cbc2ee679f"}
May 29 02:42:14.210572 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.210274    2547 scope.go:117] "RemoveContainer" containerID="351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"
May 29 02:42:14.219370 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.219357    2547 scope.go:117] "RemoveContainer" containerID="351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"
May 29 02:42:14.219600 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:42:14.219581    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93\": container with ID starting with 351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93 not found: ID does not exist" containerID="351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"
May 29 02:42:14.219664 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.219612    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93"} err="failed to get container status \"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93\": rpc error: code = NotFound desc = could not find container \"351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93\": container with ID starting with 351b2426bb68bdb079a14dfb8464705d88dd0bfdb7ace29d608b0e32e7dc2b93 not found: ID does not exist"
May 29 02:42:14.233945 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.233913    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:42:14.238183 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.238160    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8768cff59-pd9c6"]
May 29 02:42:14.840629 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.840594    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" path="/var/lib/kubelet/pods/7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2/volumes"
May 29 02:42:14.992789 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.992756    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8768cff59-6ctp6"]
May 29 02:42:14.993139 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.993128    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" containerName="manager"
May 29 02:42:14.993230 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.993141    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" containerName="manager"
May 29 02:42:14.993276 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.993228    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="7747e1cd-4be4-4cd4-a5ce-3b454dd9f5f2" containerName="manager"
May 29 02:42:14.997526 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:14.997511    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:15.000234 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.000212    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 29 02:42:15.000446 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.000430    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lxtsz\""
May 29 02:42:15.006919 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.006898    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8768cff59-6ctp6"]
May 29 02:42:15.176310 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.176284    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56r92\" (UniqueName: \"kubernetes.io/projected/ff93b93d-e048-4183-96be-587bf8db3b57-kube-api-access-56r92\") pod \"maas-controller-8768cff59-6ctp6\" (UID: \"ff93b93d-e048-4183-96be-587bf8db3b57\") " pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:15.276781 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.276754    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56r92\" (UniqueName: \"kubernetes.io/projected/ff93b93d-e048-4183-96be-587bf8db3b57-kube-api-access-56r92\") pod \"maas-controller-8768cff59-6ctp6\" (UID: \"ff93b93d-e048-4183-96be-587bf8db3b57\") " pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:15.288373 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.288349    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56r92\" (UniqueName: \"kubernetes.io/projected/ff93b93d-e048-4183-96be-587bf8db3b57-kube-api-access-56r92\") pod \"maas-controller-8768cff59-6ctp6\" (UID: \"ff93b93d-e048-4183-96be-587bf8db3b57\") " pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:15.308246 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.308227    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:15.440041 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:15.439935    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8768cff59-6ctp6"]
May 29 02:42:15.442734 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:42:15.442709    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff93b93d_e048_4183_96be_587bf8db3b57.slice/crio-04ac6288a19ce5c50ca464fc484148d47f4c9b0878923177e603a84e1967bdab WatchSource:0}: Error finding container 04ac6288a19ce5c50ca464fc484148d47f4c9b0878923177e603a84e1967bdab: Status 404 returned error can't find the container with id 04ac6288a19ce5c50ca464fc484148d47f4c9b0878923177e603a84e1967bdab
May 29 02:42:16.219326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:16.219252    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-6ctp6" event={"ID":"ff93b93d-e048-4183-96be-587bf8db3b57","Type":"ContainerStarted","Data":"03f74a26bb5ef635e53dca1d6ae1c61c47068daac8d5ae33e8f5230c12a18073"}
May 29 02:42:16.219326 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:16.219286    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8768cff59-6ctp6" event={"ID":"ff93b93d-e048-4183-96be-587bf8db3b57","Type":"ContainerStarted","Data":"04ac6288a19ce5c50ca464fc484148d47f4c9b0878923177e603a84e1967bdab"}
May 29 02:42:16.219505 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:16.219414    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:16.237187 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:16.237141    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8768cff59-6ctp6" podStartSLOduration=1.793213063 podStartE2EDuration="2.23712848s" podCreationTimestamp="2026-05-29 02:42:14 +0000 UTC" firstStartedPulling="2026-05-29 02:42:15.443957732 +0000 UTC m=+879.133913385" lastFinishedPulling="2026-05-29 02:42:15.887873148 +0000 UTC m=+879.577828802" observedRunningTime="2026-05-29 02:42:16.235809955 +0000 UTC m=+879.925765629" watchObservedRunningTime="2026-05-29 02:42:16.23712848 +0000 UTC m=+879.927084157"
May 29 02:42:27.229882 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:27.229803    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8768cff59-6ctp6"
May 29 02:42:36.805570 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:36.805535    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:42:36.807613 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:42:36.807586    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:47:36.846920 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:47:36.846893    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:47:36.854537 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:47:36.854514    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:52:36.892168 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:36.892144    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:52:36.898176 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:36.898156    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:52:36.924839 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:36.924816    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:52:36.925100 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:36.925063    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" podUID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" containerName="manager" containerID="cri-o://d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a" gracePeriod=10
May 29 02:52:37.478189 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.478168    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:52:37.543500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.543428    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume\") pod \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") "
May 29 02:52:37.543500 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.543475    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vk7j\" (UniqueName: \"kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j\") pod \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\" (UID: \"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e\") "
May 29 02:52:37.543798 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.543777    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" (UID: "2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:52:37.545432 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.545410    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j" (OuterVolumeSpecName: "kube-api-access-5vk7j") pod "2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" (UID: "2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e"). InnerVolumeSpecName "kube-api-access-5vk7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:52:37.644767 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.644740    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-extensions-socket-volume\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:52:37.644767 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.644763    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vk7j\" (UniqueName: \"kubernetes.io/projected/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e-kube-api-access-5vk7j\") on node \"ip-10-0-131-78.ec2.internal\" DevicePath \"\""
May 29 02:52:37.656268 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.656233    2547 generic.go:358] "Generic (PLEG): container finished" podID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" containerID="d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a" exitCode=0
May 29 02:52:37.656378 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.656268    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" event={"ID":"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e","Type":"ContainerDied","Data":"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"}
May 29 02:52:37.656378 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.656300    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"
May 29 02:52:37.656378 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.656315    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj" event={"ID":"2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e","Type":"ContainerDied","Data":"6f4849b605cff6f655e01cab55a1d59ce013ab18dfeebdb34186aa3cf3988b23"}
May 29 02:52:37.656378 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.656336    2547 scope.go:117] "RemoveContainer" containerID="d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"
May 29 02:52:37.668785 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.668762    2547 scope.go:117] "RemoveContainer" containerID="d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"
May 29 02:52:37.669155 ip-10-0-131-78 kubenswrapper[2547]: E0529 02:52:37.669131    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a\": container with ID starting with d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a not found: ID does not exist" containerID="d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"
May 29 02:52:37.669301 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.669162    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a"} err="failed to get container status \"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a\": rpc error: code = NotFound desc = could not find container \"d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a\": container with ID starting with d382d5bf3c7cf31ac863f45c55aeca662ed220f79d9bbe3e24b5a306d6ff706a not found: ID does not exist"
May 29 02:52:37.680366 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.680299    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:52:37.683421 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:37.683400    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dnstj"]
May 29 02:52:38.839952 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:52:38.839921    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" path="/var/lib/kubelet/pods/2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e/volumes"
May 29 02:53:43.186790 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.186757    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"]
May 29 02:53:43.187259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.187145    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" containerName="manager"
May 29 02:53:43.187259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.187157    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" containerName="manager"
May 29 02:53:43.187259 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.187259    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a6b5b9c-b0e7-4c96-91e9-d19c3bc0fb9e" containerName="manager"
May 29 02:53:43.190689 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.190673    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.200284 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.200260    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 02:53:43.200410 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.200268    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 02:53:43.200602 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.200587    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8tkjk\""
May 29 02:53:43.262146 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.262119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbea604-40e9-400a-bedb-311336455a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.262318 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.262161    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsp5n\" (UniqueName: \"kubernetes.io/projected/ecbea604-40e9-400a-bedb-311336455a09-kube-api-access-fsp5n\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.301036 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.301008    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"]
May 29 02:53:43.363220 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.363168    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsp5n\" (UniqueName: \"kubernetes.io/projected/ecbea604-40e9-400a-bedb-311336455a09-kube-api-access-fsp5n\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.363339 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.363298    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbea604-40e9-400a-bedb-311336455a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.363657 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.363637    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbea604-40e9-400a-bedb-311336455a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.380664 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.380635    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsp5n\" (UniqueName: \"kubernetes.io/projected/ecbea604-40e9-400a-bedb-311336455a09-kube-api-access-fsp5n\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nht42\" (UID: \"ecbea604-40e9-400a-bedb-311336455a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.500785 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.500722    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.675155 ip-10-0-131-78 kubenswrapper[2547]: W0529 02:53:43.675122    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbea604_40e9_400a_bedb_311336455a09.slice/crio-8a309698ddd62d508423cacb309b0e1e63655aeed29e4a1ee00c1089ff4552f6 WatchSource:0}: Error finding container 8a309698ddd62d508423cacb309b0e1e63655aeed29e4a1ee00c1089ff4552f6: Status 404 returned error can't find the container with id 8a309698ddd62d508423cacb309b0e1e63655aeed29e4a1ee00c1089ff4552f6
May 29 02:53:43.675922 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.675901    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"]
May 29 02:53:43.677491 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.677474    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:53:43.913997 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.913963    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42" event={"ID":"ecbea604-40e9-400a-bedb-311336455a09","Type":"ContainerStarted","Data":"8986b175ce1b387e972ea7f718d4abb3f05ec7a2e3fbc113f0508c138185356f"}
May 29 02:53:43.914162 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.914007    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42" event={"ID":"ecbea604-40e9-400a-bedb-311336455a09","Type":"ContainerStarted","Data":"8a309698ddd62d508423cacb309b0e1e63655aeed29e4a1ee00c1089ff4552f6"}
May 29 02:53:43.914162 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.914028    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:53:43.970351 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:43.970305    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42" podStartSLOduration=0.970291035 podStartE2EDuration="970.291035ms" podCreationTimestamp="2026-05-29 02:53:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:53:43.96629639 +0000 UTC m=+1567.656252065" watchObservedRunningTime="2026-05-29 02:53:43.970291035 +0000 UTC m=+1567.660246709"
May 29 02:53:54.920594 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:53:54.920562    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nht42"
May 29 02:57:36.923830 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:57:36.923716    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 02:57:36.932678 ip-10-0-131-78 kubenswrapper[2547]: I0529 02:57:36.932655    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 03:02:36.957944 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:02:36.957836    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 03:02:36.967165 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:02:36.967144    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 03:03:51.999931 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:51.999807    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55b468f665-f4fvq_85cf0541-617f-42d2-b97f-2091153f15fa/nginx/0.log"
May 29 03:03:52.108784 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.108723    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-dgjw6_f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5/manager/0.log"
May 29 03:03:52.228301 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.228245    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-f5567_42ff4f6e-0224-4c3d-a78c-2c7117735c29/manager/0.log"
May 29 03:03:52.346069 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.345896    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-55bf6c96fc-2cvp6_ab080c84-8f53-441d-b5fb-345fe400c44e/maas-api/0.log"
May 29 03:03:52.686401 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.686341    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8768cff59-6ctp6_ff93b93d-e048-4183-96be-587bf8db3b57/manager/0.log"
May 29 03:03:52.795345 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.795286    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-vp4zw_62701a67-4edc-41ba-8dba-6696f3bbefbf/server/0.log"
May 29 03:03:52.916035 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:52.915970    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-s5khr_33e716f6-8dcc-4fac-af8e-4ef8a9fadda2/manager/0.log"
May 29 03:03:53.279251 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:53.279151    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-p2blq_3b08e103-05c1-444a-9343-9f6817d48c46/copy-manifests/0.log"
May 29 03:03:53.287663 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:53.287613    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-p2blq_3b08e103-05c1-444a-9343-9f6817d48c46/manager/0.log"
May 29 03:03:53.390484 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:53.390422    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-cq958_9bbd43c0-4f08-45d7-8015-7663bcd01731/postgres/0.log"
May 29 03:03:54.135835 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.135762    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/util/0.log"
May 29 03:03:54.143374 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.143324    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/pull/0.log"
May 29 03:03:54.150630 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.150545    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/extract/0.log"
May 29 03:03:54.260389 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.260344    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/util/0.log"
May 29 03:03:54.268400 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.268353    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/pull/0.log"
May 29 03:03:54.276369 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.276309    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/extract/0.log"
May 29 03:03:54.387813 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.387719    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/util/0.log"
May 29 03:03:54.394761 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.394721    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/pull/0.log"
May 29 03:03:54.401545 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.401505    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/extract/0.log"
May 29 03:03:54.514451 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.514423    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/util/0.log"
May 29 03:03:54.521114 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.521083    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/pull/0.log"
May 29 03:03:54.527903 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:54.527852    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/extract/0.log"
May 29 03:03:55.213943 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:55.213918    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nht42_ecbea604-40e9-400a-bedb-311336455a09/manager/0.log"
May 29 03:03:55.916524 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:55.916488    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-hf4wf_94c43041-7cfa-48c2-97be-0f2273d4dc26/discovery/0.log"
May 29 03:03:56.028316 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:56.028292    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cf786587-szg7b_c2744b59-cce3-487e-9516-1a3eafe3de6d/kube-auth-proxy/0.log"
May 29 03:03:56.358846 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:56.358774    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qt9rw_c833824a-51ad-4925-8256-212b9a4daf88/payload-processing/0.log"
May 29 03:03:57.027398 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:57.027366    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd_c10008d6-b1e1-4688-be61-0f31430f6aef/storage-initializer/0.log"
May 29 03:03:57.034504 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:03:57.034467    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-57cdd_c10008d6-b1e1-4688-be61-0f31430f6aef/main/0.log"
May 29 03:04:04.606124 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:04.606094    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zfdhs_76485604-838e-4401-a2a7-e5b1a26ad152/global-pull-secret-syncer/0.log"
May 29 03:04:04.656666 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:04.656639    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4m2ft_1dad2726-472c-4f03-9ccd-a0e1afa69931/konnectivity-agent/0.log"
May 29 03:04:04.737371 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:04.737335    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-78.ec2.internal_33ad922ff6556f545e846ed84cd40472/haproxy/0.log"
May 29 03:04:08.256939 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.256883    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/extract/0.log"
May 29 03:04:08.289184 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.289127    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/util/0.log"
May 29 03:04:08.321692 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.321629    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t87x7_e95aca2e-9273-4d8c-9fae-c406abe36f96/pull/0.log"
May 29 03:04:08.357039 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.356985    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/extract/0.log"
May 29 03:04:08.384478 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.384416    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/util/0.log"
May 29 03:04:08.417754 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.417692    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5zhv_39bcd756-78d0-4b36-8753-2197dee2a286/pull/0.log"
May 29 03:04:08.452608 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.452550    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/extract/0.log"
May 29 03:04:08.486837 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.486787    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/util/0.log"
May 29 03:04:08.520480 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.520327    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739dnc4_a51f43b6-8903-44de-875f-9024bacf1c13/pull/0.log"
May 29 03:04:08.553840 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.553784    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/extract/0.log"
May 29 03:04:08.584451 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.584391    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/util/0.log"
May 29 03:04:08.609570 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:08.609537    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12kz7c_575698ca-0f51-447e-9e82-b85c9ca00302/pull/0.log"
May 29 03:04:09.201610 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:09.201555    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nht42_ecbea604-40e9-400a-bedb-311336455a09/manager/0.log"
May 29 03:04:10.555119 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.555089    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/alertmanager/0.log"
May 29 03:04:10.581582 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.581534    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/config-reloader/0.log"
May 29 03:04:10.606474 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.606444    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/kube-rbac-proxy-web/0.log"
May 29 03:04:10.634779 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.634751    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/kube-rbac-proxy/0.log"
May 29 03:04:10.664321 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.664295    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/kube-rbac-proxy-metric/0.log"
May 29 03:04:10.689573 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.689547    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/prom-label-proxy/0.log"
May 29 03:04:10.713767 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.713743    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55d4056b-ce05-43ee-afe4-181431890815/init-config-reloader/0.log"
May 29 03:04:10.902496 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:10.902469    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-g5wm2_82ea6570-33ea-449b-8cf0-ff78f0e5d081/monitoring-plugin/0.log"
May 29 03:04:11.023581 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:11.023556    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f64c8_f10a5f4a-1a60-4775-93b5-6ff208bc8030/node-exporter/0.log"
May 29 03:04:11.045493 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:11.045472    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f64c8_f10a5f4a-1a60-4775-93b5-6ff208bc8030/kube-rbac-proxy/0.log"
May 29 03:04:11.071090 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:11.071067    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f64c8_f10a5f4a-1a60-4775-93b5-6ff208bc8030/init-textfile/0.log"
May 29 03:04:14.660605 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:14.660570    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-bjftl_d5dd1d23-c4c6-4383-9b4b-a083417c508d/volume-data-source-validator/0.log"
May 29 03:04:15.269863 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.269831    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"]
May 29 03:04:15.273249 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.273232    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.275929 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.275909    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-btflc\"/\"default-dockercfg-md4gp\""
May 29 03:04:15.276643 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.276625    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btflc\"/\"kube-root-ca.crt\""
May 29 03:04:15.276711 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.276667    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btflc\"/\"openshift-service-ca.crt\""
May 29 03:04:15.284654 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.284631    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"]
May 29 03:04:15.342667 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.342645    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbnc\" (UniqueName: \"kubernetes.io/projected/e0d311ff-8c30-47c9-9e4c-544d458b214b-kube-api-access-brbnc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.342771 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.342687    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-proc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.342771 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.342707    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-lib-modules\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.342771 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.342743    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-podres\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.342874 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.342803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-sys\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444052 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444025    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-proc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444052 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444054    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-lib-modules\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444070    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-podres\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-sys\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444153    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brbnc\" (UniqueName: \"kubernetes.io/projected/e0d311ff-8c30-47c9-9e4c-544d458b214b-kube-api-access-brbnc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444182    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-sys\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444150    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-proc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444228    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-lib-modules\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.444242 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.444238    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0d311ff-8c30-47c9-9e4c-544d458b214b-podres\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.452574 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.452554    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbnc\" (UniqueName: \"kubernetes.io/projected/e0d311ff-8c30-47c9-9e4c-544d458b214b-kube-api-access-brbnc\") pod \"perf-node-gather-daemonset-v7dmt\" (UID: \"e0d311ff-8c30-47c9-9e4c-544d458b214b\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.583883 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.583826    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:15.599930 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.599901    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g2dsh_d152cc93-674d-4780-8fdb-5b53d2182d79/dns/0.log"
May 29 03:04:15.621743 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.621715    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g2dsh_d152cc93-674d-4780-8fdb-5b53d2182d79/kube-rbac-proxy/0.log"
May 29 03:04:15.724834 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.724807    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"]
May 29 03:04:15.726898 ip-10-0-131-78 kubenswrapper[2547]: W0529 03:04:15.726861    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode0d311ff_8c30_47c9_9e4c_544d458b214b.slice/crio-62bc2fb2972eebb7a092e4e2774c047f27183d8f9ffad92d1bf550d70e8f53b0 WatchSource:0}: Error finding container 62bc2fb2972eebb7a092e4e2774c047f27183d8f9ffad92d1bf550d70e8f53b0: Status 404 returned error can't find the container with id 62bc2fb2972eebb7a092e4e2774c047f27183d8f9ffad92d1bf550d70e8f53b0
May 29 03:04:15.728758 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.728737    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 03:04:15.750277 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:15.750244    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvf6f_fcb62fb6-4481-45c5-81e0-8b56ce82272a/dns-node-resolver/0.log"
May 29 03:04:16.215321 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.215297    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-558457cddc-qc6dk_9f64737d-09d3-4042-9584-ca5f17b46d18/registry/0.log"
May 29 03:04:16.234881 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.234861    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jqs96_daf3b546-2ad5-4170-8576-9ffeecbfa98d/node-ca/0.log"
May 29 03:04:16.673386 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.673349    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt" event={"ID":"e0d311ff-8c30-47c9-9e4c-544d458b214b","Type":"ContainerStarted","Data":"778e7fd84d7dab2b9b857e555f2ab7bec10f1922b025237ee1b5b879faea644e"}
May 29 03:04:16.673386 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.673385    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt" event={"ID":"e0d311ff-8c30-47c9-9e4c-544d458b214b","Type":"ContainerStarted","Data":"62bc2fb2972eebb7a092e4e2774c047f27183d8f9ffad92d1bf550d70e8f53b0"}
May 29 03:04:16.673579 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.673471    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:16.692567 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:16.692529    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt" podStartSLOduration=1.692517354 podStartE2EDuration="1.692517354s" podCreationTimestamp="2026-05-29 03:04:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 03:04:16.690548765 +0000 UTC m=+2200.380504461" watchObservedRunningTime="2026-05-29 03:04:16.692517354 +0000 UTC m=+2200.382473029"
May 29 03:04:17.208554 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:17.208524    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-hf4wf_94c43041-7cfa-48c2-97be-0f2273d4dc26/discovery/0.log"
May 29 03:04:17.232818 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:17.232796    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cf786587-szg7b_c2744b59-cce3-487e-9516-1a3eafe3de6d/kube-auth-proxy/0.log"
May 29 03:04:17.370861 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:17.370829    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qt9rw_c833824a-51ad-4925-8256-212b9a4daf88/payload-processing/0.log"
May 29 03:04:17.932304 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:17.932275    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8scw8_1c07db6d-7907-4d7d-8a61-859509226a07/serve-healthcheck-canary/0.log"
May 29 03:04:18.580370 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:18.580340    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk6d5_46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42/kube-rbac-proxy/0.log"
May 29 03:04:18.603892 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:18.603870    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk6d5_46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42/exporter/0.log"
May 29 03:04:18.625356 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:18.625322    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk6d5_46ada40c-e6d3-4f1c-b1c0-7eb054dc6b42/extractor/0.log"
May 29 03:04:20.697551 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:20.697519    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55b468f665-f4fvq_85cf0541-617f-42d2-b97f-2091153f15fa/nginx/0.log"
May 29 03:04:20.724618 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:20.724593    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-dgjw6_f1ed2e85-37cf-4b4d-b9e1-1cb624838cc5/manager/0.log"
May 29 03:04:20.807004 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:20.806971    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-f5567_42ff4f6e-0224-4c3d-a78c-2c7117735c29/manager/0.log"
May 29 03:04:20.844451 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:20.844410    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-55bf6c96fc-2cvp6_ab080c84-8f53-441d-b5fb-345fe400c44e/maas-api/0.log"
May 29 03:04:21.017351 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.017069    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8768cff59-6ctp6_ff93b93d-e048-4183-96be-587bf8db3b57/manager/0.log"
May 29 03:04:21.039544 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.039488    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-vp4zw_62701a67-4edc-41ba-8dba-6696f3bbefbf/server/0.log"
May 29 03:04:21.109683 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.109622    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-s5khr_33e716f6-8dcc-4fac-af8e-4ef8a9fadda2/manager/0.log"
May 29 03:04:21.336300 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.336064    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-p2blq_3b08e103-05c1-444a-9343-9f6817d48c46/manager/0.log"
May 29 03:04:21.360062 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.360005    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-p2blq_3b08e103-05c1-444a-9343-9f6817d48c46/copy-manifests/0.log"
May 29 03:04:21.388764 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:21.388708    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-cq958_9bbd43c0-4f08-45d7-8015-7663bcd01731/postgres/0.log"
May 29 03:04:22.691296 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:22.691183    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-dqc8w_d8b6bdcd-61bf-4e8b-8d3d-61cd214f596c/openshift-lws-operator/0.log"
May 29 03:04:22.694782 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:22.694736    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-v7dmt"
May 29 03:04:27.619395 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:27.619353    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-h9c8h_db9354d5-eea3-482f-bdbb-b9c7d2cac694/migrator/0.log"
May 29 03:04:27.641300 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:27.641278    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-h9c8h_db9354d5-eea3-482f-bdbb-b9c7d2cac694/graceful-termination/0.log"
May 29 03:04:28.006696 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:28.006633    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c5c9s_8163df72-915b-4049-bd3d-c5ed3ca9c73f/kube-storage-version-migrator-operator/1.log"
May 29 03:04:28.007417 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:28.007401    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-c5c9s_8163df72-915b-4049-bd3d-c5ed3ca9c73f/kube-storage-version-migrator-operator/0.log"
May 29 03:04:29.175506 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.175479    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5z9h6_aecb947e-f20b-4a7b-a3bf-cd7ebde8d3ad/kube-multus/0.log"
May 29 03:04:29.378935 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.378910    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/kube-multus-additional-cni-plugins/0.log"
May 29 03:04:29.401547 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.401527    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/egress-router-binary-copy/0.log"
May 29 03:04:29.426010 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.425961    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/cni-plugins/0.log"
May 29 03:04:29.450414 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.450396    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/bond-cni-plugin/0.log"
May 29 03:04:29.477419 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.477400    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/routeoverride-cni/0.log"
May 29 03:04:29.501353 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.501332    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/whereabouts-cni-bincopy/0.log"
May 29 03:04:29.521893 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.521877    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nct75_e24ec829-6940-4925-bf2e-e68d7bb063b8/whereabouts-cni/0.log"
May 29 03:04:29.881005 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.880978    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lqs2h_502a08f0-241a-424b-80f6-bd4840fc3be4/network-metrics-daemon/0.log"
May 29 03:04:29.903383 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:29.903360    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lqs2h_502a08f0-241a-424b-80f6-bd4840fc3be4/kube-rbac-proxy/0.log"
May 29 03:04:31.404317 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.404285    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-controller/0.log"
May 29 03:04:31.420501 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.420472    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/0.log"
May 29 03:04:31.430843 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.430819    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovn-acl-logging/1.log"
May 29 03:04:31.450741 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.450717    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/kube-rbac-proxy-node/0.log"
May 29 03:04:31.472956 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.472936    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/kube-rbac-proxy-ovn-metrics/0.log"
May 29 03:04:31.493534 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.493520    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/northd/0.log"
May 29 03:04:31.516781 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.516762    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/nbdb/0.log"
May 29 03:04:31.539800 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.539778    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/sbdb/0.log"
May 29 03:04:31.639775 ip-10-0-131-78 kubenswrapper[2547]: I0529 03:04:31.639753    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-97cs5_c9adf29d-9694-4db4-9483-e4ea17603a11/ovnkube-controller/0.log"