Jun 03 17:48:25.027871 ip-10-0-128-189 systemd[1]: Starting Kubernetes Kubelet... Jun 03 17:48:25.410489 ip-10-0-128-189 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:48:25.410489 ip-10-0-128-189 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 17:48:25.410489 ip-10-0-128-189 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:48:25.410489 ip-10-0-128-189 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 17:48:25.411167 ip-10-0-128-189 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:48:25.413026 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.412940 2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417930 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417981 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417986 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417990 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417993 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:48:25.417986 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417996 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.417999 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418002 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418005 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418007 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418013 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418018 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418021 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418024 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418027 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418030 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418032 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418035 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418039 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418042 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418045 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418048 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418050 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418053 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:48:25.418216 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418055 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418058 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418061 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418063 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418066 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418068 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418070 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418073 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418076 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418079 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418082 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418085 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418087 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418089 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418092 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418095 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418098 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418100 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418103 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418105 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:48:25.418693 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418108 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418110 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418114 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418117 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418119 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418122 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418125 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418128 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418130 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418133 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418136 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418138 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418141 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418143 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418146 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418148 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418150 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418153 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418156 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:48:25.419193 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418158 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418160 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418163 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418165 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418168 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418170 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418172 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418175 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418179 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418182 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418185 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418188 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418190 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418192 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418195 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418205 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418208 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418210 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418213 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418216 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:48:25.419671 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418218 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418221 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418223 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418667 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418673 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418676 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418680 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418682 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418685 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418688 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418690 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418693 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418695 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418698 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418701 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418703 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418706 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418708 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418711 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418713 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:48:25.420156 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418717 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418719 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418722 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418724 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418727 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418730 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418732 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418742 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418745 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418747 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418749 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418752 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418754 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418756 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418759 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418761 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418764 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418766 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418769 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418771 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:48:25.420665 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418774 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418776 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418778 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418781 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418783 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418785 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418788 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418790 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418792 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418795 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418797 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418800 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418803 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418806 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418808 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418811 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418813 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418816 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418823 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418826 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:48:25.421166 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418834 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418837 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418841 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418845 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418848 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418850 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418853 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418855 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418858 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418860 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418862 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418865 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418867 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418870 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418872 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418875 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418877 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418879 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418882 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:48:25.421678 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418884 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418886 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418888 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418893 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418897 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418902 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418904 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418907 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418910 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.418912 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.418995 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419003 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419015 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419019 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419030 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419033 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419037 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419042 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419044 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419048 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419051 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 17:48:25.422150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419054 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419057 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419060 2581 flags.go:64] FLAG: --cgroup-root="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419062 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419065 2581 flags.go:64] FLAG: --client-ca-file="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419068 2581 flags.go:64] FLAG: --cloud-config="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419070 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419073 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419080 2581 flags.go:64] FLAG: --cluster-domain="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419083 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419086 2581 flags.go:64] FLAG: --config-dir="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419088 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419092 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419095 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419098 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419102 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419106 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419109 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419112 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419115 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419118 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419121 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419129 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419132 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419135 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 17:48:25.422707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419138 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419147 2581 flags.go:64] FLAG: --enable-server="true" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419150 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419156 2581 flags.go:64] FLAG: --event-burst="100" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419159 2581 flags.go:64] FLAG: --event-qps="50" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419162 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419165 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419168 2581 flags.go:64] FLAG: --eviction-hard="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419171 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419174 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419177 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419179 2581 flags.go:64] FLAG: --eviction-soft="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419182 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419185 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419188 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419190 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419193 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419196 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419199 2581 flags.go:64] FLAG: --feature-gates="" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419203 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419206 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419209 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419213 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419216 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419218 2581 flags.go:64] FLAG: --help="false" Jun 03 17:48:25.423341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419221 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419224 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419227 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419230 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419233 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419237 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419240 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419242 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419245 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419259 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419262 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419265 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419267 2581 flags.go:64] FLAG: --kube-reserved="" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419270 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419273 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419276 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419278 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419281 2581 flags.go:64] FLAG: --lock-file="" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419284 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419287 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419290 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419295 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419298 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419300 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 17:48:25.423989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419303 2581 flags.go:64] FLAG: --logging-format="text" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419306 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419309 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419312 2581 flags.go:64] FLAG: --manifest-url="" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419314 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419319 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419322 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419326 2581 flags.go:64] FLAG: --max-pods="110" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419329 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419332 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419335 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419338 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419341 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419343 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419346 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419353 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419356 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419359 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419368 2581 flags.go:64] FLAG: --pod-cidr="" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419371 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419376 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419379 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419382 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419385 2581 flags.go:64] FLAG: --port="10250" Jun 03 17:48:25.424591 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419397 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419401 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-072d15dcdb466cfe8" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419404 2581 flags.go:64] FLAG: --qos-reserved="" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419408 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419411 2581 flags.go:64] FLAG: --register-node="true" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419414 2581 flags.go:64] FLAG: --register-schedulable="true" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419419 2581 flags.go:64] FLAG: --register-with-taints="" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419423 2581 flags.go:64] FLAG: --registry-burst="10" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419426 2581 flags.go:64] FLAG: --registry-qps="5" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419428 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419431 2581 flags.go:64] FLAG: --reserved-memory="" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419435 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419438 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419442 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419445 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419448 2581 flags.go:64] FLAG: --runonce="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419450 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419453 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419456 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419459 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419461 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419464 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419467 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419470 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419473 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419475 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 17:48:25.425195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419478 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419486 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419489 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419492 2581 flags.go:64] FLAG: --system-cgroups="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419495 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419501 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419516 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419519 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419526 2581 flags.go:64] FLAG: --tls-min-version="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419528 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419531 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419534 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419538 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419541 2581 flags.go:64] FLAG: --v="2" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419545 2581 flags.go:64] FLAG: --version="false" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419549 2581 flags.go:64] FLAG: --vmodule="" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419553 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419556 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419657 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419662 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419666 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419668 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419671 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:48:25.425867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419674 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419677 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419679 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419682 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419685 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419687 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419690 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419692 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419695 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419697 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419700 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419708 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419711 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419713 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419716 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419718 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419721 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419723 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419725 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419728 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:48:25.426410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419731 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419734 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419736 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419740 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419743 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419746 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419748 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419751 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419755 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419757 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419760 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419763 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419765 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419768 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419770 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419772 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419775 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419777 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419780 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:48:25.426999 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419782 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419785 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419787 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419790 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419793 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419802 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419805 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419808 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419810 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419813 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419815 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419818 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419820 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419823 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419826 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419828 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419831 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419833 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419836 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419838 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:48:25.427470 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419841 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419845 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419848 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419850 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419853 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419855 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419858 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419860 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419863 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419865 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419867 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419870 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419872 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419876 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419879 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419882 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419885 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419887 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419895 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:48:25.428080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419898 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419901 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.419903 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.419909 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.427792 2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.427814 2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427867 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427872 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427878 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427882 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427886 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427889 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427892 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427894 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427897 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:48:25.428580 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427900 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427903 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427906 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427909 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427912 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427914 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427917 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427920 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427923 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427926 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427928 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427932 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427935 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427938 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427941 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427944 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427947 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427950 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427952 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427955 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:48:25.428971 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427958 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427961 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427965 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427968 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427970 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427973 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427976 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427980 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427984 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427987 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427990 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427992 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427995 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.427998 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428000 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428003 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428006 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428009 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428013 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428015 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:48:25.429498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428018 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428020 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428023 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428026 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428028 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428031 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428033 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428035 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428038 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428041 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428043 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428046 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428049 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428052 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428055 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428058 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428061 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428064 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428066 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428069 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:48:25.430080 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428072 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428074 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428076 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428079 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428081 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428084 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428087 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428090 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428093 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428095 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428098 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428101 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428103 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428106 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428108 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428110 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:48:25.430594 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428113 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.428118 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428230 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428234 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428237 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428240 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428242 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428245 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428248 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428250 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428253 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428256 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428259 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428262 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428264 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:48:25.431434 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428267 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428269 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428272 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428274 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428277 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428279 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428282 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428284 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428287 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428289 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428292 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428295 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428297 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428300 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428302 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428304 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428307 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428310 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428312 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:48:25.431836 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428314 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428317 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428319 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428322 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428324 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428327 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428330 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428332 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428335 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428337 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428340 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428346 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428348 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428351 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428354 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428356 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428358 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428361 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428363 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428366 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:48:25.432356 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428368 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428370 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428373 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428376 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428380 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428383 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428386 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428389 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428392 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428395 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428397 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428400 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428403 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428406 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428409 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428411 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428414 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428417 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428420 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:48:25.432963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428422 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428425 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428427 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428430 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428432 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428435 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428438 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428441 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428444 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428447 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428449 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428452 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428454 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428457 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:25.428459 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.428465 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:48:25.433437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.429165 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 17:48:25.433918 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.432376 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 17:48:25.433918 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.433331 2581 server.go:1019] "Starting client certificate rotation" Jun 03 17:48:25.433918 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.433428 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 17:48:25.433918 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.433458 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 17:48:25.455718 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.455695 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 17:48:25.460695 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.460672 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 17:48:25.475047 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.475029 2581 log.go:25] "Validated CRI v1 runtime API" Jun 03 17:48:25.481570 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.481553 2581 log.go:25] "Validated CRI v1 image API" Jun 03 17:48:25.482753 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.482736 2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 17:48:25.485039 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.485018 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d91166f8-be29-46ea-adaf-a6a7c9ada9df:/dev/nvme0n1p4 ded602d8-846e-44c0-89bf-ef2a0b596322:/dev/nvme0n1p3] Jun 03 17:48:25.485099 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.485040 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 17:48:25.489443 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.489331 2581 manager.go:217] Machine: {Timestamp:2026-06-03 17:48:25.488808312 +0000 UTC m=+0.358106897 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101364 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec242d2cbb257bcbfee7f3fb114273bc SystemUUID:ec242d2c-bb25-7bcb-fee7-f3fb114273bc BootID:0a753e28-3c7c-4506-acb4-01d5c252c97c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:e0:03:ed:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:e0:03:ed:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:49:9d:19:b6:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 17:48:25.490010 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.489999 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 17:48:25.490109 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.490096 2581 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 17:48:25.492856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.492824 2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 17:48:25.493040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.492859 2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 17:48:25.493125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.493055 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 17:48:25.493125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.493067 2581 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 17:48:25.493125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.493078 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 17:48:25.494380 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.494363 2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 17:48:25.494893 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.494873 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 17:48:25.495789 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.495776 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 17:48:25.495915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.495905 2581 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 17:48:25.497923 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.497913 2581 kubelet.go:491] "Attempting to sync node with API server" Jun 03 17:48:25.497970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.497929 2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 17:48:25.497970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.497941 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 17:48:25.497970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.497950 2581 kubelet.go:397] "Adding apiserver pod source" Jun 03 17:48:25.497970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.497959 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 17:48:25.498922 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.498910 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 17:48:25.498977 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.498930 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 17:48:25.502346 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.502331 2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 17:48:25.508531 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.508492 2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 17:48:25.510395 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510381 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510398 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510405 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510411 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510433 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510443 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510452 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510460 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 17:48:25.510468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510470 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 17:48:25.510821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510476 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 17:48:25.510821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510494 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 17:48:25.510821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.510500 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 17:48:25.511245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.511229 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 17:48:25.511245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.511246 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 17:48:25.512749 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.512730 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:48:25.513034 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.513010 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 17:48:25.514955 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.514942 2581 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 17:48:25.515012 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.514985 2581 server.go:1295] "Started kubelet" Jun 03 17:48:25.515337 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.515311 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 17:48:25.515705 ip-10-0-128-189 systemd[1]: Started Kubernetes Kubelet. Jun 03 17:48:25.517337 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.517318 2581 server.go:317] "Adding debug handlers to kubelet server" Jun 03 17:48:25.518260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.518220 2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 17:48:25.518345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.518280 2581 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 17:48:25.519133 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.519117 2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 17:48:25.523498 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.523473 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rxfmz" Jun 03 17:48:25.523716 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.523700 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 17:48:25.524071 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524054 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 17:48:25.524290 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524244 2581 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 17:48:25.524290 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524279 2581 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 17:48:25.524422 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524399 2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 17:48:25.524770 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.524737 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:25.524880 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524802 2581 factory.go:55] Registering systemd factory Jun 03 17:48:25.524980 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.524960 2581 factory.go:223] Registration of the systemd container factory successfully Jun 03 17:48:25.525080 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.525074 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 03 17:48:25.525136 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.525083 2581 reconciler.go:26] "Reconciler: start to sync state" Jun 03 17:48:25.525425 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.525387 2581 factory.go:153] Registering CRI-O factory Jun 03 17:48:25.526352 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.526322 2581 factory.go:223] Registration of the crio container factory successfully Jun 03 17:48:25.526534 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.526521 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 17:48:25.526644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.526634 2581 factory.go:103] Registering Raw factory Jun 03 17:48:25.526807 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.526581 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:25.527007 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.526987 2581 manager.go:1196] Started watching for new ooms in manager Jun 03 17:48:25.527559 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.527544 2581 manager.go:319] Starting recovery of all containers Jun 03 17:48:25.531645 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.531476 2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 17:48:25.532087 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.528589 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a80a374dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.514955996 +0000 UTC m=+0.384254582,LastTimestamp:2026-06-03 17:48:25.514955996 +0000 UTC m=+0.384254582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.536782 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.536754 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 17:48:25.536910 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.536892 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 17:48:25.540370 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.540352 2581 manager.go:324] Recovery completed Jun 03 17:48:25.544436 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.544421 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.546466 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.546450 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.546573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.546490 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.546573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.546567 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.547109 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.547091 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 17:48:25.547109 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.547109 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 17:48:25.547182 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.547126 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 17:48:25.549098 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.549029 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.549398 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.549385 2581 policy_none.go:49] "None policy: Start" Jun 03 17:48:25.549480 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.549404 2581 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 17:48:25.549480 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.549418 2581 state_mem.go:35] "Initializing new in-memory state store" Jun 03 17:48:25.563749 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.563680 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.573964 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.573891 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.585213 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585198 2581 manager.go:341] "Starting Device Plugin manager" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.585242 2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585261 2581 server.go:85] "Starting device plugin registration server" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585574 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585594 2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585702 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585777 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.585784 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.586285 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.586313 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:25.600656 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.596681 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a84f99db2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.58771141 +0000 UTC m=+0.457009982,LastTimestamp:2026-06-03 17:48:25.58771141 +0000 UTC m=+0.457009982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.659253 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.659218 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 17:48:25.660561 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.660524 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 17:48:25.660561 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.660547 2581 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 17:48:25.660696 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.660563 2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 17:48:25.660696 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.660569 2581 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 17:48:25.660696 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.660600 2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 17:48:25.671455 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.671435 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 03 17:48:25.686690 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.686671 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.687722 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.687706 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.687781 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.687739 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.687781 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.687749 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.687781 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.687772 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.697969 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.697903 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.687721933 +0000 UTC m=+0.557020518,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.707140 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.707080 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.687744279 +0000 UTC m=+0.557042864,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.707242 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.707141 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.716989 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.716921 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.687753803 +0000 UTC m=+0.557052387,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.746103 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.746072 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 03 17:48:25.761306 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.761268 2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal"] Jun 03 17:48:25.761387 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.761359 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.762145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.762127 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.762214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.762158 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.762214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.762170 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.763319 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.763306 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.765246 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.764114 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.765246 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.764157 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.765907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765802 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.765907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765834 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.765907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765802 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.765907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765849 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.766125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765883 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.766125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.765937 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.766928 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.766913 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.766998 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.766939 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.767576 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.767560 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.767633 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.767591 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.767633 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.767606 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.771809 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.771733 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.762144921 +0000 UTC m=+0.631443507,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.781456 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.781390 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.762162727 +0000 UTC m=+0.631461312,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.789885 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.789825 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.762174176 +0000 UTC m=+0.631472761,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.800859 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.800798 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.765820925 +0000 UTC m=+0.635119511,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.803350 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.803331 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.807808 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.807790 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.813490 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.813426 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.765842759 +0000 UTC m=+0.635141330,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.821992 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.821932 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.765862507 +0000 UTC m=+0.635161098,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.826221 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.826202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.826284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.826240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.826284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.826255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08d0c7f0753ab2c047bc1d790cbbe027-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"08d0c7f0753ab2c047bc1d790cbbe027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.830344 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.830285 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.765894227 +0000 UTC m=+0.635192811,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.840319 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.840260 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.765929002 +0000 UTC m=+0.635227589,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.850226 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.850151 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.765943091 +0000 UTC m=+0.635241678,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.857817 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.857757 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.76757782 +0000 UTC m=+0.636876417,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.867011 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.866938 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.767598625 +0000 UTC m=+0.636897213,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.875949 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.875886 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.767610956 +0000 UTC m=+0.636909540,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.908134 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.908108 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:25.909031 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.909014 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:25.909118 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.909044 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:25.909118 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.909056 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:25.909118 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.909091 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.916610 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.916479 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:25.909031355 +0000 UTC m=+0.778329939,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.925108 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.925088 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.925197 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.925140 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:25.909049075 +0000 UTC m=+0.778347659,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:25.926888 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.926872 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.926934 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.926897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.926934 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.926915 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08d0c7f0753ab2c047bc1d790cbbe027-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"08d0c7f0753ab2c047bc1d790cbbe027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.927012 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.926982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.927051 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.927036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c163294ff817eb9bdf95e12ae1833b8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"c163294ff817eb9bdf95e12ae1833b8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.927084 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:25.927070 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08d0c7f0753ab2c047bc1d790cbbe027-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"08d0c7f0753ab2c047bc1d790cbbe027\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:48:25.933051 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:25.932995 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8285e46e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8285e46e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.54657291 +0000 UTC m=+0.415871496,LastTimestamp:2026-06-03 17:48:25.909059368 +0000 UTC m=+0.778357953,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:26.105865 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.105815 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:48:26.110319 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.110297 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:48:26.155213 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.155181 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jun 03 17:48:26.325938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.325867 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:26.332404 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.332383 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:26.332488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.332422 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:26.332488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.332436 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:26.332488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.332461 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:26.350347 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.350251 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284465f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284465f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546466911 +0000 UTC m=+0.415765496,LastTimestamp:2026-06-03 17:48:26.332401195 +0000 UTC m=+1.201699780,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:26.361398 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.361369 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:26.361544 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.361459 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b5a36a8284b94c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b5a36a8284b94c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:25.546496332 +0000 UTC m=+0.415794917,LastTimestamp:2026-06-03 17:48:26.332429848 +0000 UTC m=+1.201728435,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:26.529668 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.529643 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:26.655997 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:26.655958 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d0c7f0753ab2c047bc1d790cbbe027.slice/crio-39221577f89a19998c6c2c31d5d0032060c3368d4dbc957a207cd5db46fc667b WatchSource:0}: Error finding container 39221577f89a19998c6c2c31d5d0032060c3368d4dbc957a207cd5db46fc667b: Status 404 returned error can't find the container with id 39221577f89a19998c6c2c31d5d0032060c3368d4dbc957a207cd5db46fc667b Jun 03 17:48:26.656222 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:48:26.656201 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc163294ff817eb9bdf95e12ae1833b8b.slice/crio-230f1ad37695ab837d255283214db307293efdd6698aefb849b677dde3d140c9 WatchSource:0}: Error finding container 230f1ad37695ab837d255283214db307293efdd6698aefb849b677dde3d140c9: Status 404 returned error can't find the container with id 230f1ad37695ab837d255283214db307293efdd6698aefb849b677dde3d140c9 Jun 03 17:48:26.659262 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.659243 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:48:26.663213 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.663174 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerStarted","Data":"230f1ad37695ab837d255283214db307293efdd6698aefb849b677dde3d140c9"} Jun 03 17:48:26.664245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:26.664221 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" event={"ID":"08d0c7f0753ab2c047bc1d790cbbe027","Type":"ContainerStarted","Data":"39221577f89a19998c6c2c31d5d0032060c3368d4dbc957a207cd5db46fc667b"} Jun 03 17:48:26.669279 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.669211 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36ac4db7fc3 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78053b8e01dc3fb4442aa8f899787540074d67b84813d6893e947fcea00491c1\",Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:26.659479491 +0000 UTC m=+1.528778063,LastTimestamp:2026-06-03 17:48:26.659479491 +0000 UTC m=+1.528778063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:26.681156 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.681091 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-128-189.ec2.internal.18b5a36ac4dcd7fc kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-128-189.ec2.internal,UID:08d0c7f0753ab2c047bc1d790cbbe027,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac316082bf8e6d5cbd8d6a480bae4e50b88ceb613312fbd0406df7b843140f37\",Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:26.659567612 +0000 UTC m=+1.528866197,LastTimestamp:2026-06-03 17:48:26.659567612 +0000 UTC m=+1.528866197,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:26.841612 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.841578 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 17:48:26.964830 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.964750 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Jun 03 17:48:26.981928 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.981885 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 17:48:26.982047 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:26.981987 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:48:27.155031 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:27.154956 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 03 17:48:27.162291 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.162265 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:27.163394 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.163368 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:27.163488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.163406 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:27.163488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.163422 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:27.163488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.163456 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:27.181764 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:27.181723 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:27.535712 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:27.535678 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:28.302926 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.302819 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-128-189.ec2.internal.18b5a36b2636bbbe kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-128-189.ec2.internal,UID:08d0c7f0753ab2c047bc1d790cbbe027,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac316082bf8e6d5cbd8d6a480bae4e50b88ceb613312fbd0406df7b843140f37\" in 1.633s (1.633s including waiting). Image size: 305026820 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.292848574 +0000 UTC m=+3.162147162,LastTimestamp:2026-06-03 17:48:28.292848574 +0000 UTC m=+3.162147162,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.312403 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.312300 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b2645bc0a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78053b8e01dc3fb4442aa8f899787540074d67b84813d6893e947fcea00491c1\" in 1.634s (1.634s including waiting). Image size: 292844541 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.29383169 +0000 UTC m=+3.163130275,LastTimestamp:2026-06-03 17:48:28.29383169 +0000 UTC m=+3.163130275,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.362159 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.361946 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-128-189.ec2.internal.18b5a36b29c9537d kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-128-189.ec2.internal,UID:08d0c7f0753ab2c047bc1d790cbbe027,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.352787325 +0000 UTC m=+3.222085898,LastTimestamp:2026-06-03 17:48:28.352787325 +0000 UTC m=+3.222085898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.371945 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.371851 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-128-189.ec2.internal.18b5a36b2a37f96a kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-128-189.ec2.internal,UID:08d0c7f0753ab2c047bc1d790cbbe027,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.360038762 +0000 UTC m=+3.229337334,LastTimestamp:2026-06-03 17:48:28.360038762 +0000 UTC m=+3.229337334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.535892 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.535872 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:28.545982 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.545857 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b34a92ad8 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.535229144 +0000 UTC m=+3.404527737,LastTimestamp:2026-06-03 17:48:28.535229144 +0000 UTC m=+3.404527737,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.554624 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.554551 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b352a55eb openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.543694315 +0000 UTC m=+3.412992908,LastTimestamp:2026-06-03 17:48:28.543694315 +0000 UTC m=+3.412992908,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.574215 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.574183 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" Jun 03 17:48:28.668428 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.668394 2581 generic.go:358] "Generic (PLEG): container finished" podID="c163294ff817eb9bdf95e12ae1833b8b" containerID="a03944a7949d354d7fc17b75f612fdea971d165ce9d25042ef71f56f3465781e" exitCode=0 Jun 03 17:48:28.668599 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.668460 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerDied","Data":"a03944a7949d354d7fc17b75f612fdea971d165ce9d25042ef71f56f3465781e"} Jun 03 17:48:28.668599 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.668480 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:28.669370 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.669350 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:28.669478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.669383 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:28.669478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.669396 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:28.669691 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.669675 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:28.669762 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.669674 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" event={"ID":"08d0c7f0753ab2c047bc1d790cbbe027","Type":"ContainerStarted","Data":"342112f80cdb898ccc09865db97320e6d7cb67204c50e33372c1151de66a2557"} Jun 03 17:48:28.669815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.669766 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:28.670408 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.670393 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:28.670528 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.670421 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:28.670528 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.670433 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:28.670619 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.670583 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:28.681070 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.680998 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b3ccd1974 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78053b8e01dc3fb4442aa8f899787540074d67b84813d6893e947fcea00491c1\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.671801716 +0000 UTC m=+3.541100307,LastTimestamp:2026-06-03 17:48:28.671801716 +0000 UTC m=+3.541100307,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.759053 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.758940 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b414f8ae2 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.747459298 +0000 UTC m=+3.616757893,LastTimestamp:2026-06-03 17:48:28.747459298 +0000 UTC m=+3.616757893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.767988 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.767454 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b41c996db openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.755457755 +0000 UTC m=+3.624756349,LastTimestamp:2026-06-03 17:48:28.755457755 +0000 UTC m=+3.624756349,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:28.768189 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.768167 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:48:28.782469 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.782450 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:28.783407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.783380 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:28.783407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.783407 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:28.783580 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.783417 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:28.783580 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:28.783445 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:28.801075 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:28.801023 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:29.537016 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.536984 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:29.672104 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.672079 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/0.log" Jun 03 17:48:29.672416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.672395 2581 generic.go:358] "Generic (PLEG): container finished" podID="c163294ff817eb9bdf95e12ae1833b8b" containerID="f32fac5a1097f07e5dac644bde43c849018d6df1eb4636ddf86a11e7b3880842" exitCode=1 Jun 03 17:48:29.672486 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.672476 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:29.672571 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.672485 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerDied","Data":"f32fac5a1097f07e5dac644bde43c849018d6df1eb4636ddf86a11e7b3880842"} Jun 03 17:48:29.672571 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.672478 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:29.673296 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673279 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:29.673296 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673285 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:29.673414 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673310 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:29.673414 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673324 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:29.673414 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673311 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:29.673414 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673353 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:29.673563 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.673500 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:29.673563 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:29.673557 2581 scope.go:117] "RemoveContainer" containerID="f32fac5a1097f07e5dac644bde43c849018d6df1eb4636ddf86a11e7b3880842" Jun 03 17:48:29.673630 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.673619 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:29.684381 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.684304 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b3ccd1974\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b3ccd1974 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78053b8e01dc3fb4442aa8f899787540074d67b84813d6893e947fcea00491c1\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.671801716 +0000 UTC m=+3.541100307,LastTimestamp:2026-06-03 17:48:29.675474278 +0000 UTC m=+4.544772872,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:29.762099 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.762022 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b414f8ae2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b414f8ae2 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.747459298 +0000 UTC m=+3.616757893,LastTimestamp:2026-06-03 17:48:29.753703064 +0000 UTC m=+4.623001657,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:29.772295 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.772208 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b41c996db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b41c996db openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.755457755 +0000 UTC m=+3.624756349,LastTimestamp:2026-06-03 17:48:29.761760214 +0000 UTC m=+4.631058793,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:29.958757 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:29.958723 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 17:48:30.018779 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:30.018750 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 03 17:48:30.169787 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:30.169720 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 17:48:30.537070 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.536993 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:30.675491 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.675462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/1.log" Jun 03 17:48:30.675898 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.675883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/0.log" Jun 03 17:48:30.676197 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.676175 2581 generic.go:358] "Generic (PLEG): container finished" podID="c163294ff817eb9bdf95e12ae1833b8b" containerID="bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29" exitCode=1 Jun 03 17:48:30.676278 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.676210 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerDied","Data":"bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29"} Jun 03 17:48:30.676278 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.676238 2581 scope.go:117] "RemoveContainer" containerID="f32fac5a1097f07e5dac644bde43c849018d6df1eb4636ddf86a11e7b3880842" Jun 03 17:48:30.676278 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.676254 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:30.678287 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.678270 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:30.678360 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.678304 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:30.678360 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.678314 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:30.678567 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:30.678554 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:30.678634 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:30.678607 2581 scope.go:117] "RemoveContainer" containerID="bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29" Jun 03 17:48:30.678764 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:30.678738 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podUID="c163294ff817eb9bdf95e12ae1833b8b" Jun 03 17:48:30.686766 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:30.686694 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36bb46c0efb openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b),Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:30.678707963 +0000 UTC m=+5.548006548,LastTimestamp:2026-06-03 17:48:30.678707963 +0000 UTC m=+5.548006548,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:31.537672 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.537641 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:31.678674 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.678651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/1.log" Jun 03 17:48:31.679101 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.679086 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:31.679905 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.679888 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:31.679970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.679923 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:31.679970 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.679933 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:31.680150 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:31.680138 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:31.680193 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:31.680184 2581 scope.go:117] "RemoveContainer" containerID="bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29" Jun 03 17:48:31.680318 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:31.680302 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podUID="c163294ff817eb9bdf95e12ae1833b8b" Jun 03 17:48:31.689017 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:31.688948 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36bb46c0efb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36bb46c0efb openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b),Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:30.678707963 +0000 UTC m=+5.548006548,LastTimestamp:2026-06-03 17:48:31.680274113 +0000 UTC m=+6.549572686,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:31.783650 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:31.783620 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s" Jun 03 17:48:32.001781 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.001709 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:32.002635 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.002618 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:32.002694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.002653 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:32.002694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.002666 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:32.002694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.002693 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:32.020306 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:32.020280 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:32.120442 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:32.120411 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:48:32.541080 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:32.541054 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:33.536179 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:33.536145 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:33.584165 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:33.584135 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 17:48:34.537550 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:34.537500 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:35.536109 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:35.536079 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:35.586591 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:35.586564 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:35.588348 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:35.588325 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 17:48:35.619165 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:35.619137 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 03 17:48:36.535949 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:36.535918 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:37.538040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:37.538011 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:38.193165 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:38.193139 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Jun 03 17:48:38.421217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.421176 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:38.422237 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.422219 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:38.422356 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.422252 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:38.422356 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.422269 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:38.422356 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.422295 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:38.438300 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:38.438266 2581 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:38.537119 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:38.537091 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:39.536266 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:39.536234 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:40.538986 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:40.538949 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:41.124163 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:41.124132 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:48:41.536924 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:41.536894 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:42.538179 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.538145 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:42.661817 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.661789 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:42.662794 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.662765 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:42.662794 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.662799 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:42.662997 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.662810 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:42.663050 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:42.663032 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:42.663098 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:42.663079 2581 scope.go:117] "RemoveContainer" containerID="bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29" Jun 03 17:48:42.676164 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:42.676078 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b3ccd1974\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b3ccd1974 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78053b8e01dc3fb4442aa8f899787540074d67b84813d6893e947fcea00491c1\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.671801716 +0000 UTC m=+3.541100307,LastTimestamp:2026-06-03 17:48:42.665240522 +0000 UTC m=+17.534539115,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:42.744647 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:42.744576 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b414f8ae2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b414f8ae2 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.747459298 +0000 UTC m=+3.616757893,LastTimestamp:2026-06-03 17:48:42.735694741 +0000 UTC m=+17.604993336,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:42.753432 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:42.753354 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b41c996db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36b41c996db openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:28.755457755 +0000 UTC m=+3.624756349,LastTimestamp:2026-06-03 17:48:42.743062461 +0000 UTC m=+17.612361033,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:43.536713 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.536681 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:48:43.697801 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.697775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:48:43.698190 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.698170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/1.log" Jun 03 17:48:43.698474 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.698457 2581 generic.go:358] "Generic (PLEG): container finished" podID="c163294ff817eb9bdf95e12ae1833b8b" containerID="7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd" exitCode=1 Jun 03 17:48:43.698545 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.698492 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerDied","Data":"7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd"} Jun 03 17:48:43.698585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.698543 2581 scope.go:117] "RemoveContainer" containerID="bfe17f415bbc21f20a60caca68f61f5008450d61fba4fb1496a31bc0df488f29" Jun 03 17:48:43.698634 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.698620 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:43.700061 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.700047 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:43.700122 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.700076 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:43.700122 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.700088 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:43.700311 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:43.700290 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:43.700410 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:43.700346 2581 scope.go:117] "RemoveContainer" containerID="7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd" Jun 03 17:48:43.700489 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:43.700474 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podUID="c163294ff817eb9bdf95e12ae1833b8b" Jun 03 17:48:43.709422 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:43.709348 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36bb46c0efb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal.18b5a36bb46c0efb openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal,UID:c163294ff817eb9bdf95e12ae1833b8b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b),Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-03 17:48:30.678707963 +0000 UTC m=+5.548006548,LastTimestamp:2026-06-03 17:48:43.70044728 +0000 UTC m=+18.569745865,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 03 17:48:44.414684 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.414649 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rxfmz" Jun 03 17:48:44.433710 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.433688 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 17:48:44.448280 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.448254 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:48:44.553447 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.553422 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.572415 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.572395 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.640001 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.639978 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.701482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.701419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:48:44.921325 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.921293 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.921325 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:44.921333 2581 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.958143 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.958092 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:44.975206 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:44.975191 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:45.034573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.034544 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:45.198425 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.198396 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:45.245993 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.245964 2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:48:45.311203 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.311175 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:45.311203 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.311200 2581 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-128-189.ec2.internal" not found Jun 03 17:48:45.415991 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.415950 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 17:43:44 +0000 UTC" deadline="2028-02-24 08:58:23.33651629 +0000 UTC" Jun 03 17:48:45.415991 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.415988 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15135h9m37.920532844s" Jun 03 17:48:45.438563 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.438541 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:45.439638 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.439620 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:45.439725 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.439651 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:45.439725 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.439662 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:45.439725 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.439689 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:45.445496 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.445480 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:45.445577 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.445516 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-189.ec2.internal\": node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.466418 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.466397 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.532694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.532630 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 17:48:45.544705 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.544682 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 17:48:45.567460 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.567436 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.579496 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.579475 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcxgp" Jun 03 17:48:45.586716 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.586701 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.593406 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:45.593386 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcxgp" Jun 03 17:48:45.667769 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.667743 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.768216 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.768188 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.868671 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.868609 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:45.969246 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:45.969205 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.069828 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.069789 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.170269 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.170204 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.270738 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.270714 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.371169 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.371142 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.389623 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:46.389578 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:48:46.472009 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.471986 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.572773 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.572740 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.595946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:46.595910 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 17:43:45 +0000 UTC" deadline="2027-11-19 12:45:47.313082655 +0000 UTC" Jun 03 17:48:46.595946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:46.595944 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12810h57m0.717142013s" Jun 03 17:48:46.673589 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.673565 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.773999 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.773900 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.874338 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.874301 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:46.974930 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:46.974902 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.075561 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.075487 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.175995 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.175969 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.276970 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.276945 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.377474 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.377402 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.478034 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.478002 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.578796 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.578770 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.596971 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:47.596946 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 17:43:45 +0000 UTC" deadline="2028-01-14 04:50:31.272075578 +0000 UTC" Jun 03 17:48:47.596971 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:47.596967 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14147h1m43.675111415s" Jun 03 17:48:47.679696 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.679626 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.780022 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.779996 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.880457 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.880433 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:47.981091 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:47.981071 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.081820 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.081788 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.182818 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.182792 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.283295 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.283233 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.383805 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.383774 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.484825 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.484795 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.585738 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.585677 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.686789 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.686759 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.787288 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.787255 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.887806 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.887735 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:48.988380 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:48.988337 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.088972 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.088935 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.189475 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.189414 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.289880 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.289860 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.390333 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.390301 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.490965 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.490921 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.592060 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.592016 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.692799 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.692774 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.793499 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.793423 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.893881 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.893850 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:49.994821 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:49.994786 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.095401 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.095328 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.195828 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.195788 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.296800 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.296772 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.397292 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.397224 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.497879 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.497848 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.598817 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.598790 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.699445 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.699379 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.799765 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.799728 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:50.900151 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:50.900127 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.000768 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.000737 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.101213 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.101172 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.201651 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.201619 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.302149 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.302088 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.402569 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.402535 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.503317 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.503277 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.604070 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.604003 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.704649 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.704621 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.805041 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.805005 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:51.905560 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:51.905470 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.006183 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.006135 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.106593 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.106558 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.207213 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.207148 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.307668 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.307625 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.408116 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.408080 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.508852 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.508824 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.609793 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.609769 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.710408 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.710373 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.810929 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.810826 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:52.911295 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:52.911252 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.012061 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.012026 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.112561 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.112479 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.213031 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.213002 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.313479 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.313454 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.414004 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.413930 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.514767 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.514732 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.615349 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.615316 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.715848 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.715826 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.816315 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.816286 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:53.917214 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:53.917190 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.017969 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.017899 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.118391 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.118361 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.218841 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.218806 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.319337 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.319271 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.419745 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.419714 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.520611 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.520574 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.621270 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.621210 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.722265 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.722242 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.822800 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.822769 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:54.923304 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:54.923232 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.024004 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.023973 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.124405 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.124367 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.224781 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.224754 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.325620 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.325581 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.426555 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.426529 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.527033 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.526975 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.586861 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.586838 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.627658 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.627619 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.727726 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.727706 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.753981 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.753966 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-189.ec2.internal\": node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.827965 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.827880 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:55.928491 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:55.928458 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.029434 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.029399 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.130355 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.130269 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.230981 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.230950 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.331915 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.331885 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.432737 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.432666 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.533174 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.533155 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.633781 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.633738 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.661010 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:56.660993 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:48:56.662099 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:56.662084 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:48:56.662186 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:56.662111 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:48:56.662186 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:56.662121 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:48:56.662332 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.662321 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 03 17:48:56.662379 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:48:56.662370 2581 scope.go:117] "RemoveContainer" containerID="7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd" Jun 03 17:48:56.662546 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.662493 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podUID="c163294ff817eb9bdf95e12ae1833b8b" Jun 03 17:48:56.734338 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.734311 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.834828 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.834797 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:56.935404 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:56.935375 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.036443 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.036385 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.137031 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.137005 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.237374 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.237346 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.337867 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.337807 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.438267 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.438244 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.539220 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.539186 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.639876 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.639815 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.740252 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.740228 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.840949 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.840922 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:57.941803 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:57.941745 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.042436 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.042405 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.143312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.143277 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.243771 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.243747 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.344376 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.344340 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.445113 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.445070 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.546231 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.546164 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.647088 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.647054 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.748064 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.748034 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.849205 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.849129 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:58.949671 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:58.949628 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.050395 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.050358 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.150922 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.150863 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.251349 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.251321 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.352265 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.352236 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.452744 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.452684 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.553781 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.553749 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.654799 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.654773 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.755414 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.755386 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.856235 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.856208 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:48:59.956731 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:48:59.956705 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.057128 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.057057 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.157522 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.157474 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.258111 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.258078 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.359144 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.359065 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.459371 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.459349 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.560174 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.560140 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.660364 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.660290 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.761095 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.761061 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.862172 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.862128 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:00.963139 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:00.963112 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.063754 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.063712 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.164186 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.164156 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.264652 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.264599 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.365106 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.365063 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.465164 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.465138 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.566076 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.566013 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.666779 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.666754 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.767082 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.767044 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.867654 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.867582 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.968162 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:01.968122 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 03 17:49:01.990386 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:01.990365 2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:49:02.024391 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.024364 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 03 17:49:02.034478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.034459 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 17:49:02.034579 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.034568 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 03 17:49:02.045557 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.045539 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 17:49:02.518653 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.518622 2581 apiserver.go:52] "Watching apiserver" Jun 03 17:49:02.525377 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.525354 2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 17:49:02.526868 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.526848 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jrzn8","openshift-multus/multus-additional-cni-plugins-tzrpg","openshift-multus/multus-bxsdg","openshift-multus/network-metrics-daemon-r68wz","openshift-network-operator/iptables-alerter-gj57b","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb","openshift-cluster-node-tuning-operator/tuned-zbhrw","openshift-image-registry/node-ca-hnvmc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal","openshift-network-diagnostics/network-check-target-4kxzh","openshift-ovn-kubernetes/ovnkube-node-vwrvm","kube-system/konnectivity-agent-h2t7m","kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal","openshift-dns/node-resolver-9w5p9"] Jun 03 17:49:02.531014 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.530997 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.533382 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.533355 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.533530 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.533398 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.533530 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.533398 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rsxfp\"" Jun 03 17:49:02.533988 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.533975 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.535884 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.535865 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.535986 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.535960 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 17:49:02.536050 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.535995 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.536050 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.536035 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 17:49:02.536145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.536099 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.536662 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.536642 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 17:49:02.536755 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.536721 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bn2kt\"" Jun 03 17:49:02.536803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.536789 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 17:49:02.538043 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.538027 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.538170 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.538152 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:02.538751 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.538734 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 17:49:02.539204 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.539189 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.539281 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.539267 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 17:49:02.539336 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.539308 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.540003 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.539987 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.540409 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.540394 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-96p2j\"" Jun 03 17:49:02.542353 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.542339 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.542792 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.542772 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.542873 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.542778 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.542873 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.542844 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 17:49:02.543661 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.543645 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zl25j\"" Jun 03 17:49:02.546652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.544338 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 17:49:02.546652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.545356 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.546652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.545377 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.546652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.545667 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b7qt\"" Jun 03 17:49:02.547481 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.547463 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.550743 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.550726 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.550861 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.550727 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.550861 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.550731 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ct62s\"" Jun 03 17:49:02.551563 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.551540 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.553952 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.553911 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.553952 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.553913 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 17:49:02.554108 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.553914 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.554108 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.554028 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmbzn\"" Jun 03 17:49:02.554269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.554252 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.556661 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.556640 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 17:49:02.556756 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.556685 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 17:49:02.556956 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.556852 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6jbx\"" Jun 03 17:49:02.557135 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.557119 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:02.557205 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.557186 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:02.560039 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.560021 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.562852 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.562835 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.562932 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.562840 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 17:49:02.562994 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.562948 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 17:49:02.563133 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.563118 2581 scope.go:117] "RemoveContainer" containerID="7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd" Jun 03 17:49:02.563312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.563283 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_openshift-machine-config-operator(c163294ff817eb9bdf95e12ae1833b8b)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podUID="c163294ff817eb9bdf95e12ae1833b8b" Jun 03 17:49:02.563476 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.563456 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2ggs\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572585 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572622 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572626 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572671 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572622 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b8k7p\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572622 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 17:49:02.572735 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.572692 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 17:49:02.625248 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625220 2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 17:49:02.625627 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-hosts-file\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.625701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-textfile\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.625701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-config\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.625701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.625701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-sys\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.625823 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4474v\" (UniqueName: \"kubernetes.io/projected/807abf3b-e9b3-4794-b9b4-930a6f5028f7-kube-api-access-4474v\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.625823 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-kubernetes\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.625823 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-sys\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.625912 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-tmp\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.625912 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-slash\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.625912 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-serviceca\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.625912 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-k8s-cni-cncf-io\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-etc-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-env-overrides\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-cnibin\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.625982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-tmp-dir\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.626023 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-wtmp\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovn-node-metrics-cert\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgxz\" (UniqueName: \"kubernetes.io/projected/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-kube-api-access-zrgxz\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7jm\" (UniqueName: \"kubernetes.io/projected/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-kube-api-access-vc7jm\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-system-cni-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqsb\" (UniqueName: \"kubernetes.io/projected/3326f203-72a2-4385-aa72-a925db2102be-kube-api-access-dqqsb\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-kubelet\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-iptables-alerter-script\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.626211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvfht\" (UniqueName: \"kubernetes.io/projected/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-kube-api-access-wvfht\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-kubelet\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-os-release\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-system-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-os-release\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cmbf\" (UniqueName: \"kubernetes.io/projected/8fc84847-ca50-41bb-8d18-e74dab983fcc-kube-api-access-9cmbf\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-root\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-netd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-socket-dir-parent\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626482 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-netns\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-script-lib\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-device-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-host\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-tls\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlpm9\" (UniqueName: \"kubernetes.io/projected/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-kube-api-access-dlpm9\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-cnibin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-netns\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-hostroot\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-etc-kubernetes\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-host-slash\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbad39c6-d83a-495d-9e4d-7af2fc80f440-agent-certs\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-metrics-client-ca\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.626989 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-systemd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-node-log\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-socket-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.626974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-sys-fs\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqwt\" (UniqueName: \"kubernetes.io/projected/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kube-api-access-4bqwt\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-log-socket\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-multus\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-run\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-lib-modules\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8xj\" (UniqueName: \"kubernetes.io/projected/d2ba21a4-9885-48de-b5e6-68245b248cdc-kube-api-access-cz8xj\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-registration-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbad39c6-d83a-495d-9e4d-7af2fc80f440-konnectivity-ca\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-modprobe-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysconfig\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-systemd\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.627644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-bin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-conf-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-systemd-units\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-daemon-config\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpcrv\" (UniqueName: \"kubernetes.io/projected/4d3d51f1-576f-4969-871a-f4443810e201-kube-api-access-zpcrv\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-var-lib-kubelet\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-host\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-tuned\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-var-lib-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-ovn\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-conf\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-cni-binary-copy\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.628158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-multus-certs\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.628615 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628615 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-bin\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.628615 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.627731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.728492 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728463 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-bin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.728492 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728493 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-conf-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728526 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-systemd-units\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728541 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728559 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-daemon-config\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-bin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-systemd-units\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728583 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpcrv\" (UniqueName: \"kubernetes.io/projected/4d3d51f1-576f-4969-871a-f4443810e201-kube-api-access-zpcrv\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.728707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-conf-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728743 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-var-lib-kubelet\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728776 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-host\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-var-lib-kubelet\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728795 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-tuned\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728816 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-var-lib-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728842 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-ovn\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-host\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728864 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728891 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-var-lib-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728909 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-ovn\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728915 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-conf\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728952 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-cni-binary-copy\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.728976 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-multus-certs\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729006 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729046 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-multus-certs\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729048 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-conf\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729077 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-bin\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-bin\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729123 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729146 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-hosts-file\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729171 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-textfile\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-daemon-config\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729196 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-config\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.729199 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729220 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729226 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-hosts-file\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729243 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-sys\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729229 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-sys\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.729286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:03.229245623 +0000 UTC m=+38.098544212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.729856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729464 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4474v\" (UniqueName: \"kubernetes.io/projected/807abf3b-e9b3-4794-b9b4-930a6f5028f7-kube-api-access-4474v\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-textfile\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729485 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc84847-ca50-41bb-8d18-e74dab983fcc-cni-binary-copy\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729490 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-kubernetes\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729547 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-kubernetes\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729548 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-sys\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729577 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-tmp\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-sys\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729601 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-slash\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729625 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-serviceca\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729649 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-k8s-cni-cncf-io\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729658 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-slash\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729672 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729715 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-k8s-cni-cncf-io\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729744 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-etc-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729777 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-env-overrides\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-config\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.730838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysctl-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729803 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-cnibin\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729827 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-tmp-dir\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729855 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-wtmp\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-cnibin\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729878 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovn-node-metrics-cert\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-etc-openvswitch\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729927 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgxz\" (UniqueName: \"kubernetes.io/projected/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-kube-api-access-zrgxz\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729954 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7jm\" (UniqueName: \"kubernetes.io/projected/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-kube-api-access-vc7jm\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-wtmp\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.729980 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-system-cni-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730006 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqsb\" (UniqueName: \"kubernetes.io/projected/3326f203-72a2-4385-aa72-a925db2102be-kube-api-access-dqqsb\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730033 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-kubelet\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730059 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-iptables-alerter-script\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730089 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvfht\" (UniqueName: \"kubernetes.io/projected/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-kube-api-access-wvfht\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730116 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-kubelet\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-env-overrides\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.732407 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730144 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730171 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-os-release\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730177 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-kubelet\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-system-cni-dir\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730196 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-system-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730231 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-os-release\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-system-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730253 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cmbf\" (UniqueName: \"kubernetes.io/projected/8fc84847-ca50-41bb-8d18-e74dab983fcc-kube-api-access-9cmbf\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730282 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-root\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730309 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-netd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730335 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730362 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730386 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-socket-dir-parent\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730410 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-netns\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730437 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-script-lib\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-os-release\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730465 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-device-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/807abf3b-e9b3-4794-b9b4-930a6f5028f7-root\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.733217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730499 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730546 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-host\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-kubelet\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730572 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-tls\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730579 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730598 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730612 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3326f203-72a2-4385-aa72-a925db2102be-os-release\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730625 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlpm9\" (UniqueName: \"kubernetes.io/projected/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-kube-api-access-dlpm9\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730654 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-cnibin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-cni-netd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-host\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730679 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-netns\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-device-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730744 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-hostroot\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-socket-dir-parent\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-cnibin\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730774 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-hostroot\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730776 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-etc-kubernetes\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730834 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-host-slash\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730857 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbad39c6-d83a-495d-9e4d-7af2fc80f440-agent-certs\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730882 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-metrics-client-ca\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730909 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730934 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-systemd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730967 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-node-log\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.730992 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-socket-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731020 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-sys-fs\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731062 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqwt\" (UniqueName: \"kubernetes.io/projected/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kube-api-access-4bqwt\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-tmp-dir\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731087 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-log-socket\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731117 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731297 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-multus\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731325 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-run\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-multus-cni-dir\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.734883 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731357 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-etc-kubernetes\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-run\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-var-lib-cni-multus\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc84847-ca50-41bb-8d18-e74dab983fcc-host-run-netns\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-host-slash\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-serviceca\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-socket-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807abf3b-e9b3-4794-b9b4-930a6f5028f7-metrics-client-ca\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.731967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-sys-fs\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovnkube-script-lib\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-run-systemd\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-node-log\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732242 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-lib-modules\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732219 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-log-socket\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-host-run-netns\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732278 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8xj\" (UniqueName: \"kubernetes.io/projected/d2ba21a4-9885-48de-b5e6-68245b248cdc-kube-api-access-cz8xj\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732327 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-registration-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.735728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-lib-modules\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732434 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbad39c6-d83a-495d-9e4d-7af2fc80f440-konnectivity-ca\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732459 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-modprobe-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732484 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysconfig\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732460 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-registration-dir\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732525 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-systemd\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732565 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-systemd\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732573 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-sysconfig\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.732653 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-modprobe-d\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.733016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3326f203-72a2-4385-aa72-a925db2102be-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.733434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bbad39c6-d83a-495d-9e4d-7af2fc80f440-konnectivity-ca\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.733968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-iptables-alerter-script\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.734046 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-etc-tuned\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.734052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2ba21a4-9885-48de-b5e6-68245b248cdc-tmp\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.734476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-tls\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.734479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bbad39c6-d83a-495d-9e4d-7af2fc80f440-agent-certs\") pod \"konnectivity-agent-h2t7m\" (UID: \"bbad39c6-d83a-495d-9e4d-7af2fc80f440\") " pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.736588 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.734718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-ovn-node-metrics-cert\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.737422 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.735602 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807abf3b-e9b3-4794-b9b4-930a6f5028f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.737422 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.736928 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" podStartSLOduration=0.736918692 podStartE2EDuration="736.918692ms" podCreationTimestamp="2026-06-03 17:49:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:49:02.717962554 +0000 UTC m=+37.587261148" watchObservedRunningTime="2026-06-03 17:49:02.736918692 +0000 UTC m=+37.606217343" Jun 03 17:49:02.744368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.744342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpcrv\" (UniqueName: \"kubernetes.io/projected/4d3d51f1-576f-4969-871a-f4443810e201-kube-api-access-zpcrv\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:02.746480 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.746461 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:02.746574 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.746486 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:02.746574 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.746499 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:02.746646 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:02.746583 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:03.246566694 +0000 UTC m=+38.115865281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:02.749241 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.749212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4474v\" (UniqueName: \"kubernetes.io/projected/807abf3b-e9b3-4794-b9b4-930a6f5028f7-kube-api-access-4474v\") pod \"node-exporter-jrzn8\" (UID: \"807abf3b-e9b3-4794-b9b4-930a6f5028f7\") " pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.749605 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.749583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvfht\" (UniqueName: \"kubernetes.io/projected/2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd-kube-api-access-wvfht\") pod \"node-resolver-9w5p9\" (UID: \"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd\") " pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.749685 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.749674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgxz\" (UniqueName: \"kubernetes.io/projected/c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9-kube-api-access-zrgxz\") pod \"ovnkube-node-vwrvm\" (UID: \"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.749784 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.749755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlpm9\" (UniqueName: \"kubernetes.io/projected/6e207d05-2ba1-4c1b-b3ae-fa4ba759668a-kube-api-access-dlpm9\") pod \"iptables-alerter-gj57b\" (UID: \"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a\") " pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.749941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.749919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7jm\" (UniqueName: \"kubernetes.io/projected/79b1ea21-d80d-41a4-bc4c-190f6ff33fa4-kube-api-access-vc7jm\") pod \"node-ca-hnvmc\" (UID: \"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4\") " pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.750092 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.750075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqwt\" (UniqueName: \"kubernetes.io/projected/260f40ee-aaa2-4bd2-b67b-f3d258008a2a-kube-api-access-4bqwt\") pod \"aws-ebs-csi-driver-node-cc8nb\" (UID: \"260f40ee-aaa2-4bd2-b67b-f3d258008a2a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.750321 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.750306 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8xj\" (UniqueName: \"kubernetes.io/projected/d2ba21a4-9885-48de-b5e6-68245b248cdc-kube-api-access-cz8xj\") pod \"tuned-zbhrw\" (UID: \"d2ba21a4-9885-48de-b5e6-68245b248cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.750707 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.750689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cmbf\" (UniqueName: \"kubernetes.io/projected/8fc84847-ca50-41bb-8d18-e74dab983fcc-kube-api-access-9cmbf\") pod \"multus-bxsdg\" (UID: \"8fc84847-ca50-41bb-8d18-e74dab983fcc\") " pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.751458 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.751441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqsb\" (UniqueName: \"kubernetes.io/projected/3326f203-72a2-4385-aa72-a925db2102be-kube-api-access-dqqsb\") pod \"multus-additional-cni-plugins-tzrpg\" (UID: \"3326f203-72a2-4385-aa72-a925db2102be\") " pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.840496 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.840425 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" Jun 03 17:49:02.847480 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.847458 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ba21a4_9885_48de_b5e6_68245b248cdc.slice/crio-27b59e9f720bf1f6dad79b090169f1bcb4e8da8b79efdc0940f458602ef9787f WatchSource:0}: Error finding container 27b59e9f720bf1f6dad79b090169f1bcb4e8da8b79efdc0940f458602ef9787f: Status 404 returned error can't find the container with id 27b59e9f720bf1f6dad79b090169f1bcb4e8da8b79efdc0940f458602ef9787f Jun 03 17:49:02.848146 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.848123 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:02.853557 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.853530 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81e4996_c6e6_4cf1_9c47_e14cb9ece9c9.slice/crio-b454f32ec9c58e22d91d94ad4caeee6a3b2d36ca11e05593a3ed0c083542b30a WatchSource:0}: Error finding container b454f32ec9c58e22d91d94ad4caeee6a3b2d36ca11e05593a3ed0c083542b30a: Status 404 returned error can't find the container with id b454f32ec9c58e22d91d94ad4caeee6a3b2d36ca11e05593a3ed0c083542b30a Jun 03 17:49:02.856728 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.856713 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxsdg" Jun 03 17:49:02.860869 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.860846 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gj57b" Jun 03 17:49:02.862354 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.862327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc84847_ca50_41bb_8d18_e74dab983fcc.slice/crio-2e143e59107f9f1dc0c9041ca61d88f8a6be2694328a9711d913a9ff5e183ed6 WatchSource:0}: Error finding container 2e143e59107f9f1dc0c9041ca61d88f8a6be2694328a9711d913a9ff5e183ed6: Status 404 returned error can't find the container with id 2e143e59107f9f1dc0c9041ca61d88f8a6be2694328a9711d913a9ff5e183ed6 Jun 03 17:49:02.866360 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.866340 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" Jun 03 17:49:02.866894 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.866808 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e207d05_2ba1_4c1b_b3ae_fa4ba759668a.slice/crio-e9d6005994e23f6c5b2862deb4ed68051fddcad12b1ffe54368aa2fccc59a5f5 WatchSource:0}: Error finding container e9d6005994e23f6c5b2862deb4ed68051fddcad12b1ffe54368aa2fccc59a5f5: Status 404 returned error can't find the container with id e9d6005994e23f6c5b2862deb4ed68051fddcad12b1ffe54368aa2fccc59a5f5 Jun 03 17:49:02.870455 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.870437 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9w5p9" Jun 03 17:49:02.874455 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.874429 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260f40ee_aaa2_4bd2_b67b_f3d258008a2a.slice/crio-6be5517e46489edfcc9e25f0cbc20700644152105e602a7c8c8de9d9e114207b WatchSource:0}: Error finding container 6be5517e46489edfcc9e25f0cbc20700644152105e602a7c8c8de9d9e114207b: Status 404 returned error can't find the container with id 6be5517e46489edfcc9e25f0cbc20700644152105e602a7c8c8de9d9e114207b Jun 03 17:49:02.876070 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.876051 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hnvmc" Jun 03 17:49:02.877490 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.877471 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d87b3ce_123d_42d5_b1e1_1fb0efaff8bd.slice/crio-95cfb1a0f2568e401fb13183370a106b24e776893a5d715ca31128daaddd741a WatchSource:0}: Error finding container 95cfb1a0f2568e401fb13183370a106b24e776893a5d715ca31128daaddd741a: Status 404 returned error can't find the container with id 95cfb1a0f2568e401fb13183370a106b24e776893a5d715ca31128daaddd741a Jun 03 17:49:02.881830 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.881634 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" Jun 03 17:49:02.883990 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.883967 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b1ea21_d80d_41a4_bc4c_190f6ff33fa4.slice/crio-24d8d90aef8225e75542a4f37e7d646c63bfbbcad876a519df0f3ac2a517a77b WatchSource:0}: Error finding container 24d8d90aef8225e75542a4f37e7d646c63bfbbcad876a519df0f3ac2a517a77b: Status 404 returned error can't find the container with id 24d8d90aef8225e75542a4f37e7d646c63bfbbcad876a519df0f3ac2a517a77b Jun 03 17:49:02.885766 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.885719 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:02.889386 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.889367 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3326f203_72a2_4385_aa72_a925db2102be.slice/crio-3c7ec82422484fc3fd7bb479d3b6cee27238123e9ab1aab67468025492967a7e WatchSource:0}: Error finding container 3c7ec82422484fc3fd7bb479d3b6cee27238123e9ab1aab67468025492967a7e: Status 404 returned error can't find the container with id 3c7ec82422484fc3fd7bb479d3b6cee27238123e9ab1aab67468025492967a7e Jun 03 17:49:02.890184 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:02.890164 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrzn8" Jun 03 17:49:02.894877 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.894856 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbad39c6_d83a_495d_9e4d_7af2fc80f440.slice/crio-cd5c2e0543a4f1b757b63f694245938f15fbbb7c3952f955023686ad959718b8 WatchSource:0}: Error finding container cd5c2e0543a4f1b757b63f694245938f15fbbb7c3952f955023686ad959718b8: Status 404 returned error can't find the container with id cd5c2e0543a4f1b757b63f694245938f15fbbb7c3952f955023686ad959718b8 Jun 03 17:49:02.899000 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:02.898975 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807abf3b_e9b3_4794_b9b4_930a6f5028f7.slice/crio-5acf28254c3c65dcc19ae722e6dbbba3e779ba909af1ec06b5109a64fdfdcf14 WatchSource:0}: Error finding container 5acf28254c3c65dcc19ae722e6dbbba3e779ba909af1ec06b5109a64fdfdcf14: Status 404 returned error can't find the container with id 5acf28254c3c65dcc19ae722e6dbbba3e779ba909af1ec06b5109a64fdfdcf14 Jun 03 17:49:03.236244 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.236220 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:03.236406 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.236323 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:03.236406 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.236371 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:04.236357116 +0000 UTC m=+39.105655689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:03.337443 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.337411 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:03.337675 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.337651 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:03.337675 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.337678 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:03.337835 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.337692 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:03.337835 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:03.337752 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:04.337733538 +0000 UTC m=+39.207032113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:03.739108 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.739032 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gj57b" event={"ID":"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a","Type":"ContainerStarted","Data":"e9d6005994e23f6c5b2862deb4ed68051fddcad12b1ffe54368aa2fccc59a5f5"} Jun 03 17:49:03.743850 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.743782 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"b454f32ec9c58e22d91d94ad4caeee6a3b2d36ca11e05593a3ed0c083542b30a"} Jun 03 17:49:03.746340 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.746311 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" event={"ID":"d2ba21a4-9885-48de-b5e6-68245b248cdc","Type":"ContainerStarted","Data":"27b59e9f720bf1f6dad79b090169f1bcb4e8da8b79efdc0940f458602ef9787f"} Jun 03 17:49:03.747555 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.747532 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrzn8" event={"ID":"807abf3b-e9b3-4794-b9b4-930a6f5028f7","Type":"ContainerStarted","Data":"5acf28254c3c65dcc19ae722e6dbbba3e779ba909af1ec06b5109a64fdfdcf14"} Jun 03 17:49:03.749338 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.749283 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" event={"ID":"260f40ee-aaa2-4bd2-b67b-f3d258008a2a","Type":"ContainerStarted","Data":"6be5517e46489edfcc9e25f0cbc20700644152105e602a7c8c8de9d9e114207b"} Jun 03 17:49:03.760490 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.760440 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxsdg" event={"ID":"8fc84847-ca50-41bb-8d18-e74dab983fcc","Type":"ContainerStarted","Data":"2e143e59107f9f1dc0c9041ca61d88f8a6be2694328a9711d913a9ff5e183ed6"} Jun 03 17:49:03.771598 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.770802 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2t7m" event={"ID":"bbad39c6-d83a-495d-9e4d-7af2fc80f440","Type":"ContainerStarted","Data":"cd5c2e0543a4f1b757b63f694245938f15fbbb7c3952f955023686ad959718b8"} Jun 03 17:49:03.781165 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.781130 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerStarted","Data":"3c7ec82422484fc3fd7bb479d3b6cee27238123e9ab1aab67468025492967a7e"} Jun 03 17:49:03.782691 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.782663 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hnvmc" event={"ID":"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4","Type":"ContainerStarted","Data":"24d8d90aef8225e75542a4f37e7d646c63bfbbcad876a519df0f3ac2a517a77b"} Jun 03 17:49:03.785549 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:03.785522 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9w5p9" event={"ID":"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd","Type":"ContainerStarted","Data":"95cfb1a0f2568e401fb13183370a106b24e776893a5d715ca31128daaddd741a"} Jun 03 17:49:04.244691 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:04.244419 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:04.244691 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.244597 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:04.244691 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.244660 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:06.244641669 +0000 UTC m=+41.113940247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:04.346103 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:04.345342 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:04.346103 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.345542 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:04.346103 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.345567 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:04.346103 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.345580 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:04.346103 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.345639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:06.345620935 +0000 UTC m=+41.214919525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:04.661008 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:04.660926 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:04.661199 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.661083 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:04.661540 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:04.661500 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:04.661645 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:04.661620 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:06.261247 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:06.261210 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:06.261750 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.261396 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:06.261750 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.261466 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:10.261445366 +0000 UTC m=+45.130743940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:06.362312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:06.361631 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:06.362312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.361867 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:06.362312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.361888 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:06.362312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.361901 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:06.362312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.361962 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:10.361941361 +0000 UTC m=+45.231239936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:06.662284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:06.661727 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:06.662284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:06.661727 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:06.662284 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.661873 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:06.662284 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:06.661900 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:08.660855 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:08.660817 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:08.661302 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:08.660968 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:08.661473 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:08.661450 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:08.661573 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:08.661558 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:10.297029 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:10.296986 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:10.297434 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.297152 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:10.297434 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.297229 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:18.297207013 +0000 UTC m=+53.166505599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:10.397711 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:10.397670 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:10.397895 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.397844 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:10.397895 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.397864 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:10.397895 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.397877 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:10.398067 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.397936 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:18.397918242 +0000 UTC m=+53.267216820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:10.661890 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:10.661388 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:10.661890 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.661481 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:10.661890 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:10.661739 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:10.661890 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:10.661813 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:12.661422 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:12.661390 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:12.661422 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:12.661422 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:12.661960 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:12.661535 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:12.661960 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:12.661590 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:14.661024 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:14.660984 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:14.661024 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:14.661017 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:14.661491 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:14.661126 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:14.661491 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:14.661260 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:16.661152 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:16.661117 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:16.661627 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:16.661117 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:16.661627 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:16.661251 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:16.661627 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:16.661360 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:17.661368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:17.661335 2581 scope.go:117] "RemoveContainer" containerID="7817af0170d96d0780c801bac16d0093831bc9d00827e8a64d93fb158dbfebcd" Jun 03 17:49:18.359565 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:18.359489 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:18.359749 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.359643 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:18.359749 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.359706 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:49:34.359690975 +0000 UTC m=+69.228989546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:18.459904 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:18.459872 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:18.460089 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.460014 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:18.460089 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.460033 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:18.460089 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.460046 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:18.460210 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.460103 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:49:34.460087568 +0000 UTC m=+69.329386141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:18.661347 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:18.661259 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:18.661347 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:18.661293 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:18.661877 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.661389 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:18.661877 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:18.661448 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:20.661689 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:20.661658 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:20.662115 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:20.661708 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:20.662115 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:20.661812 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:20.662115 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:20.661889 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:21.832815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.832654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:49:21.833635 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.833206 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"c163294ff817eb9bdf95e12ae1833b8b","Type":"ContainerStarted","Data":"34f6e26c8d101528459be76eb1397ba4ccc39bd0a83fce7da2e05d6be36c3efc"} Jun 03 17:49:21.835019 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.834991 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2t7m" event={"ID":"bbad39c6-d83a-495d-9e4d-7af2fc80f440","Type":"ContainerStarted","Data":"bd9ee1d9df261735195b2bfc098fb7c9e9f3a37ffe3c2f43438995e86a7e6a56"} Jun 03 17:49:21.836604 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.836582 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hnvmc" event={"ID":"79b1ea21-d80d-41a4-bc4c-190f6ff33fa4","Type":"ContainerStarted","Data":"5ec336028076fa59df312706b27dfba822294e678d1ba3b64c176f3c03a014ba"} Jun 03 17:49:21.838289 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.838268 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" event={"ID":"d2ba21a4-9885-48de-b5e6-68245b248cdc","Type":"ContainerStarted","Data":"9650f1e9ce3a1a963e8d4ec80aac0cce968f30ea2b1e188eb91af03b63227e45"} Jun 03 17:49:21.840238 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.840218 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrzn8" event={"ID":"807abf3b-e9b3-4794-b9b4-930a6f5028f7","Type":"ContainerStarted","Data":"dec4de84644eafff09e14c47941254a21455a7eb1331631e7ca532adffa8ddc6"} Jun 03 17:49:21.863897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.863858 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podStartSLOduration=19.863845285 podStartE2EDuration="19.863845285s" podCreationTimestamp="2026-06-03 17:49:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:49:21.863093623 +0000 UTC m=+56.732392218" watchObservedRunningTime="2026-06-03 17:49:21.863845285 +0000 UTC m=+56.733143879" Jun 03 17:49:21.881845 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.881810 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h2t7m" podStartSLOduration=26.410614791 podStartE2EDuration="36.881797479s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.896943518 +0000 UTC m=+37.766242092" lastFinishedPulling="2026-06-03 17:49:13.368126196 +0000 UTC m=+48.237424780" observedRunningTime="2026-06-03 17:49:21.881588873 +0000 UTC m=+56.750887467" watchObservedRunningTime="2026-06-03 17:49:21.881797479 +0000 UTC m=+56.751096072" Jun 03 17:49:21.900228 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.900192 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zbhrw" podStartSLOduration=18.189351862 podStartE2EDuration="36.900180891s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.84892893 +0000 UTC m=+37.718227502" lastFinishedPulling="2026-06-03 17:49:21.559757955 +0000 UTC m=+56.429056531" observedRunningTime="2026-06-03 17:49:21.899883249 +0000 UTC m=+56.769181865" watchObservedRunningTime="2026-06-03 17:49:21.900180891 +0000 UTC m=+56.769479485" Jun 03 17:49:21.914381 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:21.914341 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hnvmc" podStartSLOduration=18.24446385 podStartE2EDuration="36.914327157s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.885462069 +0000 UTC m=+37.754760640" lastFinishedPulling="2026-06-03 17:49:21.555325372 +0000 UTC m=+56.424623947" observedRunningTime="2026-06-03 17:49:21.913677367 +0000 UTC m=+56.782975961" watchObservedRunningTime="2026-06-03 17:49:21.914327157 +0000 UTC m=+56.783625752" Jun 03 17:49:22.661362 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.661316 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:22.661521 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:22.661440 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:22.661521 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.661471 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:22.661587 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:22.661533 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:22.843297 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.843216 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="b98913d791ddcdb62e6f6460f09ad8349e86ca4e6a486778853e585071006f98" exitCode=0 Jun 03 17:49:22.843805 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.843299 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"b98913d791ddcdb62e6f6460f09ad8349e86ca4e6a486778853e585071006f98"} Jun 03 17:49:22.844649 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.844626 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9w5p9" event={"ID":"2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd","Type":"ContainerStarted","Data":"4ce1e1e9b82762821be3f7a801519756861849811693120f5f828a1bbb8bc6ad"} Jun 03 17:49:22.846720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.846702 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:49:22.847020 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847003 2581 generic.go:358] "Generic (PLEG): container finished" podID="c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9" containerID="0f21bbcb4bb7cd64119cbe3e872460df0377744f53af44e85009a3be466f79c8" exitCode=1 Jun 03 17:49:22.847089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847065 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"4db1d1cbcb8d54e680a6743983b0a554a3062b815b7328384e17e8a8d8211ae9"} Jun 03 17:49:22.847089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847086 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"079e825385282e57e214701b5f28d9cb1634bbc9e67afd1e1e24e61f82561049"} Jun 03 17:49:22.847173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847096 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"831e0a291ee30f35c721d601369e94807818f53472776158c1d7c976ec01ca44"} Jun 03 17:49:22.847173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847105 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"ef6b82ad1145883a6a553a7ec0698eaa3a17f9f2c3cb45a0aa1302365c7d7cbc"} Jun 03 17:49:22.847173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847112 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerDied","Data":"0f21bbcb4bb7cd64119cbe3e872460df0377744f53af44e85009a3be466f79c8"} Jun 03 17:49:22.847173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.847122 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"d87c862768bfd629b0333ee7d19b52913509478f5a193e267bc7aee9d276fff4"} Jun 03 17:49:22.848312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.848292 2581 generic.go:358] "Generic (PLEG): container finished" podID="807abf3b-e9b3-4794-b9b4-930a6f5028f7" containerID="dec4de84644eafff09e14c47941254a21455a7eb1331631e7ca532adffa8ddc6" exitCode=0 Jun 03 17:49:22.848394 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.848353 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrzn8" event={"ID":"807abf3b-e9b3-4794-b9b4-930a6f5028f7","Type":"ContainerDied","Data":"dec4de84644eafff09e14c47941254a21455a7eb1331631e7ca532adffa8ddc6"} Jun 03 17:49:22.849621 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.849601 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" event={"ID":"260f40ee-aaa2-4bd2-b67b-f3d258008a2a","Type":"ContainerStarted","Data":"7679e9218fda8081671c6b28863c0067676ecc6d865e6223679d299d1f6c783b"} Jun 03 17:49:22.850787 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.850758 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxsdg" event={"ID":"8fc84847-ca50-41bb-8d18-e74dab983fcc","Type":"ContainerStarted","Data":"fd8b724c20d6bfe8572d58728d2b727e813dbddbee18aa32a65eca6a93d94cc5"} Jun 03 17:49:22.886258 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.886232 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:22.886764 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.886748 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:22.914782 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.914745 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9w5p9" podStartSLOduration=19.23923294 podStartE2EDuration="37.914733362s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.880177468 +0000 UTC m=+37.749476058" lastFinishedPulling="2026-06-03 17:49:21.555677903 +0000 UTC m=+56.424976480" observedRunningTime="2026-06-03 17:49:22.88763299 +0000 UTC m=+57.756931584" watchObservedRunningTime="2026-06-03 17:49:22.914733362 +0000 UTC m=+57.784031955" Jun 03 17:49:22.933249 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:22.933206 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bxsdg" podStartSLOduration=19.218700739 podStartE2EDuration="37.933194287s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.863900614 +0000 UTC m=+37.733199198" lastFinishedPulling="2026-06-03 17:49:21.578394173 +0000 UTC m=+56.447692746" observedRunningTime="2026-06-03 17:49:22.932969084 +0000 UTC m=+57.802267678" watchObservedRunningTime="2026-06-03 17:49:22.933194287 +0000 UTC m=+57.802492881" Jun 03 17:49:23.183102 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.182994 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 17:49:23.618599 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.618489 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T17:49:23.183014383Z","UUID":"594d604e-addc-462b-bef6-d8b41c01f26b","Handler":null,"Name":"","Endpoint":""} Jun 03 17:49:23.619991 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.619968 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 17:49:23.620130 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.620001 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 17:49:23.854783 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.854727 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrzn8" event={"ID":"807abf3b-e9b3-4794-b9b4-930a6f5028f7","Type":"ContainerStarted","Data":"38b087d78a6d09d89ebde0d26d3d525c477da8ed6b8f587e886bbcaf69d3a76c"} Jun 03 17:49:23.854783 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.854777 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrzn8" event={"ID":"807abf3b-e9b3-4794-b9b4-930a6f5028f7","Type":"ContainerStarted","Data":"2288f7cf67559f3690e083ad4fa92fcce6b13e61ce6d2bab1f27d5ccc5a655d1"} Jun 03 17:49:23.857271 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.857237 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" event={"ID":"260f40ee-aaa2-4bd2-b67b-f3d258008a2a","Type":"ContainerStarted","Data":"70a35aa8d1d5ca0dd0873c91ced8d97166488877de8aba9fa0e67a54b2f59b2a"} Jun 03 17:49:23.859916 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.859307 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gj57b" event={"ID":"6e207d05-2ba1-4c1b-b3ae-fa4ba759668a","Type":"ContainerStarted","Data":"d11b2ba59f845332fe6e8f591115357c61d3edfe1f5dcb9b058be5de2ddeb671"} Jun 03 17:49:23.859916 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.859340 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:23.859916 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.859884 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h2t7m" Jun 03 17:49:23.873628 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.873493 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jrzn8" podStartSLOduration=21.903996759 podStartE2EDuration="26.873482915s" podCreationTimestamp="2026-06-03 17:48:57 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.900492532 +0000 UTC m=+37.769791104" lastFinishedPulling="2026-06-03 17:49:07.869978682 +0000 UTC m=+42.739277260" observedRunningTime="2026-06-03 17:49:23.872792297 +0000 UTC m=+58.742090919" watchObservedRunningTime="2026-06-03 17:49:23.873482915 +0000 UTC m=+58.742781508" Jun 03 17:49:23.887305 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:23.887271 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gj57b" podStartSLOduration=20.202853331 podStartE2EDuration="38.887262744s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.870375166 +0000 UTC m=+37.739673739" lastFinishedPulling="2026-06-03 17:49:21.554784567 +0000 UTC m=+56.424083152" observedRunningTime="2026-06-03 17:49:23.886938363 +0000 UTC m=+58.756236944" watchObservedRunningTime="2026-06-03 17:49:23.887262744 +0000 UTC m=+58.756561338" Jun 03 17:49:24.661376 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.661344 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:24.661475 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.661347 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:24.661475 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:24.661462 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:24.661612 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:24.661567 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:24.864405 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.864379 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:49:24.864857 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.864820 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"7dedd9ce7332b7e303ddcdca947077904ac71a33322790c2d3713efac6b02221"} Jun 03 17:49:24.866803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.866773 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" event={"ID":"260f40ee-aaa2-4bd2-b67b-f3d258008a2a","Type":"ContainerStarted","Data":"419534fb5dd2cbe5da6eea601d9bdd530ff34617d0f1389497e9ff6e1faeb6fc"} Jun 03 17:49:24.885524 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:24.885447 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cc8nb" podStartSLOduration=18.199229138 podStartE2EDuration="39.88543188s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.875987336 +0000 UTC m=+37.745285908" lastFinishedPulling="2026-06-03 17:49:24.562190073 +0000 UTC m=+59.431488650" observedRunningTime="2026-06-03 17:49:24.884989507 +0000 UTC m=+59.754288113" watchObservedRunningTime="2026-06-03 17:49:24.88543188 +0000 UTC m=+59.754730474" Jun 03 17:49:26.661994 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:26.661791 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:26.662465 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:26.661849 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:26.662465 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:26.662117 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:26.662465 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:26.662162 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:28.661069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.661039 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:28.661606 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.661043 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:28.661606 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:28.661129 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:28.661606 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:28.661218 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:28.875790 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.875752 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="b1435c9577d8180c94af091e7e4f90ce737b6ec4ea45f90ca872b1dd5bcc2ad4" exitCode=0 Jun 03 17:49:28.875942 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.875844 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"b1435c9577d8180c94af091e7e4f90ce737b6ec4ea45f90ca872b1dd5bcc2ad4"} Jun 03 17:49:28.878977 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.878957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:49:28.879332 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.879310 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"0fa0708e91a43ace2b7140e38a33405fdf4670f01ab6f05dc601801c9370540a"} Jun 03 17:49:28.879642 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.879617 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:28.879753 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.879656 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:28.879753 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.879670 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:28.879944 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.879928 2581 scope.go:117] "RemoveContainer" containerID="0f21bbcb4bb7cd64119cbe3e872460df0377744f53af44e85009a3be466f79c8" Jun 03 17:49:28.907380 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.907360 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:28.907589 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:28.907572 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:49:29.884916 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:29.883935 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerStarted","Data":"087c4913b06b58314f412f7f4d9ae7220a069b251578a94b8aacffbeb3fa1694"} Jun 03 17:49:29.888715 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:29.888690 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:49:29.889170 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:29.889144 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" event={"ID":"c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9","Type":"ContainerStarted","Data":"faf05de639e0c962476a7044e8ee443c65dbb71d72b4037843bf3347182fcf9d"} Jun 03 17:49:29.930293 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:29.930246 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" podStartSLOduration=26.160420725 podStartE2EDuration="44.930231349s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.855350592 +0000 UTC m=+37.724649163" lastFinishedPulling="2026-06-03 17:49:21.625161209 +0000 UTC m=+56.494459787" observedRunningTime="2026-06-03 17:49:29.929686247 +0000 UTC m=+64.798985058" watchObservedRunningTime="2026-06-03 17:49:29.930231349 +0000 UTC m=+64.799529944" Jun 03 17:49:30.127101 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.127015 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4kxzh"] Jun 03 17:49:30.127258 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.127176 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:30.127313 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:30.127291 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:30.127744 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.127719 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r68wz"] Jun 03 17:49:30.127853 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.127840 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:30.127972 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:30.127954 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:30.892538 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.892490 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="087c4913b06b58314f412f7f4d9ae7220a069b251578a94b8aacffbeb3fa1694" exitCode=0 Jun 03 17:49:30.892928 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:30.892536 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"087c4913b06b58314f412f7f4d9ae7220a069b251578a94b8aacffbeb3fa1694"} Jun 03 17:49:31.661825 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:31.661652 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:31.661969 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:31.661660 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:31.661969 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:31.661898 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:31.662045 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:31.661978 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:32.898171 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:32.898134 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="c3f64e502bbe7b36ecdd173f855e256967bc07e6dfaba6bfcde9598ab3cc4939" exitCode=0 Jun 03 17:49:32.898596 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:32.898207 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"c3f64e502bbe7b36ecdd173f855e256967bc07e6dfaba6bfcde9598ab3cc4939"} Jun 03 17:49:33.665014 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:33.664586 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:33.665014 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:33.664597 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:33.665014 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:33.664707 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4kxzh" podUID="ecadf230-c02f-47fc-96ee-ef141792672c" Jun 03 17:49:33.665014 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:33.664786 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r68wz" podUID="4d3d51f1-576f-4969-871a-f4443810e201" Jun 03 17:49:34.380872 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:34.380837 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:34.381296 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.380986 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:34.381296 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.381052 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs podName:4d3d51f1-576f-4969-871a-f4443810e201 nodeName:}" failed. No retries permitted until 2026-06-03 17:50:06.381036847 +0000 UTC m=+101.250335422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs") pod "network-metrics-daemon-r68wz" (UID: "4d3d51f1-576f-4969-871a-f4443810e201") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:49:34.481789 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:34.481751 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:34.481960 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.481918 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:49:34.481960 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.481940 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:49:34.481960 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.481949 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fq7sk for pod openshift-network-diagnostics/network-check-target-4kxzh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:34.482077 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:49:34.481998 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk podName:ecadf230-c02f-47fc-96ee-ef141792672c nodeName:}" failed. No retries permitted until 2026-06-03 17:50:06.481985175 +0000 UTC m=+101.351283746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq7sk" (UniqueName: "kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk") pod "network-check-target-4kxzh" (UID: "ecadf230-c02f-47fc-96ee-ef141792672c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:49:35.503415 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.503339 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeReady" Jun 03 17:49:35.503826 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.503480 2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 17:49:35.560071 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.560038 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q5sgh"] Jun 03 17:49:35.583960 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.583930 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzp87"] Jun 03 17:49:35.584141 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.584097 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.588227 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.588200 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 17:49:35.589030 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.589013 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rng6v\"" Jun 03 17:49:35.589977 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.589955 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 17:49:35.600115 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.600094 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5sgh"] Jun 03 17:49:35.600115 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.600121 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzp87"] Jun 03 17:49:35.600282 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.600220 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.603817 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.603800 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 17:49:35.604074 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.604053 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 17:49:35.604153 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.604097 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmvqr\"" Jun 03 17:49:35.604632 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.604426 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 17:49:35.662736 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.662702 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:49:35.662939 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.662914 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:49:35.665460 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.665417 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xgvk6\"" Jun 03 17:49:35.666020 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.665587 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 17:49:35.666020 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.665967 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 17:49:35.666020 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.665991 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q5kmd"] Jun 03 17:49:35.666212 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.666093 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4bvb\"" Jun 03 17:49:35.666212 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.666197 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 17:49:35.675260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.675244 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.677729 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.677703 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x8frl\"" Jun 03 17:49:35.678915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.677713 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 17:49:35.678915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.677983 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 17:49:35.679046 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.679013 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5kmd"] Jun 03 17:49:35.679284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.679264 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 17:49:35.679377 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.679360 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 17:49:35.689713 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a50a763d-0483-4cef-83ba-d619b78a1ca4-config-volume\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.689840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5984a7-272a-4537-b05e-772fb2c5c620-cert\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.689840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrdr\" (UniqueName: \"kubernetes.io/projected/5f5984a7-272a-4537-b05e-772fb2c5c620-kube-api-access-hkrdr\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.689840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk5d5\" (UniqueName: \"kubernetes.io/projected/a50a763d-0483-4cef-83ba-d619b78a1ca4-kube-api-access-wk5d5\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.689840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50a763d-0483-4cef-83ba-d619b78a1ca4-metrics-tls\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.690020 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.689857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50a763d-0483-4cef-83ba-d619b78a1ca4-tmp-dir\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.790708 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790634 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a50a763d-0483-4cef-83ba-d619b78a1ca4-config-volume\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.790708 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790668 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5984a7-272a-4537-b05e-772fb2c5c620-cert\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.790708 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790689 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrdr\" (UniqueName: \"kubernetes.io/projected/5f5984a7-272a-4537-b05e-772fb2c5c620-kube-api-access-hkrdr\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.790946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fdcd7d0-868c-460f-aa3d-68615e65881b-crio-socket\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.790946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.790946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlr2z\" (UniqueName: \"kubernetes.io/projected/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-api-access-nlr2z\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.791062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.790944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fdcd7d0-868c-460f-aa3d-68615e65881b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.791062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791010 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wk5d5\" (UniqueName: \"kubernetes.io/projected/a50a763d-0483-4cef-83ba-d619b78a1ca4-kube-api-access-wk5d5\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.791148 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791070 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50a763d-0483-4cef-83ba-d619b78a1ca4-metrics-tls\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.791148 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791106 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50a763d-0483-4cef-83ba-d619b78a1ca4-tmp-dir\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.791243 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fdcd7d0-868c-460f-aa3d-68615e65881b-data-volume\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.791243 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a50a763d-0483-4cef-83ba-d619b78a1ca4-config-volume\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.791427 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.791407 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a50a763d-0483-4cef-83ba-d619b78a1ca4-tmp-dir\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.795112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.795092 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a50a763d-0483-4cef-83ba-d619b78a1ca4-metrics-tls\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.795229 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.795137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5984a7-272a-4537-b05e-772fb2c5c620-cert\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.798732 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.798708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk5d5\" (UniqueName: \"kubernetes.io/projected/a50a763d-0483-4cef-83ba-d619b78a1ca4-kube-api-access-wk5d5\") pod \"dns-default-q5sgh\" (UID: \"a50a763d-0483-4cef-83ba-d619b78a1ca4\") " pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.798969 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.798948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrdr\" (UniqueName: \"kubernetes.io/projected/5f5984a7-272a-4537-b05e-772fb2c5c620-kube-api-access-hkrdr\") pod \"ingress-canary-gzp87\" (UID: \"5f5984a7-272a-4537-b05e-772fb2c5c620\") " pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.891897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.891862 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fdcd7d0-868c-460f-aa3d-68615e65881b-crio-socket\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.891897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.891897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.891918 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlr2z\" (UniqueName: \"kubernetes.io/projected/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-api-access-nlr2z\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.891994 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fdcd7d0-868c-460f-aa3d-68615e65881b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.892063 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fdcd7d0-868c-460f-aa3d-68615e65881b-data-volume\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.892091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fdcd7d0-868c-460f-aa3d-68615e65881b-crio-socket\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.892326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fdcd7d0-868c-460f-aa3d-68615e65881b-data-volume\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.892565 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.892546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.894281 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.894262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fdcd7d0-868c-460f-aa3d-68615e65881b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.895205 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.895177 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:35.900331 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.900308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlr2z\" (UniqueName: \"kubernetes.io/projected/5fdcd7d0-868c-460f-aa3d-68615e65881b-kube-api-access-nlr2z\") pod \"insights-runtime-extractor-q5kmd\" (UID: \"5fdcd7d0-868c-460f-aa3d-68615e65881b\") " pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:35.910527 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.910488 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzp87" Jun 03 17:49:35.988657 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:35.988083 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5kmd" Jun 03 17:49:36.067523 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.067472 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzp87"] Jun 03 17:49:36.070093 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.070056 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5sgh"] Jun 03 17:49:36.072963 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:36.072931 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5984a7_272a_4537_b05e_772fb2c5c620.slice/crio-d4553e13e47940e42040e0a73b4691e98cf82b732847e96960fa129c83c00999 WatchSource:0}: Error finding container d4553e13e47940e42040e0a73b4691e98cf82b732847e96960fa129c83c00999: Status 404 returned error can't find the container with id d4553e13e47940e42040e0a73b4691e98cf82b732847e96960fa129c83c00999 Jun 03 17:49:36.075783 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:36.075760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50a763d_0483_4cef_83ba_d619b78a1ca4.slice/crio-7d9280997c28b2f2a423284a4033425976abf30567bc0845505303c3bed06117 WatchSource:0}: Error finding container 7d9280997c28b2f2a423284a4033425976abf30567bc0845505303c3bed06117: Status 404 returned error can't find the container with id 7d9280997c28b2f2a423284a4033425976abf30567bc0845505303c3bed06117 Jun 03 17:49:36.141718 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.141686 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5kmd"] Jun 03 17:49:36.146239 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:49:36.146212 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdcd7d0_868c_460f_aa3d_68615e65881b.slice/crio-8843213833a25a04ae8c5136689a543a6607cb9bc04450c74c12acd788b77345 WatchSource:0}: Error finding container 8843213833a25a04ae8c5136689a543a6607cb9bc04450c74c12acd788b77345: Status 404 returned error can't find the container with id 8843213833a25a04ae8c5136689a543a6607cb9bc04450c74c12acd788b77345 Jun 03 17:49:36.909041 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.909007 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5sgh" event={"ID":"a50a763d-0483-4cef-83ba-d619b78a1ca4","Type":"ContainerStarted","Data":"7d9280997c28b2f2a423284a4033425976abf30567bc0845505303c3bed06117"} Jun 03 17:49:36.910739 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.910711 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzp87" event={"ID":"5f5984a7-272a-4537-b05e-772fb2c5c620","Type":"ContainerStarted","Data":"d4553e13e47940e42040e0a73b4691e98cf82b732847e96960fa129c83c00999"} Jun 03 17:49:36.912387 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.912360 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5kmd" event={"ID":"5fdcd7d0-868c-460f-aa3d-68615e65881b","Type":"ContainerStarted","Data":"9a5439c3fcf75c500a2bcf3922f89d4ef4dbeb2f6dd309d722bf617b5b4f9dfb"} Jun 03 17:49:36.912484 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:36.912397 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5kmd" event={"ID":"5fdcd7d0-868c-460f-aa3d-68615e65881b","Type":"ContainerStarted","Data":"8843213833a25a04ae8c5136689a543a6607cb9bc04450c74c12acd788b77345"} Jun 03 17:49:37.916426 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:37.916378 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5kmd" event={"ID":"5fdcd7d0-868c-460f-aa3d-68615e65881b","Type":"ContainerStarted","Data":"f8c8ef8cf6c5fdf30ef68103f5528107a1b2873f608f92fb1d02211754065ec7"} Jun 03 17:49:41.927766 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.927733 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5kmd" event={"ID":"5fdcd7d0-868c-460f-aa3d-68615e65881b","Type":"ContainerStarted","Data":"7132286557de31a6c9a46db76cf21b4de5f2e630b3d6b0d8927bff41f0169d98"} Jun 03 17:49:41.930193 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.930166 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="93b65debdc1c5e8be5a53a9f6a8612f6356fba47fac642f79331125ed32b0f2e" exitCode=0 Jun 03 17:49:41.930299 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.930214 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"93b65debdc1c5e8be5a53a9f6a8612f6356fba47fac642f79331125ed32b0f2e"} Jun 03 17:49:41.935094 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.935066 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5sgh" event={"ID":"a50a763d-0483-4cef-83ba-d619b78a1ca4","Type":"ContainerStarted","Data":"b1801b78ecc9dda5e52e8ae8ad865cd2754106a4132a062ae5d0152abaf8cac4"} Jun 03 17:49:41.935212 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.935102 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5sgh" event={"ID":"a50a763d-0483-4cef-83ba-d619b78a1ca4","Type":"ContainerStarted","Data":"1966c90f8cbb1970e86da9a4a20e5ef60adaa5ac625c6cd8616f97b9a6355a77"} Jun 03 17:49:41.935272 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.935226 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q5sgh" Jun 03 17:49:41.936328 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.936310 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzp87" event={"ID":"5f5984a7-272a-4537-b05e-772fb2c5c620","Type":"ContainerStarted","Data":"9cb011742c3f7630e91a3a5825e8f74a92acc4f154007fa03f4444682fef08b0"} Jun 03 17:49:41.945622 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.945576 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q5kmd" podStartSLOduration=1.6602425539999999 podStartE2EDuration="6.945563927s" podCreationTimestamp="2026-06-03 17:49:35 +0000 UTC" firstStartedPulling="2026-06-03 17:49:36.238601827 +0000 UTC m=+71.107900404" lastFinishedPulling="2026-06-03 17:49:41.523923205 +0000 UTC m=+76.393221777" observedRunningTime="2026-06-03 17:49:41.94547185 +0000 UTC m=+76.814770443" watchObservedRunningTime="2026-06-03 17:49:41.945563927 +0000 UTC m=+76.814862521" Jun 03 17:49:41.961544 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.961337 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-q5sgh" podStartSLOduration=1.520021148 podStartE2EDuration="6.961322433s" podCreationTimestamp="2026-06-03 17:49:35 +0000 UTC" firstStartedPulling="2026-06-03 17:49:36.078017593 +0000 UTC m=+70.947316166" lastFinishedPulling="2026-06-03 17:49:41.519318875 +0000 UTC m=+76.388617451" observedRunningTime="2026-06-03 17:49:41.960310897 +0000 UTC m=+76.829609494" watchObservedRunningTime="2026-06-03 17:49:41.961322433 +0000 UTC m=+76.830621028" Jun 03 17:49:41.994573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:41.994530 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzp87" podStartSLOduration=1.549229749 podStartE2EDuration="6.99449178s" podCreationTimestamp="2026-06-03 17:49:35 +0000 UTC" firstStartedPulling="2026-06-03 17:49:36.076564822 +0000 UTC m=+70.945863394" lastFinishedPulling="2026-06-03 17:49:41.52182684 +0000 UTC m=+76.391125425" observedRunningTime="2026-06-03 17:49:41.994008868 +0000 UTC m=+76.863307463" watchObservedRunningTime="2026-06-03 17:49:41.99449178 +0000 UTC m=+76.863790374" Jun 03 17:49:42.942218 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:42.942136 2581 generic.go:358] "Generic (PLEG): container finished" podID="3326f203-72a2-4385-aa72-a925db2102be" containerID="9a6d66b4b98b9ed4b97aa92c34c7db5e6fdf879a60acb214960ff8eec57a8fd0" exitCode=0 Jun 03 17:49:42.942651 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:42.942243 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerDied","Data":"9a6d66b4b98b9ed4b97aa92c34c7db5e6fdf879a60acb214960ff8eec57a8fd0"} Jun 03 17:49:43.948058 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:43.948025 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" event={"ID":"3326f203-72a2-4385-aa72-a925db2102be","Type":"ContainerStarted","Data":"fee77490bcb0b0967b5f669652e532f8d633225c3ece7d5169dd8f3211887d69"} Jun 03 17:49:43.970305 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:43.970258 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzrpg" podStartSLOduration=20.339479207 podStartE2EDuration="58.970244861s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.891109121 +0000 UTC m=+37.760407694" lastFinishedPulling="2026-06-03 17:49:41.52187476 +0000 UTC m=+76.391173348" observedRunningTime="2026-06-03 17:49:43.969575531 +0000 UTC m=+78.838874125" watchObservedRunningTime="2026-06-03 17:49:43.970244861 +0000 UTC m=+78.839543455" Jun 03 17:49:51.945238 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:49:51.945206 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5sgh" Jun 03 17:50:00.910025 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:00.909997 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwrvm" Jun 03 17:50:06.416617 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.416580 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:50:06.419997 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.419975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d51f1-576f-4969-871a-f4443810e201-metrics-certs\") pod \"network-metrics-daemon-r68wz\" (UID: \"4d3d51f1-576f-4969-871a-f4443810e201\") " pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:50:06.517661 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.517609 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:50:06.520284 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.520257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7sk\" (UniqueName: \"kubernetes.io/projected/ecadf230-c02f-47fc-96ee-ef141792672c-kube-api-access-fq7sk\") pod \"network-check-target-4kxzh\" (UID: \"ecadf230-c02f-47fc-96ee-ef141792672c\") " pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:50:06.575127 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.575072 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:50:06.581865 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.581842 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r68wz" Jun 03 17:50:06.711799 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.711767 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4kxzh"] Jun 03 17:50:06.715069 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:50:06.715031 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecadf230_c02f_47fc_96ee_ef141792672c.slice/crio-fbd459f44678b10278f3633cbd7845a42f7ee3665c0cf69b911dbd1fc1946d3d WatchSource:0}: Error finding container fbd459f44678b10278f3633cbd7845a42f7ee3665c0cf69b911dbd1fc1946d3d: Status 404 returned error can't find the container with id fbd459f44678b10278f3633cbd7845a42f7ee3665c0cf69b911dbd1fc1946d3d Jun 03 17:50:06.730440 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:06.730415 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r68wz"] Jun 03 17:50:06.733144 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:50:06.733119 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3d51f1_576f_4969_871a_f4443810e201.slice/crio-845be87a1dd08e66d625bf78589c5d9f57f3c751ab7740258d524d5d42ee2f28 WatchSource:0}: Error finding container 845be87a1dd08e66d625bf78589c5d9f57f3c751ab7740258d524d5d42ee2f28: Status 404 returned error can't find the container with id 845be87a1dd08e66d625bf78589c5d9f57f3c751ab7740258d524d5d42ee2f28 Jun 03 17:50:07.003987 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:07.003951 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r68wz" event={"ID":"4d3d51f1-576f-4969-871a-f4443810e201","Type":"ContainerStarted","Data":"845be87a1dd08e66d625bf78589c5d9f57f3c751ab7740258d524d5d42ee2f28"} Jun 03 17:50:07.004784 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:07.004763 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4kxzh" event={"ID":"ecadf230-c02f-47fc-96ee-ef141792672c","Type":"ContainerStarted","Data":"fbd459f44678b10278f3633cbd7845a42f7ee3665c0cf69b911dbd1fc1946d3d"} Jun 03 17:50:08.009000 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:08.008962 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r68wz" event={"ID":"4d3d51f1-576f-4969-871a-f4443810e201","Type":"ContainerStarted","Data":"4b8851b889ea9caba3e00df3f61a0696c2b0f9e4cc309cc90103b84b36f87a26"} Jun 03 17:50:08.009000 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:08.009006 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r68wz" event={"ID":"4d3d51f1-576f-4969-871a-f4443810e201","Type":"ContainerStarted","Data":"4e01241c02c420a1c89d294529da3890aad4814993197ca42e312ef61c0971c8"} Jun 03 17:50:08.024722 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:08.024671 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r68wz" podStartSLOduration=81.962588365 podStartE2EDuration="1m23.024655746s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:50:06.735238849 +0000 UTC m=+101.604537421" lastFinishedPulling="2026-06-03 17:50:07.797306226 +0000 UTC m=+102.666604802" observedRunningTime="2026-06-03 17:50:08.023741395 +0000 UTC m=+102.893040014" watchObservedRunningTime="2026-06-03 17:50:08.024655746 +0000 UTC m=+102.893954340" Jun 03 17:50:11.018298 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:11.018258 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4kxzh" event={"ID":"ecadf230-c02f-47fc-96ee-ef141792672c","Type":"ContainerStarted","Data":"e29449af1f6bee6bf7913a3db85ce884b9db0813da20fdc5af217e2175420c1f"} Jun 03 17:50:11.018773 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:11.018361 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:50:11.032905 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:11.032862 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4kxzh" podStartSLOduration=82.755086664 podStartE2EDuration="1m26.032848957s" podCreationTimestamp="2026-06-03 17:48:45 +0000 UTC" firstStartedPulling="2026-06-03 17:50:06.71681439 +0000 UTC m=+101.586112962" lastFinishedPulling="2026-06-03 17:50:09.994576683 +0000 UTC m=+104.863875255" observedRunningTime="2026-06-03 17:50:11.032348637 +0000 UTC m=+105.901647228" watchObservedRunningTime="2026-06-03 17:50:11.032848957 +0000 UTC m=+105.902147550" Jun 03 17:50:19.447619 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.447582 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 17:50:19.452088 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.452072 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455045 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455086 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455114 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455146 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455148 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455119 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fm5kx\"" Jun 03 17:50:19.455263 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455170 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 17:50:19.455665 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455465 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 17:50:19.455665 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.455652 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 17:50:19.464245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.464220 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 17:50:19.464364 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.464295 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 17:50:19.495995 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.495966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.495995 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.495997 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-web-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pcg\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-kube-api-access-54pcg\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.496416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.496365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-out\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596709 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596666 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596709 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596707 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-out\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596728 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596749 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596780 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596805 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596847 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596870 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.596947 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596931 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-web-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.596975 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.597004 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54pcg\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-kube-api-access-54pcg\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.597035 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.597276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597757 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.597735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.597817 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.597763 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600113 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.599951 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-out\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600113 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600301 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600529 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600579 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600689 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600650 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600842 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-web-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.600939 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.600917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.602127 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.602098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.608973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.608953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pcg\" (UniqueName: \"kubernetes.io/projected/fc33e8db-4c98-48c0-a5d6-39e2831b63a9-kube-api-access-54pcg\") pod \"alertmanager-main-0\" (UID: \"fc33e8db-4c98-48c0-a5d6-39e2831b63a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.764071 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.764045 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 17:50:19.896367 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:19.896343 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 17:50:19.899144 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:50:19.899112 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc33e8db_4c98_48c0_a5d6_39e2831b63a9.slice/crio-eb43514881794e5fee8a731c1b2ab6c8c4498d10ce6b66d0297e82cbfc53126e WatchSource:0}: Error finding container eb43514881794e5fee8a731c1b2ab6c8c4498d10ce6b66d0297e82cbfc53126e: Status 404 returned error can't find the container with id eb43514881794e5fee8a731c1b2ab6c8c4498d10ce6b66d0297e82cbfc53126e Jun 03 17:50:20.041151 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:20.041073 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"eb43514881794e5fee8a731c1b2ab6c8c4498d10ce6b66d0297e82cbfc53126e"} Jun 03 17:50:21.845032 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.844999 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb"] Jun 03 17:50:21.847092 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.847076 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.849410 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849389 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 17:50:21.849562 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849412 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 17:50:21.849562 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849389 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 17:50:21.849725 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849709 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 17:50:21.849815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849748 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 17:50:21.849815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.849755 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7d62v\"" Jun 03 17:50:21.854139 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.854119 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 17:50:21.858168 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.858145 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb"] Jun 03 17:50:21.911979 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.911947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-serving-certs-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.911979 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.911981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-telemeter-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9md\" (UniqueName: \"kubernetes.io/projected/30bada72-38d6-4008-883f-84e78db212cd-kube-api-access-pw9md\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-federate-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:21.912411 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:21.912243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-metrics-client-ca\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013327 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013293 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-federate-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013327 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013340 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013377 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-metrics-client-ca\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013421 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-serving-certs-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013448 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-telemeter-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013792 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013564 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9md\" (UniqueName: \"kubernetes.io/projected/30bada72-38d6-4008-883f-84e78db212cd-kube-api-access-pw9md\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013792 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013626 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.013792 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.013661 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.014354 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.014331 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-metrics-client-ca\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.014452 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.014366 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-serving-certs-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.015012 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.014986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bada72-38d6-4008-883f-84e78db212cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.016132 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.016113 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.016219 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.016206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-federate-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.016496 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.016479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-telemeter-client-tls\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.016625 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.016604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30bada72-38d6-4008-883f-84e78db212cd-secret-telemeter-client\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.023981 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.023954 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9md\" (UniqueName: \"kubernetes.io/projected/30bada72-38d6-4008-883f-84e78db212cd-kube-api-access-pw9md\") pod \"telemeter-client-7d8df55bf4-nnwfb\" (UID: \"30bada72-38d6-4008-883f-84e78db212cd\") " pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.050220 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.050195 2581 generic.go:358] "Generic (PLEG): container finished" podID="fc33e8db-4c98-48c0-a5d6-39e2831b63a9" containerID="34a8d35d7b12474658d892b3f4e29561ea3d0196cf524dfb14e9e3e1e66e53b9" exitCode=0 Jun 03 17:50:22.050341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.050245 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerDied","Data":"34a8d35d7b12474658d892b3f4e29561ea3d0196cf524dfb14e9e3e1e66e53b9"} Jun 03 17:50:22.157686 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.157621 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" Jun 03 17:50:22.278217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:22.278182 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb"] Jun 03 17:50:22.282250 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:50:22.282217 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bada72_38d6_4008_883f_84e78db212cd.slice/crio-537d91ba75383c4d195cb47e82f7695c5e78f4c622e1f168b51fead0fdea1071 WatchSource:0}: Error finding container 537d91ba75383c4d195cb47e82f7695c5e78f4c622e1f168b51fead0fdea1071: Status 404 returned error can't find the container with id 537d91ba75383c4d195cb47e82f7695c5e78f4c622e1f168b51fead0fdea1071 Jun 03 17:50:23.053847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:23.053808 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" event={"ID":"30bada72-38d6-4008-883f-84e78db212cd","Type":"ContainerStarted","Data":"537d91ba75383c4d195cb47e82f7695c5e78f4c622e1f168b51fead0fdea1071"} Jun 03 17:50:24.059298 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:24.059265 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"e0bea69762937cb9ce9d8b6f457b4449faf5bd2802fa2dc1cfb96914ef3dfa40"} Jun 03 17:50:24.059298 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:24.059299 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"d27a06c3359ab5a69b9c691ad531aa2b10c31c35a93d219f32cded06d0c4aa04"} Jun 03 17:50:24.059750 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:24.059310 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"0df89c74cec346bbc2e154b45810a17489a877d86040a202c26eb52ec4762c38"} Jun 03 17:50:24.059750 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:24.059319 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"006435e17ffd7a343f4d4983ef7a0560376b4fe00aad940efd12b00faee3e1d4"} Jun 03 17:50:24.059750 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:24.059332 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"6c7975da73abf7893f0e3ccf2ec50faac10da072933a4b7a00b72e1508350da8"} Jun 03 17:50:25.068621 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:25.068580 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc33e8db-4c98-48c0-a5d6-39e2831b63a9","Type":"ContainerStarted","Data":"be028962898bcc6859a2115f1f72936b5db9d680ed23312cb652fbef102e8543"} Jun 03 17:50:25.070241 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:25.070212 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" event={"ID":"30bada72-38d6-4008-883f-84e78db212cd","Type":"ContainerStarted","Data":"5a31d985e5f7b493bd83ea863ea73b259a133663b3f73888c2e795f5fa29e4a6"} Jun 03 17:50:25.070342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:25.070248 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" event={"ID":"30bada72-38d6-4008-883f-84e78db212cd","Type":"ContainerStarted","Data":"0c2c509e8668ef10bb541b1ad1e0ade4dbbc1ac2b50d5d55b6aa836bca3b8ba8"} Jun 03 17:50:25.070342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:25.070263 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" event={"ID":"30bada72-38d6-4008-883f-84e78db212cd","Type":"ContainerStarted","Data":"8388e3d585efff65cba10a43ac0f5fe9ee079049c950dc4945ec98cde178d218"} Jun 03 17:50:25.096045 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:25.095989 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.059093478 podStartE2EDuration="6.095974646s" podCreationTimestamp="2026-06-03 17:50:19 +0000 UTC" firstStartedPulling="2026-06-03 17:50:19.900978031 +0000 UTC m=+114.770276603" lastFinishedPulling="2026-06-03 17:50:24.937859194 +0000 UTC m=+119.807157771" observedRunningTime="2026-06-03 17:50:25.094225695 +0000 UTC m=+119.963524291" watchObservedRunningTime="2026-06-03 17:50:25.095974646 +0000 UTC m=+119.965273241" Jun 03 17:50:42.023412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:42.023379 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4kxzh" Jun 03 17:50:42.039139 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:50:42.039092 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d8df55bf4-nnwfb" podStartSLOduration=18.89759095 podStartE2EDuration="21.039063745s" podCreationTimestamp="2026-06-03 17:50:21 +0000 UTC" firstStartedPulling="2026-06-03 17:50:22.28412528 +0000 UTC m=+117.153423852" lastFinishedPulling="2026-06-03 17:50:24.425598062 +0000 UTC m=+119.294896647" observedRunningTime="2026-06-03 17:50:25.115683039 +0000 UTC m=+119.984981644" watchObservedRunningTime="2026-06-03 17:50:42.039063745 +0000 UTC m=+136.908362317" Jun 03 17:52:01.406223 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.406187 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xmltj"] Jun 03 17:52:01.408087 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.408071 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.410544 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.410522 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 17:52:01.422551 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.422527 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmltj"] Jun 03 17:52:01.506016 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.505986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-kubelet-config\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.506167 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.506027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-dbus\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.506167 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.506057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0cfaae00-d5b9-437f-a484-32ee3379a627-original-pull-secret\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.607218 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.607184 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0cfaae00-d5b9-437f-a484-32ee3379a627-original-pull-secret\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.607389 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.607234 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-kubelet-config\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.607389 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.607281 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-dbus\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.607479 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.607392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-kubelet-config\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.607479 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.607441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0cfaae00-d5b9-437f-a484-32ee3379a627-dbus\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.609712 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.609691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0cfaae00-d5b9-437f-a484-32ee3379a627-original-pull-secret\") pod \"global-pull-secret-syncer-xmltj\" (UID: \"0cfaae00-d5b9-437f-a484-32ee3379a627\") " pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.717117 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.717090 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmltj" Jun 03 17:52:01.835529 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:01.835473 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmltj"] Jun 03 17:52:01.839192 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:01.839164 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfaae00_d5b9_437f_a484_32ee3379a627.slice/crio-090028fe19101645af82032095ffc238edca113958479482da5475529373e44b WatchSource:0}: Error finding container 090028fe19101645af82032095ffc238edca113958479482da5475529373e44b: Status 404 returned error can't find the container with id 090028fe19101645af82032095ffc238edca113958479482da5475529373e44b Jun 03 17:52:02.318110 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:02.318081 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xmltj" event={"ID":"0cfaae00-d5b9-437f-a484-32ee3379a627","Type":"ContainerStarted","Data":"090028fe19101645af82032095ffc238edca113958479482da5475529373e44b"} Jun 03 17:52:06.328669 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:06.328634 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xmltj" event={"ID":"0cfaae00-d5b9-437f-a484-32ee3379a627","Type":"ContainerStarted","Data":"eb146fb8ba96ba3d52c59e2435c4ee18890b9425cd58a32842538202fa65a5ba"} Jun 03 17:52:06.344324 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:06.344276 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xmltj" podStartSLOduration=1.268756818 podStartE2EDuration="5.344262264s" podCreationTimestamp="2026-06-03 17:52:01 +0000 UTC" firstStartedPulling="2026-06-03 17:52:01.840748923 +0000 UTC m=+216.710047496" lastFinishedPulling="2026-06-03 17:52:05.91625437 +0000 UTC m=+220.785552942" observedRunningTime="2026-06-03 17:52:06.342618579 +0000 UTC m=+221.211917185" watchObservedRunningTime="2026-06-03 17:52:06.344262264 +0000 UTC m=+221.213560857" Jun 03 17:52:18.694720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.694685 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc"] Jun 03 17:52:18.696784 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.696768 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.699266 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.699236 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:52:18.699944 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.699924 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:52:18.700047 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.699955 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:52:18.704766 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.704743 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc"] Jun 03 17:52:18.830401 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.830367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94xx\" (UniqueName: \"kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.830587 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.830409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.830587 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.830447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.931089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.931059 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.931269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.931113 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.931269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.931140 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s94xx\" (UniqueName: \"kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.931445 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.931422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.931536 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.931475 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:18.939653 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:18.939630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94xx\" (UniqueName: \"kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:19.006111 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:19.006082 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:19.125550 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:19.125524 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc"] Jun 03 17:52:19.128016 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:19.127989 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fbc67a_ea8a_45c2_9ecc_d534bee83990.slice/crio-df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f WatchSource:0}: Error finding container df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f: Status 404 returned error can't find the container with id df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f Jun 03 17:52:19.362104 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:19.362016 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" event={"ID":"c2fbc67a-ea8a-45c2-9ecc-d534bee83990","Type":"ContainerStarted","Data":"df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f"} Jun 03 17:52:24.376698 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:24.376657 2581 generic.go:358] "Generic (PLEG): container finished" podID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerID="88066d1e75f303aca8cf9e090136e77f801c4a3bceadf88616343e0bedd6949a" exitCode=0 Jun 03 17:52:24.377018 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:24.376738 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" event={"ID":"c2fbc67a-ea8a-45c2-9ecc-d534bee83990","Type":"ContainerDied","Data":"88066d1e75f303aca8cf9e090136e77f801c4a3bceadf88616343e0bedd6949a"} Jun 03 17:52:27.385763 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:27.385671 2581 generic.go:358] "Generic (PLEG): container finished" podID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerID="08e040529a2efd69974028a9c0eb1112e8a83744369f5b244f5edd6f2afff2e7" exitCode=0 Jun 03 17:52:27.386195 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:27.385765 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" event={"ID":"c2fbc67a-ea8a-45c2-9ecc-d534bee83990","Type":"ContainerDied","Data":"08e040529a2efd69974028a9c0eb1112e8a83744369f5b244f5edd6f2afff2e7"} Jun 03 17:52:34.405718 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:34.405685 2581 generic.go:358] "Generic (PLEG): container finished" podID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerID="92911f56bee90a604cd21bfd900b3ae6627881b5c097c955be60a4cc03db085b" exitCode=0 Jun 03 17:52:34.406090 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:34.405785 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" event={"ID":"c2fbc67a-ea8a-45c2-9ecc-d534bee83990","Type":"ContainerDied","Data":"92911f56bee90a604cd21bfd900b3ae6627881b5c097c955be60a4cc03db085b"} Jun 03 17:52:35.527636 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.527613 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:35.668177 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.668097 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s94xx\" (UniqueName: \"kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx\") pod \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " Jun 03 17:52:35.668332 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.668189 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle\") pod \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " Jun 03 17:52:35.668332 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.668237 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util\") pod \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\" (UID: \"c2fbc67a-ea8a-45c2-9ecc-d534bee83990\") " Jun 03 17:52:35.668881 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.668857 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle" (OuterVolumeSpecName: "bundle") pod "c2fbc67a-ea8a-45c2-9ecc-d534bee83990" (UID: "c2fbc67a-ea8a-45c2-9ecc-d534bee83990"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:52:35.670396 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.670361 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx" (OuterVolumeSpecName: "kube-api-access-s94xx") pod "c2fbc67a-ea8a-45c2-9ecc-d534bee83990" (UID: "c2fbc67a-ea8a-45c2-9ecc-d534bee83990"). InnerVolumeSpecName "kube-api-access-s94xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:52:35.673705 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.673680 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util" (OuterVolumeSpecName: "util") pod "c2fbc67a-ea8a-45c2-9ecc-d534bee83990" (UID: "c2fbc67a-ea8a-45c2-9ecc-d534bee83990"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:52:35.769404 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.769374 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:35.769404 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.769397 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:35.769404 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:35.769407 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s94xx\" (UniqueName: \"kubernetes.io/projected/c2fbc67a-ea8a-45c2-9ecc-d534bee83990-kube-api-access-s94xx\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:36.412839 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:36.412804 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" event={"ID":"c2fbc67a-ea8a-45c2-9ecc-d534bee83990","Type":"ContainerDied","Data":"df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f"} Jun 03 17:52:36.412839 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:36.412836 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df87cd12eac78f8b0fc9ec60866626c4f16e96a543a3317b50247de0cda9cb0f" Jun 03 17:52:36.413038 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:36.412834 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhzhpc" Jun 03 17:52:41.695863 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.695829 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47"] Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696157 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="extract" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696171 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="extract" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696179 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="pull" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696184 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="pull" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696193 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="util" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696199 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="util" Jun 03 17:52:41.696294 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.696238 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2fbc67a-ea8a-45c2-9ecc-d534bee83990" containerName="extract" Jun 03 17:52:41.745475 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.745448 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47"] Jun 03 17:52:41.745628 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.745566 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:41.748369 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.748331 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:52:41.748523 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.748336 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 17:52:41.748523 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.748440 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4r6t7\"" Jun 03 17:52:41.913863 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.913827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qqp\" (UniqueName: \"kubernetes.io/projected/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-kube-api-access-x4qqp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:41.914032 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:41.913877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.014411 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.014378 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.014602 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.014445 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qqp\" (UniqueName: \"kubernetes.io/projected/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-kube-api-access-x4qqp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.014844 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.014826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.023037 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.023006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qqp\" (UniqueName: \"kubernetes.io/projected/d9c2ee9e-50ef-4b37-ac10-cb19f468b60c-kube-api-access-x4qqp\") pod \"cert-manager-operator-controller-manager-54b9655956-frj47\" (UID: \"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.053935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.053912 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" Jun 03 17:52:42.182738 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.182704 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47"] Jun 03 17:52:42.185910 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:42.185877 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c2ee9e_50ef_4b37_ac10_cb19f468b60c.slice/crio-ca540565812331821d79f8a36d8db0db52e9454c2e1ce16c652dc35fca788f50 WatchSource:0}: Error finding container ca540565812331821d79f8a36d8db0db52e9454c2e1ce16c652dc35fca788f50: Status 404 returned error can't find the container with id ca540565812331821d79f8a36d8db0db52e9454c2e1ce16c652dc35fca788f50 Jun 03 17:52:42.430867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:42.430788 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" event={"ID":"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c","Type":"ContainerStarted","Data":"ca540565812331821d79f8a36d8db0db52e9454c2e1ce16c652dc35fca788f50"} Jun 03 17:52:44.439267 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:44.439175 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" event={"ID":"d9c2ee9e-50ef-4b37-ac10-cb19f468b60c","Type":"ContainerStarted","Data":"678ac25322388849052f9b20b45d82cfffe9991b290f6247ac7a42c76b7b6e6f"} Jun 03 17:52:44.459018 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:44.458974 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frj47" podStartSLOduration=1.540421119 podStartE2EDuration="3.458962404s" podCreationTimestamp="2026-06-03 17:52:41 +0000 UTC" firstStartedPulling="2026-06-03 17:52:42.188261857 +0000 UTC m=+257.057560430" lastFinishedPulling="2026-06-03 17:52:44.106803131 +0000 UTC m=+258.976101715" observedRunningTime="2026-06-03 17:52:44.458462846 +0000 UTC m=+259.327761439" watchObservedRunningTime="2026-06-03 17:52:44.458962404 +0000 UTC m=+259.328260998" Jun 03 17:52:45.720789 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.720748 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2"] Jun 03 17:52:45.741780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.741750 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2"] Jun 03 17:52:45.741922 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.741879 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.744391 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.744370 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:52:45.745142 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.745124 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:52:45.745209 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.745164 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:52:45.841308 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.841272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.841471 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.841320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.841471 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.841343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mvn\" (UniqueName: \"kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.942032 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.941988 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.942204 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.942055 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.942204 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.942100 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mvn\" (UniqueName: \"kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.942375 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.942354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.942435 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.942391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:45.950596 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:45.950569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mvn\" (UniqueName: \"kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:46.050912 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:46.050819 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:46.173625 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:46.173567 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2"] Jun 03 17:52:46.176149 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:46.176120 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893f8f07_77cd_4d6b_ba91_b084ee976669.slice/crio-1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2 WatchSource:0}: Error finding container 1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2: Status 404 returned error can't find the container with id 1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2 Jun 03 17:52:46.446660 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:46.446621 2581 generic.go:358] "Generic (PLEG): container finished" podID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerID="390acc304c16df99c9b8c9bca29161f59e8f6c60a21cfeff4854d1e555f33f68" exitCode=0 Jun 03 17:52:46.446777 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:46.446698 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" event={"ID":"893f8f07-77cd-4d6b-ba91-b084ee976669","Type":"ContainerDied","Data":"390acc304c16df99c9b8c9bca29161f59e8f6c60a21cfeff4854d1e555f33f68"} Jun 03 17:52:46.446777 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:46.446722 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" event={"ID":"893f8f07-77cd-4d6b-ba91-b084ee976669","Type":"ContainerStarted","Data":"1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2"} Jun 03 17:52:48.549854 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.549816 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kbqv8"] Jun 03 17:52:48.558828 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.558793 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.561660 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.561550 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 17:52:48.561660 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.561633 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4f5fl\"" Jun 03 17:52:48.561882 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.561866 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 17:52:48.562484 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.562457 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kbqv8"] Jun 03 17:52:48.660836 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.660799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8qc\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-kube-api-access-7w8qc\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.660994 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.660883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.762017 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.761991 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8qc\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-kube-api-access-7w8qc\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.762122 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.762031 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.770452 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.770425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8qc\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-kube-api-access-7w8qc\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.771231 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.771211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e263dfc-88b9-4650-a253-b0a318bf5a37-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kbqv8\" (UID: \"0e263dfc-88b9-4650-a253-b0a318bf5a37\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:48.876307 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:48.876251 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" Jun 03 17:52:49.002978 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:49.002946 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kbqv8"] Jun 03 17:52:49.006006 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:49.005979 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e263dfc_88b9_4650_a253_b0a318bf5a37.slice/crio-abfc550017a36671e547fbeb909a1fed159357dd399895cd2c3c7426f2b49872 WatchSource:0}: Error finding container abfc550017a36671e547fbeb909a1fed159357dd399895cd2c3c7426f2b49872: Status 404 returned error can't find the container with id abfc550017a36671e547fbeb909a1fed159357dd399895cd2c3c7426f2b49872 Jun 03 17:52:49.455671 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:49.455634 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" event={"ID":"0e263dfc-88b9-4650-a253-b0a318bf5a37","Type":"ContainerStarted","Data":"abfc550017a36671e547fbeb909a1fed159357dd399895cd2c3c7426f2b49872"} Jun 03 17:52:49.457070 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:49.457047 2581 generic.go:358] "Generic (PLEG): container finished" podID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerID="07a34048d7d47f63a44f4da0f47aab1a82a7a4bad9e58a2970cc95e8b8a4402a" exitCode=0 Jun 03 17:52:49.457119 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:49.457091 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" event={"ID":"893f8f07-77cd-4d6b-ba91-b084ee976669","Type":"ContainerDied","Data":"07a34048d7d47f63a44f4da0f47aab1a82a7a4bad9e58a2970cc95e8b8a4402a"} Jun 03 17:52:50.462596 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:50.462559 2581 generic.go:358] "Generic (PLEG): container finished" podID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerID="11aee9a78dc1ed8491141daa599c814fa1a2865db1ec651937bfd601320f66c3" exitCode=0 Jun 03 17:52:50.463154 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:50.462628 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" event={"ID":"893f8f07-77cd-4d6b-ba91-b084ee976669","Type":"ContainerDied","Data":"11aee9a78dc1ed8491141daa599c814fa1a2865db1ec651937bfd601320f66c3"} Jun 03 17:52:51.595403 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.595262 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:51.786040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.785967 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7mvn\" (UniqueName: \"kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn\") pod \"893f8f07-77cd-4d6b-ba91-b084ee976669\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " Jun 03 17:52:51.786040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.786031 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util\") pod \"893f8f07-77cd-4d6b-ba91-b084ee976669\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " Jun 03 17:52:51.786232 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.786074 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle\") pod \"893f8f07-77cd-4d6b-ba91-b084ee976669\" (UID: \"893f8f07-77cd-4d6b-ba91-b084ee976669\") " Jun 03 17:52:51.786469 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.786444 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle" (OuterVolumeSpecName: "bundle") pod "893f8f07-77cd-4d6b-ba91-b084ee976669" (UID: "893f8f07-77cd-4d6b-ba91-b084ee976669"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:52:51.788259 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.788237 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn" (OuterVolumeSpecName: "kube-api-access-p7mvn") pod "893f8f07-77cd-4d6b-ba91-b084ee976669" (UID: "893f8f07-77cd-4d6b-ba91-b084ee976669"). InnerVolumeSpecName "kube-api-access-p7mvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:52:51.813400 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.813372 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util" (OuterVolumeSpecName: "util") pod "893f8f07-77cd-4d6b-ba91-b084ee976669" (UID: "893f8f07-77cd-4d6b-ba91-b084ee976669"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:52:51.887368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.887338 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:51.887368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.887365 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f8f07-77cd-4d6b-ba91-b084ee976669-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:51.887368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:51.887374 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7mvn\" (UniqueName: \"kubernetes.io/projected/893f8f07-77cd-4d6b-ba91-b084ee976669-kube-api-access-p7mvn\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:52:52.469718 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.469684 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" Jun 03 17:52:52.469910 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.469681 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flbzn2" event={"ID":"893f8f07-77cd-4d6b-ba91-b084ee976669","Type":"ContainerDied","Data":"1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2"} Jun 03 17:52:52.469910 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.469803 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c711b9a0dde6e547f325afe491c7c78edbf32b66824a3f21bfcf09618e56ad2" Jun 03 17:52:52.470974 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.470936 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" event={"ID":"0e263dfc-88b9-4650-a253-b0a318bf5a37","Type":"ContainerStarted","Data":"d0052bae7abf696bd31eb7d2a33b87437ad55156b9e780f9c96ae6ebd83f37bc"} Jun 03 17:52:52.487098 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.487059 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kbqv8" podStartSLOduration=2.013116469 podStartE2EDuration="4.487047553s" podCreationTimestamp="2026-06-03 17:52:48 +0000 UTC" firstStartedPulling="2026-06-03 17:52:49.007709817 +0000 UTC m=+263.877008393" lastFinishedPulling="2026-06-03 17:52:51.481640898 +0000 UTC m=+266.350939477" observedRunningTime="2026-06-03 17:52:52.486212707 +0000 UTC m=+267.355511304" watchObservedRunningTime="2026-06-03 17:52:52.487047553 +0000 UTC m=+267.356346146" Jun 03 17:52:52.574592 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574561 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-sb69f"] Jun 03 17:52:52.574805 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="util" Jun 03 17:52:52.574847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574807 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="util" Jun 03 17:52:52.574847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574815 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="pull" Jun 03 17:52:52.574847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574820 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="pull" Jun 03 17:52:52.574847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574828 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="extract" Jun 03 17:52:52.574847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574833 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="extract" Jun 03 17:52:52.574994 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.574882 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="893f8f07-77cd-4d6b-ba91-b084ee976669" containerName="extract" Jun 03 17:52:52.578698 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.578681 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.581102 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.581081 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c8gws\"" Jun 03 17:52:52.589135 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.589114 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-sb69f"] Jun 03 17:52:52.693716 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.693682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.694121 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.693735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z897j\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-kube-api-access-z897j\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.794742 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.794648 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z897j\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-kube-api-access-z897j\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.794742 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.794715 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.802821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.802797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.802905 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.802834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z897j\" (UniqueName: \"kubernetes.io/projected/12fb44ae-7b59-42c8-8b99-b14b7e57543f-kube-api-access-z897j\") pod \"cert-manager-webhook-587ccfb98-sb69f\" (UID: \"12fb44ae-7b59-42c8-8b99-b14b7e57543f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:52.887298 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:52.887266 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:53.014006 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:53.009876 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-sb69f"] Jun 03 17:52:53.475227 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:53.475183 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" event={"ID":"12fb44ae-7b59-42c8-8b99-b14b7e57543f","Type":"ContainerStarted","Data":"ab4263be20c9c238784a4adbe31c3ab294164cd09952b6577f140d94889556a5"} Jun 03 17:52:53.475418 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:53.475233 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" event={"ID":"12fb44ae-7b59-42c8-8b99-b14b7e57543f","Type":"ContainerStarted","Data":"e1dcb6b778464056ade2b75a0456e7880e777a4a6e7c7c68830b25c038c781c3"} Jun 03 17:52:53.494251 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:53.494202 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" podStartSLOduration=1.494190269 podStartE2EDuration="1.494190269s" podCreationTimestamp="2026-06-03 17:52:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:52:53.493228226 +0000 UTC m=+268.362526825" watchObservedRunningTime="2026-06-03 17:52:53.494190269 +0000 UTC m=+268.363488862" Jun 03 17:52:54.477522 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:54.477477 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:52:55.925243 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.925204 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd"] Jun 03 17:52:55.928705 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.928683 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:55.931036 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.931011 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:52:55.931729 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.931714 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fq6g5\"" Jun 03 17:52:55.931778 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.931749 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 17:52:55.935943 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:55.935921 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd"] Jun 03 17:52:56.117854 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.117825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-tmp\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.118007 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.117881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqqr\" (UniqueName: \"kubernetes.io/projected/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-kube-api-access-8lqqr\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.218929 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.218903 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-tmp\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.219048 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.218982 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqqr\" (UniqueName: \"kubernetes.io/projected/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-kube-api-access-8lqqr\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.219293 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.219276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-tmp\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.228620 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.228591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqqr\" (UniqueName: \"kubernetes.io/projected/fc4ccb50-6cf5-42cc-9a78-6afee026a4ac-kube-api-access-8lqqr\") pod \"openshift-lws-operator-bfc7f696d-8nndd\" (UID: \"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.238379 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.238358 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" Jun 03 17:52:56.359709 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.359680 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd"] Jun 03 17:52:56.361867 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:52:56.361835 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc4ccb50_6cf5_42cc_9a78_6afee026a4ac.slice/crio-b530b3922f3d7e8fc6a2c625dd93bc9a179350a282851dd5dbf6d317b97b900e WatchSource:0}: Error finding container b530b3922f3d7e8fc6a2c625dd93bc9a179350a282851dd5dbf6d317b97b900e: Status 404 returned error can't find the container with id b530b3922f3d7e8fc6a2c625dd93bc9a179350a282851dd5dbf6d317b97b900e Jun 03 17:52:56.484046 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:52:56.483962 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" event={"ID":"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac","Type":"ContainerStarted","Data":"b530b3922f3d7e8fc6a2c625dd93bc9a179350a282851dd5dbf6d317b97b900e"} Jun 03 17:53:00.483056 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:00.483004 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-sb69f" Jun 03 17:53:01.501086 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:01.501050 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" event={"ID":"fc4ccb50-6cf5-42cc-9a78-6afee026a4ac","Type":"ContainerStarted","Data":"52a484c961c5f122722704c2b5e231bf20061554c6fa58ace48552ee8866a2d8"} Jun 03 17:53:03.760614 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.760553 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8nndd" podStartSLOduration=4.259729472 podStartE2EDuration="8.760531925s" podCreationTimestamp="2026-06-03 17:52:55 +0000 UTC" firstStartedPulling="2026-06-03 17:52:56.36344006 +0000 UTC m=+271.232738633" lastFinishedPulling="2026-06-03 17:53:00.864242514 +0000 UTC m=+275.733541086" observedRunningTime="2026-06-03 17:53:01.517361404 +0000 UTC m=+276.386660000" watchObservedRunningTime="2026-06-03 17:53:03.760531925 +0000 UTC m=+278.629830520" Jun 03 17:53:03.764858 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.762461 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt"] Jun 03 17:53:03.767300 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.767271 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.769797 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.769779 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:53:03.769797 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.769786 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:53:03.769951 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.769792 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:53:03.772628 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.772604 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt"] Jun 03 17:53:03.773957 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.773936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.774065 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.773976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n7qs\" (UniqueName: \"kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.774065 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.774004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.875167 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.875124 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.875336 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.875196 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n7qs\" (UniqueName: \"kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.875336 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.875221 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.875544 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.875500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.875544 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.875536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:03.883229 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:03.883204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n7qs\" (UniqueName: \"kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:04.076487 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:04.076402 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:04.198809 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:04.198786 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt"] Jun 03 17:53:04.201388 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:04.201353 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105e8e7d_8db0_4755_b5a6_70bc2893e534.slice/crio-1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597 WatchSource:0}: Error finding container 1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597: Status 404 returned error can't find the container with id 1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597 Jun 03 17:53:04.511604 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:04.511570 2581 generic.go:358] "Generic (PLEG): container finished" podID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerID="889b060a5dbe69656b24e7b1200a5532cb6164e9fc2621b2ed430d4ce80c8265" exitCode=0 Jun 03 17:53:04.511776 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:04.511643 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" event={"ID":"105e8e7d-8db0-4755-b5a6-70bc2893e534","Type":"ContainerDied","Data":"889b060a5dbe69656b24e7b1200a5532cb6164e9fc2621b2ed430d4ce80c8265"} Jun 03 17:53:04.511776 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:04.511665 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" event={"ID":"105e8e7d-8db0-4755-b5a6-70bc2893e534","Type":"ContainerStarted","Data":"1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597"} Jun 03 17:53:05.516743 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.516712 2581 generic.go:358] "Generic (PLEG): container finished" podID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerID="cff6e107533ad7956b1a33715e2f29c136683e70bbd0e1f80528df7fc01c09d2" exitCode=0 Jun 03 17:53:05.517113 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.516800 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" event={"ID":"105e8e7d-8db0-4755-b5a6-70bc2893e534","Type":"ContainerDied","Data":"cff6e107533ad7956b1a33715e2f29c136683e70bbd0e1f80528df7fc01c09d2"} Jun 03 17:53:05.718160 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.718125 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tl8rt"] Jun 03 17:53:05.721055 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.721039 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.723169 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.723149 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f9dkz\"" Jun 03 17:53:05.728694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.728657 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tl8rt"] Jun 03 17:53:05.789494 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.789406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wls4z\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-kube-api-access-wls4z\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.789494 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.789460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-bound-sa-token\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.890329 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.890296 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wls4z\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-kube-api-access-wls4z\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.890438 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.890360 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-bound-sa-token\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.898452 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.898428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-bound-sa-token\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:05.898452 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:05.898444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wls4z\" (UniqueName: \"kubernetes.io/projected/11bdf4be-7394-4d0e-8fc3-2ecc2f33f042-kube-api-access-wls4z\") pod \"cert-manager-79c8d999ff-tl8rt\" (UID: \"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042\") " pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:06.029665 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.029636 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-tl8rt" Jun 03 17:53:06.153527 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.153395 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-tl8rt"] Jun 03 17:53:06.156028 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:06.155994 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11bdf4be_7394_4d0e_8fc3_2ecc2f33f042.slice/crio-1e81cfca9c5f1fb13ed6b39f83dc796c5408de0c0252da36292c757fa4967207 WatchSource:0}: Error finding container 1e81cfca9c5f1fb13ed6b39f83dc796c5408de0c0252da36292c757fa4967207: Status 404 returned error can't find the container with id 1e81cfca9c5f1fb13ed6b39f83dc796c5408de0c0252da36292c757fa4967207 Jun 03 17:53:06.521592 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.521549 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-tl8rt" event={"ID":"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042","Type":"ContainerStarted","Data":"be59abe36ac36c56fe516095893f789364a72eb2bd31ad228134c1a80dcc338d"} Jun 03 17:53:06.521592 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.521595 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-tl8rt" event={"ID":"11bdf4be-7394-4d0e-8fc3-2ecc2f33f042","Type":"ContainerStarted","Data":"1e81cfca9c5f1fb13ed6b39f83dc796c5408de0c0252da36292c757fa4967207"} Jun 03 17:53:06.523303 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.523279 2581 generic.go:358] "Generic (PLEG): container finished" podID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerID="86d8d6c1853b6c6ad9063fb85da7f5200fb1650b909304b45c424305b5715b41" exitCode=0 Jun 03 17:53:06.523396 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.523338 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" event={"ID":"105e8e7d-8db0-4755-b5a6-70bc2893e534","Type":"ContainerDied","Data":"86d8d6c1853b6c6ad9063fb85da7f5200fb1650b909304b45c424305b5715b41"} Jun 03 17:53:06.536574 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:06.536525 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-tl8rt" podStartSLOduration=1.536495742 podStartE2EDuration="1.536495742s" podCreationTimestamp="2026-06-03 17:53:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:53:06.535551423 +0000 UTC m=+281.404850016" watchObservedRunningTime="2026-06-03 17:53:06.536495742 +0000 UTC m=+281.405794335" Jun 03 17:53:07.646024 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.646000 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:07.703631 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.703596 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n7qs\" (UniqueName: \"kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs\") pod \"105e8e7d-8db0-4755-b5a6-70bc2893e534\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " Jun 03 17:53:07.703793 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.703651 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util\") pod \"105e8e7d-8db0-4755-b5a6-70bc2893e534\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " Jun 03 17:53:07.703793 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.703703 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle\") pod \"105e8e7d-8db0-4755-b5a6-70bc2893e534\" (UID: \"105e8e7d-8db0-4755-b5a6-70bc2893e534\") " Jun 03 17:53:07.704674 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.704644 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle" (OuterVolumeSpecName: "bundle") pod "105e8e7d-8db0-4755-b5a6-70bc2893e534" (UID: "105e8e7d-8db0-4755-b5a6-70bc2893e534"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:07.705927 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.705900 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs" (OuterVolumeSpecName: "kube-api-access-6n7qs") pod "105e8e7d-8db0-4755-b5a6-70bc2893e534" (UID: "105e8e7d-8db0-4755-b5a6-70bc2893e534"). InnerVolumeSpecName "kube-api-access-6n7qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:53:07.709338 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.709312 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util" (OuterVolumeSpecName: "util") pod "105e8e7d-8db0-4755-b5a6-70bc2893e534" (UID: "105e8e7d-8db0-4755-b5a6-70bc2893e534"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:07.805088 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.804995 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n7qs\" (UniqueName: \"kubernetes.io/projected/105e8e7d-8db0-4755-b5a6-70bc2893e534-kube-api-access-6n7qs\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:07.805088 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.805032 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:07.805088 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:07.805041 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/105e8e7d-8db0-4755-b5a6-70bc2893e534-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:08.531701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:08.531667 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" event={"ID":"105e8e7d-8db0-4755-b5a6-70bc2893e534","Type":"ContainerDied","Data":"1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597"} Jun 03 17:53:08.531701 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:08.531705 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d1fae27f4d7014e3c0b2604e08e80b2dc83155ae17f627a62a115483f7ea597" Jun 03 17:53:08.531906 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:08.531675 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ftjt" Jun 03 17:53:17.668328 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668296 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt"] Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668570 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="pull" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668581 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="pull" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668593 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="util" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668598 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="util" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668605 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="extract" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668611 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="extract" Jun 03 17:53:17.668734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.668655 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="105e8e7d-8db0-4755-b5a6-70bc2893e534" containerName="extract" Jun 03 17:53:17.670799 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.670774 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.673543 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.673500 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 17:53:17.673789 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.673776 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 17:53:17.674092 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.674077 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 17:53:17.674140 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.674124 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ncxhs\"" Jun 03 17:53:17.674241 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.674225 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 17:53:17.685768 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.685735 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt"] Jun 03 17:53:17.774942 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.774904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5mz\" (UniqueName: \"kubernetes.io/projected/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-kube-api-access-6b5mz\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.774942 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.774946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.775165 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.774971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.775165 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.775022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.775165 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.775052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876220 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876279 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5mz\" (UniqueName: \"kubernetes.io/projected/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-kube-api-access-6b5mz\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876302 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876321 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876371 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.876654 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.876634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.878874 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.878841 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.878983 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.878957 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.879067 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.879052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.885449 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.885427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5mz\" (UniqueName: \"kubernetes.io/projected/c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb-kube-api-access-6b5mz\") pod \"opendatahub-operator-controller-manager-99c86d98-cbbkt\" (UID: \"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:17.980780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:17.980745 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:18.119087 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:18.119045 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt"] Jun 03 17:53:18.124631 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:18.124604 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e892a6_d2e6_440e_b7fe_ca7f72a1ccdb.slice/crio-36aca7788c4b0e44944afa752e30ac9271a6b5a7dc7a86f24e349e1626f5bab1 WatchSource:0}: Error finding container 36aca7788c4b0e44944afa752e30ac9271a6b5a7dc7a86f24e349e1626f5bab1: Status 404 returned error can't find the container with id 36aca7788c4b0e44944afa752e30ac9271a6b5a7dc7a86f24e349e1626f5bab1 Jun 03 17:53:18.563464 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:18.563426 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" event={"ID":"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb","Type":"ContainerStarted","Data":"36aca7788c4b0e44944afa752e30ac9271a6b5a7dc7a86f24e349e1626f5bab1"} Jun 03 17:53:21.575768 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:21.575728 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" event={"ID":"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb","Type":"ContainerStarted","Data":"3a9c7858dab9ddde4243d4d76ca7fb442a87a9c485b9b310d1289259f0db6703"} Jun 03 17:53:22.580786 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:22.580749 2581 generic.go:358] "Generic (PLEG): container finished" podID="c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb" containerID="3a9c7858dab9ddde4243d4d76ca7fb442a87a9c485b9b310d1289259f0db6703" exitCode=0 Jun 03 17:53:22.581211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:22.580789 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" event={"ID":"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb","Type":"ContainerDied","Data":"3a9c7858dab9ddde4243d4d76ca7fb442a87a9c485b9b310d1289259f0db6703"} Jun 03 17:53:23.585879 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:23.585839 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" event={"ID":"c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb","Type":"ContainerStarted","Data":"b0625b4864b676b50eabe1e504d903b57d078654fb9c51eecff51c90a9831ee4"} Jun 03 17:53:23.586259 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:23.585968 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:23.608662 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:23.608613 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" podStartSLOduration=1.838339755 podStartE2EDuration="6.608599222s" podCreationTimestamp="2026-06-03 17:53:17 +0000 UTC" firstStartedPulling="2026-06-03 17:53:18.126501438 +0000 UTC m=+292.995800023" lastFinishedPulling="2026-06-03 17:53:22.896760916 +0000 UTC m=+297.766059490" observedRunningTime="2026-06-03 17:53:23.606454062 +0000 UTC m=+298.475752668" watchObservedRunningTime="2026-06-03 17:53:23.608599222 +0000 UTC m=+298.477897816" Jun 03 17:53:25.552645 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:25.552618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:53:25.553347 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:25.553323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:53:25.553907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:25.553882 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:53:25.554466 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:25.554444 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:53:25.556622 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:25.556608 2581 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 17:53:34.591690 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:34.591657 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cbbkt" Jun 03 17:53:36.970720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.970689 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-854dd8479f-797kl"] Jun 03 17:53:36.973570 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.973552 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:36.976846 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.976810 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 17:53:36.976846 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.976836 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8w2jz\"" Jun 03 17:53:36.977030 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.976904 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 17:53:36.977213 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.977199 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 17:53:36.990266 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:36.990237 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-854dd8479f-797kl"] Jun 03 17:53:37.028678 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.028653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.028816 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.028686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-metrics-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.028816 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.028708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b118e409-27ee-4b92-a73a-fbf60e1d4a11-manager-config\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.028816 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.028782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnxjx\" (UniqueName: \"kubernetes.io/projected/b118e409-27ee-4b92-a73a-fbf60e1d4a11-kube-api-access-nnxjx\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.129976 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.129942 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxjx\" (UniqueName: \"kubernetes.io/projected/b118e409-27ee-4b92-a73a-fbf60e1d4a11-kube-api-access-nnxjx\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.130145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.130035 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.130145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.130063 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-metrics-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.130145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.130092 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b118e409-27ee-4b92-a73a-fbf60e1d4a11-manager-config\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.130741 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.130711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b118e409-27ee-4b92-a73a-fbf60e1d4a11-manager-config\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.132644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.132624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.132821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.132801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b118e409-27ee-4b92-a73a-fbf60e1d4a11-metrics-cert\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.149403 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.149372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnxjx\" (UniqueName: \"kubernetes.io/projected/b118e409-27ee-4b92-a73a-fbf60e1d4a11-kube-api-access-nnxjx\") pod \"lws-controller-manager-854dd8479f-797kl\" (UID: \"b118e409-27ee-4b92-a73a-fbf60e1d4a11\") " pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.285202 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.285110 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:37.424062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.424015 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-854dd8479f-797kl"] Jun 03 17:53:37.426834 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:37.426805 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb118e409_27ee_4b92_a73a_fbf60e1d4a11.slice/crio-ce274b639567b5cfac99c31d21273f3cd8bc5bef6342a964a00148d117dedc33 WatchSource:0}: Error finding container ce274b639567b5cfac99c31d21273f3cd8bc5bef6342a964a00148d117dedc33: Status 404 returned error can't find the container with id ce274b639567b5cfac99c31d21273f3cd8bc5bef6342a964a00148d117dedc33 Jun 03 17:53:37.428634 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.428599 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:53:37.630852 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:37.630769 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" event={"ID":"b118e409-27ee-4b92-a73a-fbf60e1d4a11","Type":"ContainerStarted","Data":"ce274b639567b5cfac99c31d21273f3cd8bc5bef6342a964a00148d117dedc33"} Jun 03 17:53:39.324218 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.324139 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r"] Jun 03 17:53:39.326457 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.326428 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.328967 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.328946 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:53:39.329066 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.328992 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:53:39.330126 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.330100 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:53:39.336259 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.336237 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r"] Jun 03 17:53:39.451202 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.451172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.451329 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.451274 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.451329 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.451300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc9wj\" (UniqueName: \"kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.551818 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.551779 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.551818 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.551819 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc9wj\" (UniqueName: \"kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.552026 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.551859 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.552174 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.552155 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.552209 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.552189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.560799 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.560768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc9wj\" (UniqueName: \"kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.635450 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.635361 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:39.638999 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.638958 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" event={"ID":"b118e409-27ee-4b92-a73a-fbf60e1d4a11","Type":"ContainerStarted","Data":"2ef07a6b6ad33f72b352f89e16489954dafdff13e3071a20f07eac12ba2bd5bd"} Jun 03 17:53:39.639137 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.639086 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:39.656633 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.656588 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" podStartSLOduration=2.094091372 podStartE2EDuration="3.656575299s" podCreationTimestamp="2026-06-03 17:53:36 +0000 UTC" firstStartedPulling="2026-06-03 17:53:37.428742975 +0000 UTC m=+312.298041547" lastFinishedPulling="2026-06-03 17:53:38.991226895 +0000 UTC m=+313.860525474" observedRunningTime="2026-06-03 17:53:39.654116426 +0000 UTC m=+314.523415022" watchObservedRunningTime="2026-06-03 17:53:39.656575299 +0000 UTC m=+314.525873893" Jun 03 17:53:39.769162 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:39.769130 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r"] Jun 03 17:53:39.772060 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:39.772033 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4d7ef1_2d96_4dd7_aeda_1e6824a10fe2.slice/crio-f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656 WatchSource:0}: Error finding container f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656: Status 404 returned error can't find the container with id f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656 Jun 03 17:53:40.643350 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:40.643315 2581 generic.go:358] "Generic (PLEG): container finished" podID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerID="e03f34c77f80973785df57ae1b89baf8b6a7334c1a53b88fcac1dbb3358815b4" exitCode=0 Jun 03 17:53:40.643780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:40.643403 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" event={"ID":"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2","Type":"ContainerDied","Data":"e03f34c77f80973785df57ae1b89baf8b6a7334c1a53b88fcac1dbb3358815b4"} Jun 03 17:53:40.643780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:40.643445 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" event={"ID":"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2","Type":"ContainerStarted","Data":"f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656"} Jun 03 17:53:41.648832 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:41.648742 2581 generic.go:358] "Generic (PLEG): container finished" podID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerID="46f9b3794cb5f28566e4e4a451c53fd34a0b7c56755fef7bde8ada9e619546bc" exitCode=0 Jun 03 17:53:41.649271 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:41.648823 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" event={"ID":"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2","Type":"ContainerDied","Data":"46f9b3794cb5f28566e4e4a451c53fd34a0b7c56755fef7bde8ada9e619546bc"} Jun 03 17:53:42.654199 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:42.654163 2581 generic.go:358] "Generic (PLEG): container finished" podID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerID="799a5f234cdb66c6d059a803bee985977dd8c70bd3c122491052d931d726858d" exitCode=0 Jun 03 17:53:42.654585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:42.654247 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" event={"ID":"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2","Type":"ContainerDied","Data":"799a5f234cdb66c6d059a803bee985977dd8c70bd3c122491052d931d726858d"} Jun 03 17:53:43.789115 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.784422 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:43.889019 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.888984 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc9wj\" (UniqueName: \"kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj\") pod \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " Jun 03 17:53:43.889019 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.889023 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle\") pod \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " Jun 03 17:53:43.889264 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.889089 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util\") pod \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\" (UID: \"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2\") " Jun 03 17:53:43.889969 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.889930 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle" (OuterVolumeSpecName: "bundle") pod "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" (UID: "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:43.891331 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.891294 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj" (OuterVolumeSpecName: "kube-api-access-cc9wj") pod "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" (UID: "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2"). InnerVolumeSpecName "kube-api-access-cc9wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:53:43.897488 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.897445 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util" (OuterVolumeSpecName: "util") pod "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" (UID: "1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:43.990509 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.990479 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:43.990652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.990530 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc9wj\" (UniqueName: \"kubernetes.io/projected/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-kube-api-access-cc9wj\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:43.990652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:43.990542 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:44.663406 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:44.663370 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" event={"ID":"1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2","Type":"ContainerDied","Data":"f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656"} Jun 03 17:53:44.663406 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:44.663401 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0bae4408641b369c6eed0b9cefaca5ebbd8ab40ca12d9690806e61fd0593656" Jun 03 17:53:44.663697 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:44.663431 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dgw2r" Jun 03 17:53:47.495973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.495935 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd"] Jun 03 17:53:47.496357 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496339 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="util" Jun 03 17:53:47.496405 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496362 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="util" Jun 03 17:53:47.496405 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496377 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="pull" Jun 03 17:53:47.496405 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496385 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="pull" Jun 03 17:53:47.496405 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496401 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="extract" Jun 03 17:53:47.496558 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496410 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="extract" Jun 03 17:53:47.496558 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.496477 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c4d7ef1-2d96-4dd7-aeda-1e6824a10fe2" containerName="extract" Jun 03 17:53:47.499174 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.499153 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.502097 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.502075 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 17:53:47.502097 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.502085 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b6fpb\"" Jun 03 17:53:47.515775 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.515750 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd"] Jun 03 17:53:47.619628 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.619587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0258bed9-b393-4aab-9739-ad907b61c815-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.619917 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.619895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5z8\" (UniqueName: \"kubernetes.io/projected/0258bed9-b393-4aab-9739-ad907b61c815-kube-api-access-dd5z8\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.721150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.721122 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5z8\" (UniqueName: \"kubernetes.io/projected/0258bed9-b393-4aab-9739-ad907b61c815-kube-api-access-dd5z8\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.721297 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.721180 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0258bed9-b393-4aab-9739-ad907b61c815-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.723670 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.723653 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0258bed9-b393-4aab-9739-ad907b61c815-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.749012 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.748943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5z8\" (UniqueName: \"kubernetes.io/projected/0258bed9-b393-4aab-9739-ad907b61c815-kube-api-access-dd5z8\") pod \"llmisvc-controller-manager-c6b9847d7-wjhjd\" (UID: \"0258bed9-b393-4aab-9739-ad907b61c815\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.808908 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.808875 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:47.940028 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:47.940003 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd"] Jun 03 17:53:47.941376 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:47.941349 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0258bed9_b393_4aab_9739_ad907b61c815.slice/crio-b974eecfb687a8c2e86410279284199dbe890f1a0aceacb70f866993715b3a78 WatchSource:0}: Error finding container b974eecfb687a8c2e86410279284199dbe890f1a0aceacb70f866993715b3a78: Status 404 returned error can't find the container with id b974eecfb687a8c2e86410279284199dbe890f1a0aceacb70f866993715b3a78 Jun 03 17:53:48.681587 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:48.681552 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" event={"ID":"0258bed9-b393-4aab-9739-ad907b61c815","Type":"ContainerStarted","Data":"b974eecfb687a8c2e86410279284199dbe890f1a0aceacb70f866993715b3a78"} Jun 03 17:53:50.645525 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:50.645480 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-854dd8479f-797kl" Jun 03 17:53:52.711361 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:52.711329 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" event={"ID":"0258bed9-b393-4aab-9739-ad907b61c815","Type":"ContainerStarted","Data":"e4df92d7edd5d01bcee08c1798aeb1ce18b206de67519eacc6c68d276d57dd48"} Jun 03 17:53:52.711779 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:52.711472 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:53:52.851918 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:52.851862 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" podStartSLOduration=2.046881776 podStartE2EDuration="5.851846698s" podCreationTimestamp="2026-06-03 17:53:47 +0000 UTC" firstStartedPulling="2026-06-03 17:53:47.942685596 +0000 UTC m=+322.811984168" lastFinishedPulling="2026-06-03 17:53:51.747650514 +0000 UTC m=+326.616949090" observedRunningTime="2026-06-03 17:53:52.84146747 +0000 UTC m=+327.710766065" watchObservedRunningTime="2026-06-03 17:53:52.851846698 +0000 UTC m=+327.721145293" Jun 03 17:53:54.339645 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.339611 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb"] Jun 03 17:53:54.343437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.343415 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.345757 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.345728 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:53:54.345882 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.345852 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:53:54.347419 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.347401 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:53:54.357490 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.357466 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb"] Jun 03 17:53:54.483301 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.483267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.483494 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.483320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.483494 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.483398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4vb\" (UniqueName: \"kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.584182 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.584147 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.584360 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.584190 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.584360 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.584321 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4vb\" (UniqueName: \"kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.584574 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.584558 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.584632 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.584576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.593187 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.593126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4vb\" (UniqueName: \"kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.652130 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.652096 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:54.782652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:54.782629 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb"] Jun 03 17:53:54.785039 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:53:54.785012 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ee6a7f_02d7_4c7b_872f_3eceb388d3d2.slice/crio-57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b WatchSource:0}: Error finding container 57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b: Status 404 returned error can't find the container with id 57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b Jun 03 17:53:55.726899 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:55.726862 2581 generic.go:358] "Generic (PLEG): container finished" podID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerID="03e03dda95123e38fba9753d4109fe017e71a60934076b58469d8f124b6a9530" exitCode=0 Jun 03 17:53:55.727320 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:55.726954 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" event={"ID":"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2","Type":"ContainerDied","Data":"03e03dda95123e38fba9753d4109fe017e71a60934076b58469d8f124b6a9530"} Jun 03 17:53:55.727320 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:55.726993 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" event={"ID":"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2","Type":"ContainerStarted","Data":"57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b"} Jun 03 17:53:56.731725 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:56.731688 2581 generic.go:358] "Generic (PLEG): container finished" podID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerID="0517a7cace1013b3ca545b6ec6c469ddc06e0961953ba179e352e4a7ddab1977" exitCode=0 Jun 03 17:53:56.732207 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:56.731756 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" event={"ID":"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2","Type":"ContainerDied","Data":"0517a7cace1013b3ca545b6ec6c469ddc06e0961953ba179e352e4a7ddab1977"} Jun 03 17:53:57.743128 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:57.743089 2581 generic.go:358] "Generic (PLEG): container finished" podID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerID="a6ab6bd1f5998f41d9ec8bcdb222a3242619d665981a6cfd7751c9c1f20f8051" exitCode=0 Jun 03 17:53:57.743556 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:57.743135 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" event={"ID":"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2","Type":"ContainerDied","Data":"a6ab6bd1f5998f41d9ec8bcdb222a3242619d665981a6cfd7751c9c1f20f8051"} Jun 03 17:53:58.861747 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:58.861724 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:59.021342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.021252 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util\") pod \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " Jun 03 17:53:59.021342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.021290 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle\") pod \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " Jun 03 17:53:59.021342 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.021316 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm4vb\" (UniqueName: \"kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb\") pod \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\" (UID: \"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2\") " Jun 03 17:53:59.022129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.022095 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle" (OuterVolumeSpecName: "bundle") pod "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" (UID: "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:59.023652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.023628 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb" (OuterVolumeSpecName: "kube-api-access-xm4vb") pod "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" (UID: "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2"). InnerVolumeSpecName "kube-api-access-xm4vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:53:59.027770 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.027748 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util" (OuterVolumeSpecName: "util") pod "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" (UID: "c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:53:59.122344 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.122307 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:59.122344 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.122341 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:59.122344 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.122351 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm4vb\" (UniqueName: \"kubernetes.io/projected/c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2-kube-api-access-xm4vb\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:53:59.751842 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.751804 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" event={"ID":"c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2","Type":"ContainerDied","Data":"57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b"} Jun 03 17:53:59.751842 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.751835 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aflfxb" Jun 03 17:53:59.751842 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:53:59.751844 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57f05f592d74a5b28702233c4439424bc6dc4bf85507425cbf509cf57997093b" Jun 03 17:54:07.692457 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692417 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-bsfnw"] Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692839 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="pull" Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692858 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="pull" Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692877 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="util" Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692885 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="util" Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692917 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="extract" Jun 03 17:54:07.692941 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692926 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="extract" Jun 03 17:54:07.693287 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.692999 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ee6a7f-02d7-4c7b-872f-3eceb388d3d2" containerName="extract" Jun 03 17:54:07.695973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.695948 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.698214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.698192 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 17:54:07.698357 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.698232 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jqhph\"" Jun 03 17:54:07.701953 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.701928 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-bsfnw"] Jun 03 17:54:07.789068 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.789037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cf09870b-f39d-4031-b941-91dec7933732-redirect-config\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.789239 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.789085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dg9h\" (UniqueName: \"kubernetes.io/projected/cf09870b-f39d-4031-b941-91dec7933732-kube-api-access-4dg9h\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.890236 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.890204 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cf09870b-f39d-4031-b941-91dec7933732-redirect-config\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.890404 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.890242 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dg9h\" (UniqueName: \"kubernetes.io/projected/cf09870b-f39d-4031-b941-91dec7933732-kube-api-access-4dg9h\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.890985 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.890966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cf09870b-f39d-4031-b941-91dec7933732-redirect-config\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:07.898248 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:07.898222 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dg9h\" (UniqueName: \"kubernetes.io/projected/cf09870b-f39d-4031-b941-91dec7933732-kube-api-access-4dg9h\") pod \"dashboard-redirect-74c696fb4c-bsfnw\" (UID: \"cf09870b-f39d-4031-b941-91dec7933732\") " pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:08.008392 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:08.008360 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" Jun 03 17:54:08.134085 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:08.134060 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-bsfnw"] Jun 03 17:54:08.135989 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:08.135959 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf09870b_f39d_4031_b941_91dec7933732.slice/crio-042ed2ecbded227813b305970ab4e21702591cd07e617a8585ab92a2c6f837c7 WatchSource:0}: Error finding container 042ed2ecbded227813b305970ab4e21702591cd07e617a8585ab92a2c6f837c7: Status 404 returned error can't find the container with id 042ed2ecbded227813b305970ab4e21702591cd07e617a8585ab92a2c6f837c7 Jun 03 17:54:08.782925 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:08.782886 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" event={"ID":"cf09870b-f39d-4031-b941-91dec7933732","Type":"ContainerStarted","Data":"042ed2ecbded227813b305970ab4e21702591cd07e617a8585ab92a2c6f837c7"} Jun 03 17:54:15.809755 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:15.809724 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" event={"ID":"cf09870b-f39d-4031-b941-91dec7933732","Type":"ContainerStarted","Data":"bb4b394a97ea6682ee64e7288e604b67cb4227983d5959c15eb4de25a74e3918"} Jun 03 17:54:15.824889 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:15.824836 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-74c696fb4c-bsfnw" podStartSLOduration=1.274079168 podStartE2EDuration="8.824810532s" podCreationTimestamp="2026-06-03 17:54:07 +0000 UTC" firstStartedPulling="2026-06-03 17:54:08.13733292 +0000 UTC m=+343.006631492" lastFinishedPulling="2026-06-03 17:54:15.688064282 +0000 UTC m=+350.557362856" observedRunningTime="2026-06-03 17:54:15.823178272 +0000 UTC m=+350.692476877" watchObservedRunningTime="2026-06-03 17:54:15.824810532 +0000 UTC m=+350.694109126" Jun 03 17:54:23.717028 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:23.717000 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wjhjd" Jun 03 17:54:29.147378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.147341 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:29.154746 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.154723 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.157204 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.157177 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 17:54:29.157346 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.157200 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 17:54:29.157346 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.157177 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2wbtn\"" Jun 03 17:54:29.157499 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.157485 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 17:54:29.164109 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.163459 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:29.248715 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248715 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.248909 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.248898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkcz\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349732 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349699 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349732 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349735 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349758 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349785 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349815 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349841 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349870 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.349945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349936 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350243 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.349962 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkcz\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350243 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.350209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350353 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.350299 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350353 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.350310 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350445 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.350398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.350567 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.350550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.352268 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.352241 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.352670 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.352650 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.358443 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.358416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.358856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.358832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkcz\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44l479f\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.431249 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.431171 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q"] Jun 03 17:54:29.435817 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.435801 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.448757 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.448725 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q"] Jun 03 17:54:29.471040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.470995 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:29.551988 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.551925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6be9e5c4-451c-4607-9729-452026a9d830-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94nsp\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-kube-api-access-94nsp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6be9e5c4-451c-4607-9729-452026a9d830-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.552478 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.552296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.603836 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.603811 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:29.605692 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:29.605664 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531633f1_cf17_4d89_97ff_8ed1d30f8fc2.slice/crio-c41941598757c0baabec7d9724b134558a789451f6e59dcfee397587c183f3fa WatchSource:0}: Error finding container c41941598757c0baabec7d9724b134558a789451f6e59dcfee397587c183f3fa: Status 404 returned error can't find the container with id c41941598757c0baabec7d9724b134558a789451f6e59dcfee397587c183f3fa Jun 03 17:54:29.653689 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653654 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.653797 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653720 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.653870 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653794 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.653870 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653823 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6be9e5c4-451c-4607-9729-452026a9d830-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.653870 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653851 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94nsp\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-kube-api-access-94nsp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654031 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653933 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654031 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.653969 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654133 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654040 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6be9e5c4-451c-4607-9729-452026a9d830-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654133 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654073 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654232 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654232 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654484 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654679 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654659 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.654738 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.654701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6be9e5c4-451c-4607-9729-452026a9d830-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.656008 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.655984 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6be9e5c4-451c-4607-9729-452026a9d830-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.656611 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.656592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6be9e5c4-451c-4607-9729-452026a9d830-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.662281 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.662259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94nsp\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-kube-api-access-94nsp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.662397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.662384 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6be9e5c4-451c-4607-9729-452026a9d830-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q\" (UID: \"6be9e5c4-451c-4607-9729-452026a9d830\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.745738 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.745708 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:29.859847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.859814 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" event={"ID":"531633f1-cf17-4d89-97ff-8ed1d30f8fc2","Type":"ContainerStarted","Data":"c41941598757c0baabec7d9724b134558a789451f6e59dcfee397587c183f3fa"} Jun 03 17:54:29.873311 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:29.873283 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q"] Jun 03 17:54:29.875722 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:29.875696 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be9e5c4_451c_4607_9729_452026a9d830.slice/crio-6eed7594d077db2b1416786016ae075d9c199ae60a9af7cbbff447da0913b1f7 WatchSource:0}: Error finding container 6eed7594d077db2b1416786016ae075d9c199ae60a9af7cbbff447da0913b1f7: Status 404 returned error can't find the container with id 6eed7594d077db2b1416786016ae075d9c199ae60a9af7cbbff447da0913b1f7 Jun 03 17:54:30.865491 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:30.865449 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" event={"ID":"6be9e5c4-451c-4607-9729-452026a9d830","Type":"ContainerStarted","Data":"6eed7594d077db2b1416786016ae075d9c199ae60a9af7cbbff447da0913b1f7"} Jun 03 17:54:32.721930 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.721886 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.722368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.721999 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.722368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.722041 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.728734 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.728705 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.728799 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.728770 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.728831 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.728798 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 17:54:32.875575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.875537 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" event={"ID":"531633f1-cf17-4d89-97ff-8ed1d30f8fc2","Type":"ContainerStarted","Data":"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89"} Jun 03 17:54:32.877578 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.877549 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" event={"ID":"6be9e5c4-451c-4607-9729-452026a9d830","Type":"ContainerStarted","Data":"da37ad6b9698ff93eb0f012079997c5634a952924465b179a22efd6803c38ed8"} Jun 03 17:54:32.894693 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.894634 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" podStartSLOduration=0.773960319 podStartE2EDuration="3.894617572s" podCreationTimestamp="2026-06-03 17:54:29 +0000 UTC" firstStartedPulling="2026-06-03 17:54:29.607758134 +0000 UTC m=+364.477056705" lastFinishedPulling="2026-06-03 17:54:32.728415374 +0000 UTC m=+367.597713958" observedRunningTime="2026-06-03 17:54:32.893346026 +0000 UTC m=+367.762644619" watchObservedRunningTime="2026-06-03 17:54:32.894617572 +0000 UTC m=+367.763916169" Jun 03 17:54:32.914980 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:32.914927 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" podStartSLOduration=1.070771692 podStartE2EDuration="3.914912756s" podCreationTimestamp="2026-06-03 17:54:29 +0000 UTC" firstStartedPulling="2026-06-03 17:54:29.877494724 +0000 UTC m=+364.746793300" lastFinishedPulling="2026-06-03 17:54:32.721635792 +0000 UTC m=+367.590934364" observedRunningTime="2026-06-03 17:54:32.913281648 +0000 UTC m=+367.782580243" watchObservedRunningTime="2026-06-03 17:54:32.914912756 +0000 UTC m=+367.784211349" Jun 03 17:54:33.471200 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.471161 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:33.472424 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.472394 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44l479f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 03 17:54:33.472574 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.472452 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 03 17:54:33.746113 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.746022 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:33.750543 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.750498 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:33.881033 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.881005 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:33.881903 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.881881 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q" Jun 03 17:54:33.931456 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:33.931424 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:34.471621 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:34.471584 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44l479f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 03 17:54:34.471769 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:34.471641 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 03 17:54:35.471585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:35.471539 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44l479f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 03 17:54:35.472007 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:35.471604 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 03 17:54:35.887291 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:35.887192 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" containerID="cri-o://0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89" gracePeriod=30 Jun 03 17:54:38.501740 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.501703 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:38.504935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.504919 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:38.507651 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.507631 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 17:54:38.508388 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.508365 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 17:54:38.508388 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.508372 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4d2b4\"" Jun 03 17:54:38.512456 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.512433 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:38.640056 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.640018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7q2z\" (UniqueName: \"kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z\") pod \"kuadrant-operator-catalog-psdcw\" (UID: \"573f5d00-c071-44a9-9672-1820a3b078a1\") " pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:38.740865 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.740834 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7q2z\" (UniqueName: \"kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z\") pod \"kuadrant-operator-catalog-psdcw\" (UID: \"573f5d00-c071-44a9-9672-1820a3b078a1\") " pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:38.754458 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.754394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7q2z\" (UniqueName: \"kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z\") pod \"kuadrant-operator-catalog-psdcw\" (UID: \"573f5d00-c071-44a9-9672-1820a3b078a1\") " pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:38.816135 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.816106 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:38.870359 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.870320 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:38.947033 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:38.947005 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:38.948771 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:38.948746 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573f5d00_c071_44a9_9672_1820a3b078a1.slice/crio-b8cb899c028112d562bee0e720d2d1e7e85033061f6faf4b77f1eac3d27e0e35 WatchSource:0}: Error finding container b8cb899c028112d562bee0e720d2d1e7e85033061f6faf4b77f1eac3d27e0e35: Status 404 returned error can't find the container with id b8cb899c028112d562bee0e720d2d1e7e85033061f6faf4b77f1eac3d27e0e35 Jun 03 17:54:39.080827 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.080751 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmskg"] Jun 03 17:54:39.085129 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.085112 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:39.091238 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.091215 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmskg"] Jun 03 17:54:39.144558 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.144492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwc7\" (UniqueName: \"kubernetes.io/projected/eededdf4-3a56-43af-9d37-2bb1f99201a7-kube-api-access-dlwc7\") pod \"kuadrant-operator-catalog-tmskg\" (UID: \"eededdf4-3a56-43af-9d37-2bb1f99201a7\") " pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:39.244955 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.244919 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwc7\" (UniqueName: \"kubernetes.io/projected/eededdf4-3a56-43af-9d37-2bb1f99201a7-kube-api-access-dlwc7\") pod \"kuadrant-operator-catalog-tmskg\" (UID: \"eededdf4-3a56-43af-9d37-2bb1f99201a7\") " pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:39.254382 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.254351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwc7\" (UniqueName: \"kubernetes.io/projected/eededdf4-3a56-43af-9d37-2bb1f99201a7-kube-api-access-dlwc7\") pod \"kuadrant-operator-catalog-tmskg\" (UID: \"eededdf4-3a56-43af-9d37-2bb1f99201a7\") " pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:39.395137 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.395061 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:39.532754 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.530890 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tmskg"] Jun 03 17:54:39.904365 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.904301 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" event={"ID":"573f5d00-c071-44a9-9672-1820a3b078a1","Type":"ContainerStarted","Data":"b8cb899c028112d562bee0e720d2d1e7e85033061f6faf4b77f1eac3d27e0e35"} Jun 03 17:54:39.905637 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:39.905608 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" event={"ID":"eededdf4-3a56-43af-9d37-2bb1f99201a7","Type":"ContainerStarted","Data":"dede368b1fa4e8cec0ec48afc626f381c9bc123652f9b2b8c9a99c3d1826f4f7"} Jun 03 17:54:41.185683 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.185659 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:41.260437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260402 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260438 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260668 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260473 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260668 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260591 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260668 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260629 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260668 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260663 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260684 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260713 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260745 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpkcz\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz\") pod \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\" (UID: \"531633f1-cf17-4d89-97ff-8ed1d30f8fc2\") " Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260750 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data" (OuterVolumeSpecName: "istio-data") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260766 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:41.260877 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260788 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260953 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.260989 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.261060 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-credential-socket\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.261083 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-certs\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.261101 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-workload-socket\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.261125 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.261116 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istiod-ca-cert\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.261375 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.261130 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-data\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.263069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.263022 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 03 17:54:41.263170 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.263101 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:41.263170 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.263107 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token" (OuterVolumeSpecName: "istio-token") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:54:41.263233 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.263208 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz" (OuterVolumeSpecName: "kube-api-access-qpkcz") pod "531633f1-cf17-4d89-97ff-8ed1d30f8fc2" (UID: "531633f1-cf17-4d89-97ff-8ed1d30f8fc2"). InnerVolumeSpecName "kube-api-access-qpkcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:54:41.361731 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.361697 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-podinfo\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.361731 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.361726 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-envoy\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.361731 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.361735 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-istio-token\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.361731 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.361743 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpkcz\" (UniqueName: \"kubernetes.io/projected/531633f1-cf17-4d89-97ff-8ed1d30f8fc2-kube-api-access-qpkcz\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:41.918084 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.918044 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" event={"ID":"573f5d00-c071-44a9-9672-1820a3b078a1","Type":"ContainerStarted","Data":"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e"} Jun 03 17:54:41.918283 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.918116 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" podUID="573f5d00-c071-44a9-9672-1820a3b078a1" containerName="registry-server" containerID="cri-o://e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e" gracePeriod=2 Jun 03 17:54:41.919543 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.919498 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" event={"ID":"eededdf4-3a56-43af-9d37-2bb1f99201a7","Type":"ContainerStarted","Data":"8a73b3d0747c2bf60797b07c1303a8b7b6a60289889ef2e20ca3f143c5955187"} Jun 03 17:54:41.920654 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.920627 2581 generic.go:358] "Generic (PLEG): container finished" podID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerID="0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89" exitCode=0 Jun 03 17:54:41.920770 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.920681 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" Jun 03 17:54:41.920770 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.920686 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" event={"ID":"531633f1-cf17-4d89-97ff-8ed1d30f8fc2","Type":"ContainerDied","Data":"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89"} Jun 03 17:54:41.920770 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.920713 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f" event={"ID":"531633f1-cf17-4d89-97ff-8ed1d30f8fc2","Type":"ContainerDied","Data":"c41941598757c0baabec7d9724b134558a789451f6e59dcfee397587c183f3fa"} Jun 03 17:54:41.920770 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.920732 2581 scope.go:117] "RemoveContainer" containerID="0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89" Jun 03 17:54:41.930180 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.930158 2581 scope.go:117] "RemoveContainer" containerID="0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89" Jun 03 17:54:41.930531 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:54:41.930488 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89\": container with ID starting with 0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89 not found: ID does not exist" containerID="0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89" Jun 03 17:54:41.930614 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.930531 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89"} err="failed to get container status \"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89\": rpc error: code = NotFound desc = could not find container \"0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89\": container with ID starting with 0fc567b9592c37b160c97b31173567c86154156ac74a65602f8471da6184ed89 not found: ID does not exist" Jun 03 17:54:41.934660 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.934556 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" podStartSLOduration=1.913533452 podStartE2EDuration="3.934543299s" podCreationTimestamp="2026-06-03 17:54:38 +0000 UTC" firstStartedPulling="2026-06-03 17:54:38.950085981 +0000 UTC m=+373.819384552" lastFinishedPulling="2026-06-03 17:54:40.971095827 +0000 UTC m=+375.840394399" observedRunningTime="2026-06-03 17:54:41.933846924 +0000 UTC m=+376.803145518" watchObservedRunningTime="2026-06-03 17:54:41.934543299 +0000 UTC m=+376.803841892" Jun 03 17:54:41.950736 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.950694 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" podStartSLOduration=1.512909682 podStartE2EDuration="2.950682073s" podCreationTimestamp="2026-06-03 17:54:39 +0000 UTC" firstStartedPulling="2026-06-03 17:54:39.53402945 +0000 UTC m=+374.403328024" lastFinishedPulling="2026-06-03 17:54:40.971801843 +0000 UTC m=+375.841100415" observedRunningTime="2026-06-03 17:54:41.950008967 +0000 UTC m=+376.819307562" watchObservedRunningTime="2026-06-03 17:54:41.950682073 +0000 UTC m=+376.819980710" Jun 03 17:54:41.965058 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.965033 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:41.970469 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:41.970445 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44l479f"] Jun 03 17:54:42.154971 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.154952 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:42.270428 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.270384 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7q2z\" (UniqueName: \"kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z\") pod \"573f5d00-c071-44a9-9672-1820a3b078a1\" (UID: \"573f5d00-c071-44a9-9672-1820a3b078a1\") " Jun 03 17:54:42.272759 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.272735 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z" (OuterVolumeSpecName: "kube-api-access-t7q2z") pod "573f5d00-c071-44a9-9672-1820a3b078a1" (UID: "573f5d00-c071-44a9-9672-1820a3b078a1"). InnerVolumeSpecName "kube-api-access-t7q2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:54:42.371772 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.371727 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7q2z\" (UniqueName: \"kubernetes.io/projected/573f5d00-c071-44a9-9672-1820a3b078a1-kube-api-access-t7q2z\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:42.925642 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.925608 2581 generic.go:358] "Generic (PLEG): container finished" podID="573f5d00-c071-44a9-9672-1820a3b078a1" containerID="e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e" exitCode=0 Jun 03 17:54:42.925803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.925667 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" Jun 03 17:54:42.925803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.925692 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" event={"ID":"573f5d00-c071-44a9-9672-1820a3b078a1","Type":"ContainerDied","Data":"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e"} Jun 03 17:54:42.925803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.925733 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-psdcw" event={"ID":"573f5d00-c071-44a9-9672-1820a3b078a1","Type":"ContainerDied","Data":"b8cb899c028112d562bee0e720d2d1e7e85033061f6faf4b77f1eac3d27e0e35"} Jun 03 17:54:42.925803 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.925750 2581 scope.go:117] "RemoveContainer" containerID="e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e" Jun 03 17:54:42.935260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.935243 2581 scope.go:117] "RemoveContainer" containerID="e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e" Jun 03 17:54:42.935580 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:54:42.935554 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e\": container with ID starting with e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e not found: ID does not exist" containerID="e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e" Jun 03 17:54:42.935667 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.935585 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e"} err="failed to get container status \"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e\": rpc error: code = NotFound desc = could not find container \"e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e\": container with ID starting with e32d66e69177a226a0776ac4a38313a8efca9556a915e0182dedb2ecee4d043e not found: ID does not exist" Jun 03 17:54:42.945887 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.945863 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:42.952119 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:42.952096 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-psdcw"] Jun 03 17:54:43.665645 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:43.665556 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" path="/var/lib/kubelet/pods/531633f1-cf17-4d89-97ff-8ed1d30f8fc2/volumes" Jun 03 17:54:43.666011 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:43.665904 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="573f5d00-c071-44a9-9672-1820a3b078a1" path="/var/lib/kubelet/pods/573f5d00-c071-44a9-9672-1820a3b078a1/volumes" Jun 03 17:54:49.395571 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:49.395527 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:49.395571 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:49.395577 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:49.417786 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:49.417758 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:49.975662 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:49.975636 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tmskg" Jun 03 17:54:53.685117 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685081 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67"] Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685386 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573f5d00-c071-44a9-9672-1820a3b078a1" containerName="registry-server" Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685399 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="573f5d00-c071-44a9-9672-1820a3b078a1" containerName="registry-server" Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685419 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685425 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685477 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="531633f1-cf17-4d89-97ff-8ed1d30f8fc2" containerName="istio-proxy" Jun 03 17:54:53.685500 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.685486 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="573f5d00-c071-44a9-9672-1820a3b078a1" containerName="registry-server" Jun 03 17:54:53.704569 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.704544 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67"] Jun 03 17:54:53.704708 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.704666 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.706862 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.706843 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tn7sd\"" Jun 03 17:54:53.872203 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.872171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.872203 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.872203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.872480 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.872228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsjs\" (UniqueName: \"kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.973259 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.973227 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.973259 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.973259 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.973553 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.973282 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whsjs\" (UniqueName: \"kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.973747 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.973723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.973817 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.973723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:53.980847 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:53.980827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsjs\" (UniqueName: \"kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:54.013992 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.013954 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:54.143026 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.143000 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67"] Jun 03 17:54:54.144828 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:54.144798 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe654607_9ec2_4b9b_855c_8f2e99d4baf8.slice/crio-a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b WatchSource:0}: Error finding container a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b: Status 404 returned error can't find the container with id a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b Jun 03 17:54:54.486493 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.486459 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh"] Jun 03 17:54:54.489935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.489919 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.501780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.501748 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh"] Jun 03 17:54:54.578260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.578221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djgc\" (UniqueName: \"kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.578260 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.578264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.578483 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.578372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.679759 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.679721 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.679929 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.679786 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8djgc\" (UniqueName: \"kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.679929 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.679807 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.680105 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.680084 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.680142 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.680113 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.688220 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.688197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djgc\" (UniqueName: \"kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.806402 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.806307 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:54:54.935420 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.935394 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh"] Jun 03 17:54:54.937354 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:54.937325 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfd0251_a7ab_4af4_9080_c9586de59e34.slice/crio-3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225 WatchSource:0}: Error finding container 3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225: Status 404 returned error can't find the container with id 3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225 Jun 03 17:54:54.972272 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.972242 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" event={"ID":"1cfd0251-a7ab-4af4-9080-c9586de59e34","Type":"ContainerStarted","Data":"3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225"} Jun 03 17:54:54.973547 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.973494 2581 generic.go:358] "Generic (PLEG): container finished" podID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerID="901e09c5c5d2a346fd0252b007012c9d13c2d5c8262e61afe6f95eec62d3a22e" exitCode=0 Jun 03 17:54:54.973636 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.973541 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" event={"ID":"be654607-9ec2-4b9b-855c-8f2e99d4baf8","Type":"ContainerDied","Data":"901e09c5c5d2a346fd0252b007012c9d13c2d5c8262e61afe6f95eec62d3a22e"} Jun 03 17:54:54.973636 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:54.973571 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" event={"ID":"be654607-9ec2-4b9b-855c-8f2e99d4baf8","Type":"ContainerStarted","Data":"a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b"} Jun 03 17:54:55.294139 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.294106 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp"] Jun 03 17:54:55.297556 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.297539 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.305447 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.305418 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp"] Jun 03 17:54:55.387565 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.387440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.387565 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.387494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.387750 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.387601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfbvf\" (UniqueName: \"kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.488361 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.488325 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.488551 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.488372 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.488551 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.488405 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfbvf\" (UniqueName: \"kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.488726 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.488706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.488777 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.488761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.497148 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.497132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfbvf\" (UniqueName: \"kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.607945 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.607914 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:55.689458 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.689414 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9"] Jun 03 17:54:55.697417 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.697301 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.699899 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.699870 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9"] Jun 03 17:54:55.779383 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.779352 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp"] Jun 03 17:54:55.791296 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.791269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.791572 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.791551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.791652 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.791616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bngbg\" (UniqueName: \"kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.795372 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:55.795344 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833ba47c_01ae_4ac1_84e6_6040d551e554.slice/crio-814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df WatchSource:0}: Error finding container 814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df: Status 404 returned error can't find the container with id 814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df Jun 03 17:54:55.892958 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.892928 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.893080 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.892968 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bngbg\" (UniqueName: \"kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.893080 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.893017 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.893276 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.893256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.893336 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.893318 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.901816 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.901788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bngbg\" (UniqueName: \"kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:55.978640 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.978608 2581 generic.go:358] "Generic (PLEG): container finished" podID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerID="ede217ce8d6b8456595554469cfc3c7897146febdbaae671f91164027a1fe7f7" exitCode=0 Jun 03 17:54:55.978846 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.978673 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" event={"ID":"1cfd0251-a7ab-4af4-9080-c9586de59e34","Type":"ContainerDied","Data":"ede217ce8d6b8456595554469cfc3c7897146febdbaae671f91164027a1fe7f7"} Jun 03 17:54:55.980426 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.980394 2581 generic.go:358] "Generic (PLEG): container finished" podID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerID="48b905c50d3af9dc0d484fe9fe6df3e9aaa73c70cebeff89e935896faba6acf3" exitCode=0 Jun 03 17:54:55.980549 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.980472 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" event={"ID":"be654607-9ec2-4b9b-855c-8f2e99d4baf8","Type":"ContainerDied","Data":"48b905c50d3af9dc0d484fe9fe6df3e9aaa73c70cebeff89e935896faba6acf3"} Jun 03 17:54:55.981948 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.981924 2581 generic.go:358] "Generic (PLEG): container finished" podID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerID="96388d514583a038f90c76fa6d7cac49ce3584bc2a214f97b3c1fe6ba838a6ed" exitCode=0 Jun 03 17:54:55.982051 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.981997 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" event={"ID":"833ba47c-01ae-4ac1-84e6-6040d551e554","Type":"ContainerDied","Data":"96388d514583a038f90c76fa6d7cac49ce3584bc2a214f97b3c1fe6ba838a6ed"} Jun 03 17:54:55.982051 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:55.982030 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" event={"ID":"833ba47c-01ae-4ac1-84e6-6040d551e554","Type":"ContainerStarted","Data":"814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df"} Jun 03 17:54:56.011644 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.011609 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:54:56.157979 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.157952 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9"] Jun 03 17:54:56.191458 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:54:56.191422 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50658f1_b606_446a_99bb_9f46ef3d6012.slice/crio-99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0 WatchSource:0}: Error finding container 99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0: Status 404 returned error can't find the container with id 99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0 Jun 03 17:54:56.986839 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.986810 2581 generic.go:358] "Generic (PLEG): container finished" podID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerID="74fa0e22040b4ee7a781d9e0e11071bd3a885b367f291cb525c3b3ea08ca4694" exitCode=0 Jun 03 17:54:56.987214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.986895 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" event={"ID":"e50658f1-b606-446a-99bb-9f46ef3d6012","Type":"ContainerDied","Data":"74fa0e22040b4ee7a781d9e0e11071bd3a885b367f291cb525c3b3ea08ca4694"} Jun 03 17:54:56.987214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.986930 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" event={"ID":"e50658f1-b606-446a-99bb-9f46ef3d6012","Type":"ContainerStarted","Data":"99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0"} Jun 03 17:54:56.988917 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.988889 2581 generic.go:358] "Generic (PLEG): container finished" podID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerID="07d7c19bd243bf77725419f7d470841fdf24215c3ad77db22e3a8658ef01a256" exitCode=0 Jun 03 17:54:56.989037 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.988976 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" event={"ID":"833ba47c-01ae-4ac1-84e6-6040d551e554","Type":"ContainerDied","Data":"07d7c19bd243bf77725419f7d470841fdf24215c3ad77db22e3a8658ef01a256"} Jun 03 17:54:56.991100 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.991078 2581 generic.go:358] "Generic (PLEG): container finished" podID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerID="b4f55ff10392ef86a3e8e5e9d1ac17e2f89f06c97b9ade5f2170418c1dd2337a" exitCode=0 Jun 03 17:54:56.991193 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:56.991136 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" event={"ID":"be654607-9ec2-4b9b-855c-8f2e99d4baf8","Type":"ContainerDied","Data":"b4f55ff10392ef86a3e8e5e9d1ac17e2f89f06c97b9ade5f2170418c1dd2337a"} Jun 03 17:54:57.997214 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:57.997177 2581 generic.go:358] "Generic (PLEG): container finished" podID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerID="5ccbe38be4675db4868d6cbb2fcb2346de13c652dd8edae763b5c5762a87766a" exitCode=0 Jun 03 17:54:57.997619 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:57.997265 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" event={"ID":"833ba47c-01ae-4ac1-84e6-6040d551e554","Type":"ContainerDied","Data":"5ccbe38be4675db4868d6cbb2fcb2346de13c652dd8edae763b5c5762a87766a"} Jun 03 17:54:57.998787 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:57.998763 2581 generic.go:358] "Generic (PLEG): container finished" podID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerID="57a5ce8fd3bed80bdcfdb5021baf90be670d4a8073cbe0ce6007e86bee0f0682" exitCode=0 Jun 03 17:54:57.998893 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:57.998845 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" event={"ID":"1cfd0251-a7ab-4af4-9080-c9586de59e34","Type":"ContainerDied","Data":"57a5ce8fd3bed80bdcfdb5021baf90be670d4a8073cbe0ce6007e86bee0f0682"} Jun 03 17:54:58.000466 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.000378 2581 generic.go:358] "Generic (PLEG): container finished" podID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerID="62081950aadfdab54f2c8e9c4949f55fc0336c259e27eee976e21f4c088782d7" exitCode=0 Jun 03 17:54:58.000466 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.000446 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" event={"ID":"e50658f1-b606-446a-99bb-9f46ef3d6012","Type":"ContainerDied","Data":"62081950aadfdab54f2c8e9c4949f55fc0336c259e27eee976e21f4c088782d7"} Jun 03 17:54:58.151733 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.151710 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:58.226040 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.226005 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whsjs\" (UniqueName: \"kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs\") pod \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " Jun 03 17:54:58.226189 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.226057 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle\") pod \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " Jun 03 17:54:58.226189 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.226140 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util\") pod \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\" (UID: \"be654607-9ec2-4b9b-855c-8f2e99d4baf8\") " Jun 03 17:54:58.226518 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.226483 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle" (OuterVolumeSpecName: "bundle") pod "be654607-9ec2-4b9b-855c-8f2e99d4baf8" (UID: "be654607-9ec2-4b9b-855c-8f2e99d4baf8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:58.228250 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.228225 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs" (OuterVolumeSpecName: "kube-api-access-whsjs") pod "be654607-9ec2-4b9b-855c-8f2e99d4baf8" (UID: "be654607-9ec2-4b9b-855c-8f2e99d4baf8"). InnerVolumeSpecName "kube-api-access-whsjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:54:58.231848 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.231829 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util" (OuterVolumeSpecName: "util") pod "be654607-9ec2-4b9b-855c-8f2e99d4baf8" (UID: "be654607-9ec2-4b9b-855c-8f2e99d4baf8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:58.326860 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.326774 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:58.326860 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.326808 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654607-9ec2-4b9b-855c-8f2e99d4baf8-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:58.326860 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:58.326818 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whsjs\" (UniqueName: \"kubernetes.io/projected/be654607-9ec2-4b9b-855c-8f2e99d4baf8-kube-api-access-whsjs\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:59.006442 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.006405 2581 generic.go:358] "Generic (PLEG): container finished" podID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerID="656ed3df6c7904bb34183de47d05a4a2ce8ab13139edd1a2842992548ed1ba0a" exitCode=0 Jun 03 17:54:59.006905 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.006480 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" event={"ID":"1cfd0251-a7ab-4af4-9080-c9586de59e34","Type":"ContainerDied","Data":"656ed3df6c7904bb34183de47d05a4a2ce8ab13139edd1a2842992548ed1ba0a"} Jun 03 17:54:59.008038 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.008018 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" Jun 03 17:54:59.008163 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.008022 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67" event={"ID":"be654607-9ec2-4b9b-855c-8f2e99d4baf8","Type":"ContainerDied","Data":"a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b"} Jun 03 17:54:59.008163 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.008116 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0d5ddbec7127f29ada3196554b9ea7412fd749669c73e34f7feba717dd6855b" Jun 03 17:54:59.009868 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.009841 2581 generic.go:358] "Generic (PLEG): container finished" podID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerID="5b7791a4b7a4dbfa2d4a9b3b88ef1f19ee2c73bdd9470c24c852abade2a86a36" exitCode=0 Jun 03 17:54:59.009994 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.009924 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" event={"ID":"e50658f1-b606-446a-99bb-9f46ef3d6012","Type":"ContainerDied","Data":"5b7791a4b7a4dbfa2d4a9b3b88ef1f19ee2c73bdd9470c24c852abade2a86a36"} Jun 03 17:54:59.137440 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.137420 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:54:59.234114 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.234081 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfbvf\" (UniqueName: \"kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf\") pod \"833ba47c-01ae-4ac1-84e6-6040d551e554\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " Jun 03 17:54:59.234300 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.234161 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util\") pod \"833ba47c-01ae-4ac1-84e6-6040d551e554\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " Jun 03 17:54:59.234300 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.234208 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle\") pod \"833ba47c-01ae-4ac1-84e6-6040d551e554\" (UID: \"833ba47c-01ae-4ac1-84e6-6040d551e554\") " Jun 03 17:54:59.234664 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.234640 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle" (OuterVolumeSpecName: "bundle") pod "833ba47c-01ae-4ac1-84e6-6040d551e554" (UID: "833ba47c-01ae-4ac1-84e6-6040d551e554"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:59.236341 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.236318 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf" (OuterVolumeSpecName: "kube-api-access-bfbvf") pod "833ba47c-01ae-4ac1-84e6-6040d551e554" (UID: "833ba47c-01ae-4ac1-84e6-6040d551e554"). InnerVolumeSpecName "kube-api-access-bfbvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:54:59.239637 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.239603 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util" (OuterVolumeSpecName: "util") pod "833ba47c-01ae-4ac1-84e6-6040d551e554" (UID: "833ba47c-01ae-4ac1-84e6-6040d551e554"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:54:59.335431 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.335359 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfbvf\" (UniqueName: \"kubernetes.io/projected/833ba47c-01ae-4ac1-84e6-6040d551e554-kube-api-access-bfbvf\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:59.335431 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.335385 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:54:59.335431 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:54:59.335396 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833ba47c-01ae-4ac1-84e6-6040d551e554-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.014915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.014881 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" event={"ID":"833ba47c-01ae-4ac1-84e6-6040d551e554","Type":"ContainerDied","Data":"814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df"} Jun 03 17:55:00.014915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.014917 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="814b0f84d4bc2fb723068ec7e3aa863b689b739d836e08626eb4c34da5e6e7df" Jun 03 17:55:00.014915 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.014891 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp" Jun 03 17:55:00.164480 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.164456 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:55:00.167821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.167802 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:55:00.242924 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.242892 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bngbg\" (UniqueName: \"kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg\") pod \"e50658f1-b606-446a-99bb-9f46ef3d6012\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " Jun 03 17:55:00.243112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.242936 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle\") pod \"e50658f1-b606-446a-99bb-9f46ef3d6012\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " Jun 03 17:55:00.243112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.242960 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8djgc\" (UniqueName: \"kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc\") pod \"1cfd0251-a7ab-4af4-9080-c9586de59e34\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " Jun 03 17:55:00.243112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.242980 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util\") pod \"1cfd0251-a7ab-4af4-9080-c9586de59e34\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " Jun 03 17:55:00.243112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.243011 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle\") pod \"1cfd0251-a7ab-4af4-9080-c9586de59e34\" (UID: \"1cfd0251-a7ab-4af4-9080-c9586de59e34\") " Jun 03 17:55:00.243112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.243032 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util\") pod \"e50658f1-b606-446a-99bb-9f46ef3d6012\" (UID: \"e50658f1-b606-446a-99bb-9f46ef3d6012\") " Jun 03 17:55:00.243611 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.243567 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle" (OuterVolumeSpecName: "bundle") pod "1cfd0251-a7ab-4af4-9080-c9586de59e34" (UID: "1cfd0251-a7ab-4af4-9080-c9586de59e34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:55:00.243751 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.243726 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle" (OuterVolumeSpecName: "bundle") pod "e50658f1-b606-446a-99bb-9f46ef3d6012" (UID: "e50658f1-b606-446a-99bb-9f46ef3d6012"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:55:00.245180 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.245158 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc" (OuterVolumeSpecName: "kube-api-access-8djgc") pod "1cfd0251-a7ab-4af4-9080-c9586de59e34" (UID: "1cfd0251-a7ab-4af4-9080-c9586de59e34"). InnerVolumeSpecName "kube-api-access-8djgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:55:00.245267 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.245250 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg" (OuterVolumeSpecName: "kube-api-access-bngbg") pod "e50658f1-b606-446a-99bb-9f46ef3d6012" (UID: "e50658f1-b606-446a-99bb-9f46ef3d6012"). InnerVolumeSpecName "kube-api-access-bngbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:55:00.249015 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.248996 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util" (OuterVolumeSpecName: "util") pod "e50658f1-b606-446a-99bb-9f46ef3d6012" (UID: "e50658f1-b606-446a-99bb-9f46ef3d6012"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:55:00.344378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.344306 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.344378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.344333 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8djgc\" (UniqueName: \"kubernetes.io/projected/1cfd0251-a7ab-4af4-9080-c9586de59e34-kube-api-access-8djgc\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.344378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.344346 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.344378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.344356 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50658f1-b606-446a-99bb-9f46ef3d6012-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.344378 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.344364 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bngbg\" (UniqueName: \"kubernetes.io/projected/e50658f1-b606-446a-99bb-9f46ef3d6012-kube-api-access-bngbg\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:00.384246 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.384212 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util" (OuterVolumeSpecName: "util") pod "1cfd0251-a7ab-4af4-9080-c9586de59e34" (UID: "1cfd0251-a7ab-4af4-9080-c9586de59e34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:55:00.444780 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:00.444750 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cfd0251-a7ab-4af4-9080-c9586de59e34-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:01.021867 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.021823 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" event={"ID":"1cfd0251-a7ab-4af4-9080-c9586de59e34","Type":"ContainerDied","Data":"3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225"} Jun 03 17:55:01.022354 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.021879 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3264df9563108b4162470b1010b7237f1a6c3c4b926a7bdf9329196b90cd5225" Jun 03 17:55:01.022354 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.021888 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh" Jun 03 17:55:01.023834 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.023811 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" event={"ID":"e50658f1-b606-446a-99bb-9f46ef3d6012","Type":"ContainerDied","Data":"99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0"} Jun 03 17:55:01.023834 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.023836 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99e6c968b6d722e7ab18d138cbe6b0ea83aafe9017f3c33467712bde1d7ab0b0" Jun 03 17:55:01.023973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:01.023862 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9" Jun 03 17:55:10.259858 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.259820 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm"] Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260230 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260246 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260259 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="util" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260266 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="util" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260276 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260283 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260292 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260298 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="pull" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260309 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="extract" Jun 03 17:55:10.260312 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260316 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260337 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260345 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260355 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260364 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260371 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260379 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260389 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="pull" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260395 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="pull" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260403 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260410 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260421 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260431 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260442 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260450 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="util" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260552 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cfd0251-a7ab-4af4-9080-c9586de59e34" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260566 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="be654607-9ec2-4b9b-855c-8f2e99d4baf8" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260574 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="e50658f1-b606-446a-99bb-9f46ef3d6012" containerName="extract" Jun 03 17:55:10.260815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.260585 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="833ba47c-01ae-4ac1-84e6-6040d551e554" containerName="extract" Jun 03 17:55:10.262723 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.262704 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:10.265207 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.265185 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-48wxb\"" Jun 03 17:55:10.272815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.272791 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm"] Jun 03 17:55:10.321808 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.321777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7pld\" (UniqueName: \"kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld\") pod \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" (UID: \"26df390d-f968-4524-a0d4-db39ea87f4ac\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:10.423239 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.423194 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7pld\" (UniqueName: \"kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld\") pod \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" (UID: \"26df390d-f968-4524-a0d4-db39ea87f4ac\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:10.437999 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.437965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7pld\" (UniqueName: \"kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld\") pod \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" (UID: \"26df390d-f968-4524-a0d4-db39ea87f4ac\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:10.573089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.572986 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:10.706216 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:10.706193 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm"] Jun 03 17:55:10.708340 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:55:10.708310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26df390d_f968_4524_a0d4_db39ea87f4ac.slice/crio-2803f99ac0f79910daa4b84347c083c0c77f663a71bbc722030f710d13f7d7e2 WatchSource:0}: Error finding container 2803f99ac0f79910daa4b84347c083c0c77f663a71bbc722030f710d13f7d7e2: Status 404 returned error can't find the container with id 2803f99ac0f79910daa4b84347c083c0c77f663a71bbc722030f710d13f7d7e2 Jun 03 17:55:11.061282 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:11.061248 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" event={"ID":"26df390d-f968-4524-a0d4-db39ea87f4ac","Type":"ContainerStarted","Data":"2803f99ac0f79910daa4b84347c083c0c77f663a71bbc722030f710d13f7d7e2"} Jun 03 17:55:13.069914 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:13.069868 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" event={"ID":"26df390d-f968-4524-a0d4-db39ea87f4ac","Type":"ContainerStarted","Data":"bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904"} Jun 03 17:55:13.070308 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:13.069956 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:13.088083 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:13.087880 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" podStartSLOduration=1.36881545 podStartE2EDuration="3.087868504s" podCreationTimestamp="2026-06-03 17:55:10 +0000 UTC" firstStartedPulling="2026-06-03 17:55:10.710392004 +0000 UTC m=+405.579690576" lastFinishedPulling="2026-06-03 17:55:12.429445053 +0000 UTC m=+407.298743630" observedRunningTime="2026-06-03 17:55:13.08765678 +0000 UTC m=+407.956955365" watchObservedRunningTime="2026-06-03 17:55:13.087868504 +0000 UTC m=+407.957167115" Jun 03 17:55:18.060771 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.060730 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-rntlc"] Jun 03 17:55:18.067913 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.067894 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:18.070287 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.070267 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zg6k4\"" Jun 03 17:55:18.074398 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.074371 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-rntlc"] Jun 03 17:55:18.190266 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.190195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxxt\" (UniqueName: \"kubernetes.io/projected/7c818b59-783d-4b01-884c-1e2afe6b234f-kube-api-access-9dxxt\") pod \"authorino-operator-657f44b778-rntlc\" (UID: \"7c818b59-783d-4b01-884c-1e2afe6b234f\") " pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:18.291066 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.291022 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxxt\" (UniqueName: \"kubernetes.io/projected/7c818b59-783d-4b01-884c-1e2afe6b234f-kube-api-access-9dxxt\") pod \"authorino-operator-657f44b778-rntlc\" (UID: \"7c818b59-783d-4b01-884c-1e2afe6b234f\") " pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:18.301541 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.301500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxxt\" (UniqueName: \"kubernetes.io/projected/7c818b59-783d-4b01-884c-1e2afe6b234f-kube-api-access-9dxxt\") pod \"authorino-operator-657f44b778-rntlc\" (UID: \"7c818b59-783d-4b01-884c-1e2afe6b234f\") " pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:18.379536 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.379428 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:18.509370 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:18.509266 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-rntlc"] Jun 03 17:55:18.512145 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:55:18.512115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c818b59_783d_4b01_884c_1e2afe6b234f.slice/crio-465d3c09088c2c1cd35fb92bde8ced267f1861587479c3e07aba83db51fefa38 WatchSource:0}: Error finding container 465d3c09088c2c1cd35fb92bde8ced267f1861587479c3e07aba83db51fefa38: Status 404 returned error can't find the container with id 465d3c09088c2c1cd35fb92bde8ced267f1861587479c3e07aba83db51fefa38 Jun 03 17:55:19.093188 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:19.093153 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" event={"ID":"7c818b59-783d-4b01-884c-1e2afe6b234f","Type":"ContainerStarted","Data":"465d3c09088c2c1cd35fb92bde8ced267f1861587479c3e07aba83db51fefa38"} Jun 03 17:55:21.103579 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:21.103529 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" event={"ID":"7c818b59-783d-4b01-884c-1e2afe6b234f","Type":"ContainerStarted","Data":"568e25384e2ae1017529234b3f703848414689d7d2167ea295cfcb2d040e2fbb"} Jun 03 17:55:21.104061 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:21.103629 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:21.119815 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:21.119774 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" podStartSLOduration=0.746008649 podStartE2EDuration="3.119759345s" podCreationTimestamp="2026-06-03 17:55:18 +0000 UTC" firstStartedPulling="2026-06-03 17:55:18.514228547 +0000 UTC m=+413.383527126" lastFinishedPulling="2026-06-03 17:55:20.88797925 +0000 UTC m=+415.757277822" observedRunningTime="2026-06-03 17:55:21.118311427 +0000 UTC m=+415.987610021" watchObservedRunningTime="2026-06-03 17:55:21.119759345 +0000 UTC m=+415.989058012" Jun 03 17:55:24.076595 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.076554 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:24.235196 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.235165 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2"] Jun 03 17:55:24.238576 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.238556 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.242013 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.241992 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 17:55:24.242714 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.242697 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tn7sd\"" Jun 03 17:55:24.242801 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.242764 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 17:55:24.255938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.255913 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2"] Jun 03 17:55:24.350935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.350853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57wwq\" (UniqueName: \"kubernetes.io/projected/d04a4f33-059c-4fbc-8b2d-83ad4701412b-kube-api-access-57wwq\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.350935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.350904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.351137 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.350960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d04a4f33-059c-4fbc-8b2d-83ad4701412b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.451716 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.451683 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.451897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.451739 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d04a4f33-059c-4fbc-8b2d-83ad4701412b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.451897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.451789 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57wwq\" (UniqueName: \"kubernetes.io/projected/d04a4f33-059c-4fbc-8b2d-83ad4701412b-kube-api-access-57wwq\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.451897 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:55:24.451831 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 03 17:55:24.451999 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:55:24.451912 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert podName:d04a4f33-059c-4fbc-8b2d-83ad4701412b nodeName:}" failed. No retries permitted until 2026-06-03 17:55:24.951895598 +0000 UTC m=+419.821194170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-zw8z2" (UID: "d04a4f33-059c-4fbc-8b2d-83ad4701412b") : secret "plugin-serving-cert" not found Jun 03 17:55:24.452390 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.452373 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d04a4f33-059c-4fbc-8b2d-83ad4701412b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.470397 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.470370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57wwq\" (UniqueName: \"kubernetes.io/projected/d04a4f33-059c-4fbc-8b2d-83ad4701412b-kube-api-access-57wwq\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.955958 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.955927 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:24.958437 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:24.958419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04a4f33-059c-4fbc-8b2d-83ad4701412b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zw8z2\" (UID: \"d04a4f33-059c-4fbc-8b2d-83ad4701412b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:25.147611 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:25.147577 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" Jun 03 17:55:25.281156 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:25.281130 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2"] Jun 03 17:55:25.282714 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:55:25.282689 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd04a4f33_059c_4fbc_8b2d_83ad4701412b.slice/crio-add792acec582f0c260993076f294856de95d3277f7cad093a81d423cd8d499b WatchSource:0}: Error finding container add792acec582f0c260993076f294856de95d3277f7cad093a81d423cd8d499b: Status 404 returned error can't find the container with id add792acec582f0c260993076f294856de95d3277f7cad093a81d423cd8d499b Jun 03 17:55:26.123138 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:26.123099 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" event={"ID":"d04a4f33-059c-4fbc-8b2d-83ad4701412b","Type":"ContainerStarted","Data":"add792acec582f0c260993076f294856de95d3277f7cad093a81d423cd8d499b"} Jun 03 17:55:32.110848 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:32.110816 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-rntlc" Jun 03 17:55:35.140755 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.140478 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm"] Jun 03 17:55:35.143543 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.142074 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" containerName="manager" containerID="cri-o://bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904" gracePeriod=2 Jun 03 17:55:35.144411 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.144364 2581 status_manager.go:895] "Failed to get status for pod" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" is forbidden: User \"system:node:ip-10-0-128-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-189.ec2.internal' and this object" Jun 03 17:55:35.144856 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.144803 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm"] Jun 03 17:55:35.164766 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.164675 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc"] Jun 03 17:55:35.165206 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.165181 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" containerName="manager" Jun 03 17:55:35.165206 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.165206 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" containerName="manager" Jun 03 17:55:35.165431 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.165292 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" containerName="manager" Jun 03 17:55:35.168429 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.168404 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:35.178971 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.178936 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc"] Jun 03 17:55:35.193417 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.193380 2581 status_manager.go:895] "Failed to get status for pod" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" is forbidden: User \"system:node:ip-10-0-128-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-189.ec2.internal' and this object" Jun 03 17:55:35.250549 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.250451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxp4n\" (UniqueName: \"kubernetes.io/projected/e5b43d40-bc16-4f5e-81d5-2ce7ede25c39-kube-api-access-dxp4n\") pod \"limitador-operator-controller-manager-85c4996f8c-hs5wc\" (UID: \"e5b43d40-bc16-4f5e-81d5-2ce7ede25c39\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:35.351344 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.351301 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxp4n\" (UniqueName: \"kubernetes.io/projected/e5b43d40-bc16-4f5e-81d5-2ce7ede25c39-kube-api-access-dxp4n\") pod \"limitador-operator-controller-manager-85c4996f8c-hs5wc\" (UID: \"e5b43d40-bc16-4f5e-81d5-2ce7ede25c39\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:35.360873 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.360827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxp4n\" (UniqueName: \"kubernetes.io/projected/e5b43d40-bc16-4f5e-81d5-2ce7ede25c39-kube-api-access-dxp4n\") pod \"limitador-operator-controller-manager-85c4996f8c-hs5wc\" (UID: \"e5b43d40-bc16-4f5e-81d5-2ce7ede25c39\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:35.496963 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.496930 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:35.666036 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:35.666007 2581 status_manager.go:895] "Failed to get status for pod" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" is forbidden: User \"system:node:ip-10-0-128-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-189.ec2.internal' and this object" Jun 03 17:55:49.519813 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.519776 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc"] Jun 03 17:55:49.521128 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:55:49.521093 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b43d40_bc16_4f5e_81d5_2ce7ede25c39.slice/crio-e1cdc31c188913a370ed100383319a75b5ea79030ed2b01861c8f5150131f85e WatchSource:0}: Error finding container e1cdc31c188913a370ed100383319a75b5ea79030ed2b01861c8f5150131f85e: Status 404 returned error can't find the container with id e1cdc31c188913a370ed100383319a75b5ea79030ed2b01861c8f5150131f85e Jun 03 17:55:49.547103 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.547083 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:49.551085 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.551024 2581 status_manager.go:895] "Failed to get status for pod" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" is forbidden: User \"system:node:ip-10-0-128-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-189.ec2.internal' and this object" Jun 03 17:55:49.589552 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.589481 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7pld\" (UniqueName: \"kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld\") pod \"26df390d-f968-4524-a0d4-db39ea87f4ac\" (UID: \"26df390d-f968-4524-a0d4-db39ea87f4ac\") " Jun 03 17:55:49.591625 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.591605 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld" (OuterVolumeSpecName: "kube-api-access-z7pld") pod "26df390d-f968-4524-a0d4-db39ea87f4ac" (UID: "26df390d-f968-4524-a0d4-db39ea87f4ac"). InnerVolumeSpecName "kube-api-access-z7pld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:55:49.666597 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.666558 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" path="/var/lib/kubelet/pods/26df390d-f968-4524-a0d4-db39ea87f4ac/volumes" Jun 03 17:55:49.690466 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:49.690442 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7pld\" (UniqueName: \"kubernetes.io/projected/26df390d-f968-4524-a0d4-db39ea87f4ac-kube-api-access-z7pld\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:55:50.229575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.229536 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" event={"ID":"e5b43d40-bc16-4f5e-81d5-2ce7ede25c39","Type":"ContainerStarted","Data":"c85238f0c7d465f8a418c486787739abf109713022a81042454fc1a8e623ecf3"} Jun 03 17:55:50.229575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.229579 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" event={"ID":"e5b43d40-bc16-4f5e-81d5-2ce7ede25c39","Type":"ContainerStarted","Data":"e1cdc31c188913a370ed100383319a75b5ea79030ed2b01861c8f5150131f85e"} Jun 03 17:55:50.229575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.229597 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:55:50.231044 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.231003 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" event={"ID":"d04a4f33-059c-4fbc-8b2d-83ad4701412b","Type":"ContainerStarted","Data":"3619dff6efd49a6be78c0b0f7b4267d9e80c0dcdc7587efa53a7afbcf6c21df3"} Jun 03 17:55:50.232148 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.232121 2581 generic.go:358] "Generic (PLEG): container finished" podID="26df390d-f968-4524-a0d4-db39ea87f4ac" containerID="bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904" exitCode=0 Jun 03 17:55:50.232245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.232153 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" Jun 03 17:55:50.232245 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.232210 2581 scope.go:117] "RemoveContainer" containerID="bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904" Jun 03 17:55:50.240781 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.240668 2581 scope.go:117] "RemoveContainer" containerID="bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904" Jun 03 17:55:50.240932 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:55:50.240916 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904\": container with ID starting with bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904 not found: ID does not exist" containerID="bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904" Jun 03 17:55:50.240981 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.240941 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904"} err="failed to get container status \"bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904\": rpc error: code = NotFound desc = could not find container \"bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904\": container with ID starting with bc8e0e6e3c9707325cedff4869aa2862c00c68a40592b5436a59f7373204c904 not found: ID does not exist" Jun 03 17:55:50.252747 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.252710 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" podStartSLOduration=15.252696151 podStartE2EDuration="15.252696151s" podCreationTimestamp="2026-06-03 17:55:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:55:50.251677729 +0000 UTC m=+445.120976323" watchObservedRunningTime="2026-06-03 17:55:50.252696151 +0000 UTC m=+445.121994770" Jun 03 17:55:50.254244 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.254219 2581 status_manager.go:895] "Failed to get status for pod" podUID="26df390d-f968-4524-a0d4-db39ea87f4ac" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvpvm" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvpvm\" is forbidden: User \"system:node:ip-10-0-128-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-189.ec2.internal' and this object" Jun 03 17:55:50.274412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:55:50.274370 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zw8z2" podStartSLOduration=1.8723204340000001 podStartE2EDuration="26.274354844s" podCreationTimestamp="2026-06-03 17:55:24 +0000 UTC" firstStartedPulling="2026-06-03 17:55:25.284122567 +0000 UTC m=+420.153421140" lastFinishedPulling="2026-06-03 17:55:49.686156978 +0000 UTC m=+444.555455550" observedRunningTime="2026-06-03 17:55:50.27284453 +0000 UTC m=+445.142143129" watchObservedRunningTime="2026-06-03 17:55:50.274354844 +0000 UTC m=+445.143653474" Jun 03 17:56:01.239569 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:01.239532 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hs5wc" Jun 03 17:56:20.766089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.766053 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:20.855534 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.855469 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:20.855715 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.855628 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:20.857967 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.857946 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-89855\"" Jun 03 17:56:20.943412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.943375 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:56:20.946767 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.946750 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:56:20.959935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.959903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqh5w\" (UniqueName: \"kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w\") pod \"authorino-f99f4b5cd-2pz7f\" (UID: \"2f6b0909-71b3-4a54-816d-41bc38be85a3\") " pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:20.962015 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:20.961988 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:56:21.061566 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.061449 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqh5w\" (UniqueName: \"kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w\") pod \"authorino-f99f4b5cd-2pz7f\" (UID: \"2f6b0909-71b3-4a54-816d-41bc38be85a3\") " pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:21.061566 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.061528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mkcs\" (UniqueName: \"kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs\") pod \"authorino-7498df8756-7tkzc\" (UID: \"263e6148-bcd0-4a56-9cc1-71b8c1ae224b\") " pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:56:21.069257 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.069231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqh5w\" (UniqueName: \"kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w\") pod \"authorino-f99f4b5cd-2pz7f\" (UID: \"2f6b0909-71b3-4a54-816d-41bc38be85a3\") " pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:21.162416 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.162379 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mkcs\" (UniqueName: \"kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs\") pod \"authorino-7498df8756-7tkzc\" (UID: \"263e6148-bcd0-4a56-9cc1-71b8c1ae224b\") " pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:56:21.164217 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.164187 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:21.170383 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.170358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mkcs\" (UniqueName: \"kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs\") pod \"authorino-7498df8756-7tkzc\" (UID: \"263e6148-bcd0-4a56-9cc1-71b8c1ae224b\") " pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:56:21.261693 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.261658 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:56:21.300157 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.300125 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:21.302491 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:56:21.302438 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f6b0909_71b3_4a54_816d_41bc38be85a3.slice/crio-cd7ec49c3fba2eb0f4b1b2b186e3ff5e7f11c728db55c5e69f51e2c94c957e52 WatchSource:0}: Error finding container cd7ec49c3fba2eb0f4b1b2b186e3ff5e7f11c728db55c5e69f51e2c94c957e52: Status 404 returned error can't find the container with id cd7ec49c3fba2eb0f4b1b2b186e3ff5e7f11c728db55c5e69f51e2c94c957e52 Jun 03 17:56:21.344458 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.344420 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" event={"ID":"2f6b0909-71b3-4a54-816d-41bc38be85a3","Type":"ContainerStarted","Data":"cd7ec49c3fba2eb0f4b1b2b186e3ff5e7f11c728db55c5e69f51e2c94c957e52"} Jun 03 17:56:21.395782 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:21.395754 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:56:21.397208 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:56:21.397183 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod263e6148_bcd0_4a56_9cc1_71b8c1ae224b.slice/crio-fd573d0e744e9f8c65dbeed852274fe7ef2879b1d3921387c44ecd8578ef7dc3 WatchSource:0}: Error finding container fd573d0e744e9f8c65dbeed852274fe7ef2879b1d3921387c44ecd8578ef7dc3: Status 404 returned error can't find the container with id fd573d0e744e9f8c65dbeed852274fe7ef2879b1d3921387c44ecd8578ef7dc3 Jun 03 17:56:22.357576 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:22.357495 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-7tkzc" event={"ID":"263e6148-bcd0-4a56-9cc1-71b8c1ae224b","Type":"ContainerStarted","Data":"fd573d0e744e9f8c65dbeed852274fe7ef2879b1d3921387c44ecd8578ef7dc3"} Jun 03 17:56:25.371092 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:25.371058 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-7tkzc" event={"ID":"263e6148-bcd0-4a56-9cc1-71b8c1ae224b","Type":"ContainerStarted","Data":"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02"} Jun 03 17:56:25.372499 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:25.372469 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" event={"ID":"2f6b0909-71b3-4a54-816d-41bc38be85a3","Type":"ContainerStarted","Data":"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6"} Jun 03 17:56:25.389677 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:25.389629 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-7tkzc" podStartSLOduration=2.058435543 podStartE2EDuration="5.389615313s" podCreationTimestamp="2026-06-03 17:56:20 +0000 UTC" firstStartedPulling="2026-06-03 17:56:21.398621469 +0000 UTC m=+476.267920040" lastFinishedPulling="2026-06-03 17:56:24.729801227 +0000 UTC m=+479.599099810" observedRunningTime="2026-06-03 17:56:25.387074277 +0000 UTC m=+480.256372872" watchObservedRunningTime="2026-06-03 17:56:25.389615313 +0000 UTC m=+480.258913941" Jun 03 17:56:25.402935 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:25.402883 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" podStartSLOduration=1.963854466 podStartE2EDuration="5.402869686s" podCreationTimestamp="2026-06-03 17:56:20 +0000 UTC" firstStartedPulling="2026-06-03 17:56:21.304213746 +0000 UTC m=+476.173512319" lastFinishedPulling="2026-06-03 17:56:24.743228955 +0000 UTC m=+479.612527539" observedRunningTime="2026-06-03 17:56:25.400851229 +0000 UTC m=+480.270149824" watchObservedRunningTime="2026-06-03 17:56:25.402869686 +0000 UTC m=+480.272168282" Jun 03 17:56:25.426349 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:25.426314 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:27.380885 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:27.380828 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" podUID="2f6b0909-71b3-4a54-816d-41bc38be85a3" containerName="authorino" containerID="cri-o://d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6" gracePeriod=30 Jun 03 17:56:27.621395 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:27.621373 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:27.725154 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:27.725126 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqh5w\" (UniqueName: \"kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w\") pod \"2f6b0909-71b3-4a54-816d-41bc38be85a3\" (UID: \"2f6b0909-71b3-4a54-816d-41bc38be85a3\") " Jun 03 17:56:27.727339 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:27.727311 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w" (OuterVolumeSpecName: "kube-api-access-wqh5w") pod "2f6b0909-71b3-4a54-816d-41bc38be85a3" (UID: "2f6b0909-71b3-4a54-816d-41bc38be85a3"). InnerVolumeSpecName "kube-api-access-wqh5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:56:27.826423 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:27.826386 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqh5w\" (UniqueName: \"kubernetes.io/projected/2f6b0909-71b3-4a54-816d-41bc38be85a3-kube-api-access-wqh5w\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:56:28.386161 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.386120 2581 generic.go:358] "Generic (PLEG): container finished" podID="2f6b0909-71b3-4a54-816d-41bc38be85a3" containerID="d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6" exitCode=0 Jun 03 17:56:28.386616 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.386170 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" Jun 03 17:56:28.386616 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.386170 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" event={"ID":"2f6b0909-71b3-4a54-816d-41bc38be85a3","Type":"ContainerDied","Data":"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6"} Jun 03 17:56:28.386616 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.386204 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-2pz7f" event={"ID":"2f6b0909-71b3-4a54-816d-41bc38be85a3","Type":"ContainerDied","Data":"cd7ec49c3fba2eb0f4b1b2b186e3ff5e7f11c728db55c5e69f51e2c94c957e52"} Jun 03 17:56:28.386616 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.386224 2581 scope.go:117] "RemoveContainer" containerID="d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6" Jun 03 17:56:28.394926 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.394905 2581 scope.go:117] "RemoveContainer" containerID="d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6" Jun 03 17:56:28.395190 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:56:28.395172 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6\": container with ID starting with d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6 not found: ID does not exist" containerID="d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6" Jun 03 17:56:28.395238 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.395198 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6"} err="failed to get container status \"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6\": rpc error: code = NotFound desc = could not find container \"d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6\": container with ID starting with d4f8943b29bcab1c801af4af7a0f137c5ecb020915e0ad71b7c25199e36824a6 not found: ID does not exist" Jun 03 17:56:28.408075 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.408042 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:28.411869 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:28.411848 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-2pz7f"] Jun 03 17:56:29.665808 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:29.665773 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6b0909-71b3-4a54-816d-41bc38be85a3" path="/var/lib/kubelet/pods/2f6b0909-71b3-4a54-816d-41bc38be85a3/volumes" Jun 03 17:56:53.182691 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.182650 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6"] Jun 03 17:56:53.183145 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.183126 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6b0909-71b3-4a54-816d-41bc38be85a3" containerName="authorino" Jun 03 17:56:53.183192 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.183149 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6b0909-71b3-4a54-816d-41bc38be85a3" containerName="authorino" Jun 03 17:56:53.183281 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.183271 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f6b0909-71b3-4a54-816d-41bc38be85a3" containerName="authorino" Jun 03 17:56:53.186684 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.186667 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.189297 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.189276 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 17:56:53.189897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.189878 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 17:56:53.189938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.189891 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2m9s6\"" Jun 03 17:56:53.194932 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.194908 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6"] Jun 03 17:56:53.249412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.249375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.249626 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.249431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drwq\" (UniqueName: \"kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.249626 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.249533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.350777 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.350738 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.350938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.350800 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2drwq\" (UniqueName: \"kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.350938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.350854 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.351221 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.351205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.351262 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.351201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.361593 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.361565 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drwq\" (UniqueName: \"kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.496593 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.496545 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:53.631892 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:53.631861 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6"] Jun 03 17:56:53.634095 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:56:53.634064 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e1806e_944e_4cc4_b0b5_841b4e94d8df.slice/crio-95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c WatchSource:0}: Error finding container 95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c: Status 404 returned error can't find the container with id 95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c Jun 03 17:56:54.500823 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:54.500785 2581 generic.go:358] "Generic (PLEG): container finished" podID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerID="a8ece0b1f0ae3de22930eb3c38f53270282f7179d9f951eb5790cddd4a3f46a6" exitCode=0 Jun 03 17:56:54.501168 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:54.500871 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" event={"ID":"29e1806e-944e-4cc4-b0b5-841b4e94d8df","Type":"ContainerDied","Data":"a8ece0b1f0ae3de22930eb3c38f53270282f7179d9f951eb5790cddd4a3f46a6"} Jun 03 17:56:54.501168 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:54.500905 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" event={"ID":"29e1806e-944e-4cc4-b0b5-841b4e94d8df","Type":"ContainerStarted","Data":"95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c"} Jun 03 17:56:56.509792 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:56.509753 2581 generic.go:358] "Generic (PLEG): container finished" podID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerID="a2f15eccd5b9379152ea5ab193cd70e3b6346e4306a36acea4d847fcc6f7c399" exitCode=0 Jun 03 17:56:56.510182 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:56.509830 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" event={"ID":"29e1806e-944e-4cc4-b0b5-841b4e94d8df","Type":"ContainerDied","Data":"a2f15eccd5b9379152ea5ab193cd70e3b6346e4306a36acea4d847fcc6f7c399"} Jun 03 17:56:57.515368 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:57.515337 2581 generic.go:358] "Generic (PLEG): container finished" podID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerID="7e2eb8ea3532c959cf15e9bba1cb04f8b1252243595baa94e7a5b243a1cf637b" exitCode=0 Jun 03 17:56:57.515755 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:57.515410 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" event={"ID":"29e1806e-944e-4cc4-b0b5-841b4e94d8df","Type":"ContainerDied","Data":"7e2eb8ea3532c959cf15e9bba1cb04f8b1252243595baa94e7a5b243a1cf637b"} Jun 03 17:56:58.643933 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.643907 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:58.799412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.799314 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util\") pod \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " Jun 03 17:56:58.799412 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.799372 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2drwq\" (UniqueName: \"kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq\") pod \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " Jun 03 17:56:58.799690 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.799424 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle\") pod \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\" (UID: \"29e1806e-944e-4cc4-b0b5-841b4e94d8df\") " Jun 03 17:56:58.800012 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.799970 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle" (OuterVolumeSpecName: "bundle") pod "29e1806e-944e-4cc4-b0b5-841b4e94d8df" (UID: "29e1806e-944e-4cc4-b0b5-841b4e94d8df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:56:58.801766 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.801737 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq" (OuterVolumeSpecName: "kube-api-access-2drwq") pod "29e1806e-944e-4cc4-b0b5-841b4e94d8df" (UID: "29e1806e-944e-4cc4-b0b5-841b4e94d8df"). InnerVolumeSpecName "kube-api-access-2drwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:56:58.805729 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.805703 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util" (OuterVolumeSpecName: "util") pod "29e1806e-944e-4cc4-b0b5-841b4e94d8df" (UID: "29e1806e-944e-4cc4-b0b5-841b4e94d8df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:56:58.900892 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.900861 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-bundle\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:56:58.900892 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.900890 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e1806e-944e-4cc4-b0b5-841b4e94d8df-util\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:56:58.900892 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:58.900900 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2drwq\" (UniqueName: \"kubernetes.io/projected/29e1806e-944e-4cc4-b0b5-841b4e94d8df-kube-api-access-2drwq\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:56:59.524582 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:59.524554 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" Jun 03 17:56:59.524776 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:59.524550 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lcbq6" event={"ID":"29e1806e-944e-4cc4-b0b5-841b4e94d8df","Type":"ContainerDied","Data":"95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c"} Jun 03 17:56:59.524776 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:56:59.524670 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95c550c50a46f5a93f1fbd35ea2d444213889f9a3f4711ed8f268e4bc1ad382c" Jun 03 17:57:24.846274 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846189 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846605 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="util" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846619 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="util" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846626 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="pull" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846632 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="pull" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846646 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="extract" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846652 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="extract" Jun 03 17:57:24.846737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.846709 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="29e1806e-944e-4cc4-b0b5-841b4e94d8df" containerName="extract" Jun 03 17:57:24.849811 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.849797 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:24.852229 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.852205 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 17:57:24.852229 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.852213 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 17:57:24.852429 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.852239 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 17:57:24.852429 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.852374 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7ntmg\"" Jun 03 17:57:24.858303 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.858280 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:57:24.908080 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:24.908047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrmxt\" (UniqueName: \"kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt\") pod \"maas-keycloak-0\" (UID: \"a3fd9c83-7a78-4b0b-9658-0bd112201d77\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:25.009369 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:25.009321 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrmxt\" (UniqueName: \"kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt\") pod \"maas-keycloak-0\" (UID: \"a3fd9c83-7a78-4b0b-9658-0bd112201d77\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:25.017697 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:25.017667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrmxt\" (UniqueName: \"kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt\") pod \"maas-keycloak-0\" (UID: \"a3fd9c83-7a78-4b0b-9658-0bd112201d77\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:25.160047 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:25.159966 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:25.299689 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:25.299662 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:57:25.301723 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:57:25.301694 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fd9c83_7a78_4b0b_9658_0bd112201d77.slice/crio-ebd6cd2c5abcc2f366e094b797df4761a44d846dde2aff231566a64f8ed6b98a WatchSource:0}: Error finding container ebd6cd2c5abcc2f366e094b797df4761a44d846dde2aff231566a64f8ed6b98a: Status 404 returned error can't find the container with id ebd6cd2c5abcc2f366e094b797df4761a44d846dde2aff231566a64f8ed6b98a Jun 03 17:57:25.631795 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:25.631761 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3fd9c83-7a78-4b0b-9658-0bd112201d77","Type":"ContainerStarted","Data":"ebd6cd2c5abcc2f366e094b797df4761a44d846dde2aff231566a64f8ed6b98a"} Jun 03 17:57:29.827154 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:29.827134 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 17:57:30.656827 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:30.656784 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3fd9c83-7a78-4b0b-9658-0bd112201d77","Type":"ContainerStarted","Data":"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7"} Jun 03 17:57:30.681943 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:30.679889 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.158278445 podStartE2EDuration="6.679869653s" podCreationTimestamp="2026-06-03 17:57:24 +0000 UTC" firstStartedPulling="2026-06-03 17:57:25.302858358 +0000 UTC m=+540.172156933" lastFinishedPulling="2026-06-03 17:57:29.824449569 +0000 UTC m=+544.693748141" observedRunningTime="2026-06-03 17:57:30.673838458 +0000 UTC m=+545.543137052" watchObservedRunningTime="2026-06-03 17:57:30.679869653 +0000 UTC m=+545.549168248" Jun 03 17:57:31.161011 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:31.160962 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:31.162721 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:31.162676 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:32.160957 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:32.160908 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:33.160782 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:33.160725 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:34.160786 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:34.160743 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:35.160528 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:35.160460 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:35.161677 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:35.161642 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:36.161469 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:36.161422 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:37.161093 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:37.161036 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:38.161124 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:38.161077 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:39.160681 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:39.160632 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:40.160624 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:40.160576 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:41.160938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:41.160878 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:42.161450 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:42.161340 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 03 17:57:43.291236 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:43.291194 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:43.312537 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:43.312468 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 17:57:53.297321 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:53.297289 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 17:57:54.195612 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.195572 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-j9n6r"] Jun 03 17:57:54.203545 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.203493 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-j9n6r"] Jun 03 17:57:54.203685 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.203619 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.394356 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.394316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flpmx\" (UniqueName: \"kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx\") pod \"authorino-8b475cf9f-j9n6r\" (UID: \"c6b5abac-bae6-42f5-a3c8-e4985619d9da\") " pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.429107 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.429074 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-j9n6r"] Jun 03 17:57:54.429312 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:57:54.429294 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-flpmx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-j9n6r" podUID="c6b5abac-bae6-42f5-a3c8-e4985619d9da" Jun 03 17:57:54.455940 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.455871 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:57:54.458185 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.458164 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.460409 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.460392 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 17:57:54.466475 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.466451 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:57:54.495345 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.495319 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flpmx\" (UniqueName: \"kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx\") pod \"authorino-8b475cf9f-j9n6r\" (UID: \"c6b5abac-bae6-42f5-a3c8-e4985619d9da\") " pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.503158 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.503130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flpmx\" (UniqueName: \"kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx\") pod \"authorino-8b475cf9f-j9n6r\" (UID: \"c6b5abac-bae6-42f5-a3c8-e4985619d9da\") " pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.595946 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.595915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.596133 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.595954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkgg4\" (UniqueName: \"kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.697077 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.697044 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.697077 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.697077 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkgg4\" (UniqueName: \"kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.699684 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.699659 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.705794 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.705775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkgg4\" (UniqueName: \"kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4\") pod \"authorino-66c9d7f48d-qdxp9\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.767805 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.767779 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:57:54.793699 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.793674 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.798612 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.798594 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:54.896702 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.896677 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:57:54.898528 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.898480 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flpmx\" (UniqueName: \"kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx\") pod \"c6b5abac-bae6-42f5-a3c8-e4985619d9da\" (UID: \"c6b5abac-bae6-42f5-a3c8-e4985619d9da\") " Jun 03 17:57:54.898653 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:57:54.898534 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7beb4871_6003_4976_adb5_3c705b4d411b.slice/crio-6b433023991a55ec8603cf6cc31a128afa38f339e97a5ceb733908303de4d320 WatchSource:0}: Error finding container 6b433023991a55ec8603cf6cc31a128afa38f339e97a5ceb733908303de4d320: Status 404 returned error can't find the container with id 6b433023991a55ec8603cf6cc31a128afa38f339e97a5ceb733908303de4d320 Jun 03 17:57:54.900838 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:54.900816 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx" (OuterVolumeSpecName: "kube-api-access-flpmx") pod "c6b5abac-bae6-42f5-a3c8-e4985619d9da" (UID: "c6b5abac-bae6-42f5-a3c8-e4985619d9da"). InnerVolumeSpecName "kube-api-access-flpmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:57:55.000141 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.000104 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flpmx\" (UniqueName: \"kubernetes.io/projected/c6b5abac-bae6-42f5-a3c8-e4985619d9da-kube-api-access-flpmx\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:57:55.798219 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.798131 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-j9n6r" Jun 03 17:57:55.798583 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.798132 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" event={"ID":"7beb4871-6003-4976-adb5-3c705b4d411b","Type":"ContainerStarted","Data":"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f"} Jun 03 17:57:55.798583 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.798269 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" event={"ID":"7beb4871-6003-4976-adb5-3c705b4d411b","Type":"ContainerStarted","Data":"6b433023991a55ec8603cf6cc31a128afa38f339e97a5ceb733908303de4d320"} Jun 03 17:57:55.823911 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.823871 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-j9n6r"] Jun 03 17:57:55.827060 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.827025 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-j9n6r"] Jun 03 17:57:55.841943 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.841896 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" podStartSLOduration=1.48351087 podStartE2EDuration="1.841883118s" podCreationTimestamp="2026-06-03 17:57:54 +0000 UTC" firstStartedPulling="2026-06-03 17:57:54.899857655 +0000 UTC m=+569.769156227" lastFinishedPulling="2026-06-03 17:57:55.258229903 +0000 UTC m=+570.127528475" observedRunningTime="2026-06-03 17:57:55.839180051 +0000 UTC m=+570.708478655" watchObservedRunningTime="2026-06-03 17:57:55.841883118 +0000 UTC m=+570.711181712" Jun 03 17:57:55.864455 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.864423 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:57:55.864783 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:55.864705 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-7tkzc" podUID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" containerName="authorino" containerID="cri-o://4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02" gracePeriod=30 Jun 03 17:57:56.109470 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.109445 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:57:56.208632 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.208586 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mkcs\" (UniqueName: \"kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs\") pod \"263e6148-bcd0-4a56-9cc1-71b8c1ae224b\" (UID: \"263e6148-bcd0-4a56-9cc1-71b8c1ae224b\") " Jun 03 17:57:56.210720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.210698 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs" (OuterVolumeSpecName: "kube-api-access-9mkcs") pod "263e6148-bcd0-4a56-9cc1-71b8c1ae224b" (UID: "263e6148-bcd0-4a56-9cc1-71b8c1ae224b"). InnerVolumeSpecName "kube-api-access-9mkcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:57:56.310151 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.310116 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mkcs\" (UniqueName: \"kubernetes.io/projected/263e6148-bcd0-4a56-9cc1-71b8c1ae224b-kube-api-access-9mkcs\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:57:56.803573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.803533 2581 generic.go:358] "Generic (PLEG): container finished" podID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" containerID="4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02" exitCode=0 Jun 03 17:57:56.803573 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.803574 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-7tkzc" Jun 03 17:57:56.804069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.803599 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-7tkzc" event={"ID":"263e6148-bcd0-4a56-9cc1-71b8c1ae224b","Type":"ContainerDied","Data":"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02"} Jun 03 17:57:56.804069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.803638 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-7tkzc" event={"ID":"263e6148-bcd0-4a56-9cc1-71b8c1ae224b","Type":"ContainerDied","Data":"fd573d0e744e9f8c65dbeed852274fe7ef2879b1d3921387c44ecd8578ef7dc3"} Jun 03 17:57:56.804069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.803653 2581 scope.go:117] "RemoveContainer" containerID="4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02" Jun 03 17:57:56.812469 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.812445 2581 scope.go:117] "RemoveContainer" containerID="4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02" Jun 03 17:57:56.812788 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:57:56.812770 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02\": container with ID starting with 4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02 not found: ID does not exist" containerID="4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02" Jun 03 17:57:56.812840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.812798 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02"} err="failed to get container status \"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02\": rpc error: code = NotFound desc = could not find container \"4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02\": container with ID starting with 4db7f93fec7aeafedf68be5a0183d8a24df733f83dd993173c07368097347e02 not found: ID does not exist" Jun 03 17:57:56.826410 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.826383 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:57:56.829893 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:56.829869 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-7tkzc"] Jun 03 17:57:57.665575 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:57.665540 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" path="/var/lib/kubelet/pods/263e6148-bcd0-4a56-9cc1-71b8c1ae224b/volumes" Jun 03 17:57:57.665950 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:57.665930 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b5abac-bae6-42f5-a3c8-e4985619d9da" path="/var/lib/kubelet/pods/c6b5abac-bae6-42f5-a3c8-e4985619d9da/volumes" Jun 03 17:57:59.625170 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.625136 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd67957f9-jcksm"] Jun 03 17:57:59.625623 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.625471 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" containerName="authorino" Jun 03 17:57:59.625623 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.625483 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" containerName="authorino" Jun 03 17:57:59.625623 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.625567 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="263e6148-bcd0-4a56-9cc1-71b8c1ae224b" containerName="authorino" Jun 03 17:57:59.628150 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.628133 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:57:59.630492 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.630472 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 17:57:59.630635 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.630615 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gd7q2\"" Jun 03 17:57:59.637099 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.637071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zmh2\" (UniqueName: \"kubernetes.io/projected/bec9964b-40ff-4966-a4a9-9aef7291c861-kube-api-access-6zmh2\") pod \"maas-controller-dd67957f9-jcksm\" (UID: \"bec9964b-40ff-4966-a4a9-9aef7291c861\") " pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:57:59.638721 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.638698 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd67957f9-jcksm"] Jun 03 17:57:59.738169 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.738129 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zmh2\" (UniqueName: \"kubernetes.io/projected/bec9964b-40ff-4966-a4a9-9aef7291c861-kube-api-access-6zmh2\") pod \"maas-controller-dd67957f9-jcksm\" (UID: \"bec9964b-40ff-4966-a4a9-9aef7291c861\") " pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:57:59.746126 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.746097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zmh2\" (UniqueName: \"kubernetes.io/projected/bec9964b-40ff-4966-a4a9-9aef7291c861-kube-api-access-6zmh2\") pod \"maas-controller-dd67957f9-jcksm\" (UID: \"bec9964b-40ff-4966-a4a9-9aef7291c861\") " pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:57:59.938737 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:57:59.938649 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:58:00.071367 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:00.071338 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd67957f9-jcksm"] Jun 03 17:58:00.073799 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:58:00.073769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec9964b_40ff_4966_a4a9_9aef7291c861.slice/crio-e54261ed7b6bcf054fb81d323dcf30c2baf052cb358fcee91358291a27fa9602 WatchSource:0}: Error finding container e54261ed7b6bcf054fb81d323dcf30c2baf052cb358fcee91358291a27fa9602: Status 404 returned error can't find the container with id e54261ed7b6bcf054fb81d323dcf30c2baf052cb358fcee91358291a27fa9602 Jun 03 17:58:00.822097 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:00.822055 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd67957f9-jcksm" event={"ID":"bec9964b-40ff-4966-a4a9-9aef7291c861","Type":"ContainerStarted","Data":"e54261ed7b6bcf054fb81d323dcf30c2baf052cb358fcee91358291a27fa9602"} Jun 03 17:58:02.830992 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:02.830963 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd67957f9-jcksm" event={"ID":"bec9964b-40ff-4966-a4a9-9aef7291c861","Type":"ContainerStarted","Data":"99b0caa7aba70a8450424495772694e1fe251113810710eda5cbd768a816432e"} Jun 03 17:58:02.831379 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:02.831001 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:58:02.849271 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:02.849219 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-dd67957f9-jcksm" podStartSLOduration=1.5900401290000001 podStartE2EDuration="3.849204752s" podCreationTimestamp="2026-06-03 17:57:59 +0000 UTC" firstStartedPulling="2026-06-03 17:58:00.075164209 +0000 UTC m=+574.944462781" lastFinishedPulling="2026-06-03 17:58:02.334328831 +0000 UTC m=+577.203627404" observedRunningTime="2026-06-03 17:58:02.8470701 +0000 UTC m=+577.716368696" watchObservedRunningTime="2026-06-03 17:58:02.849204752 +0000 UTC m=+577.718503346" Jun 03 17:58:13.841142 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:13.841112 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd67957f9-jcksm" Jun 03 17:58:25.587386 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:25.587358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:58:25.588461 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:25.588439 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:58:25.588894 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:25.588875 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 17:58:25.589886 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:25.589867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 17:58:43.936655 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:43.936617 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:43.937112 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:43.936841 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" containerID="cri-o://285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7" gracePeriod=30 Jun 03 17:58:45.975399 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.975378 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:45.990350 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.990322 2581 generic.go:358] "Generic (PLEG): container finished" podID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerID="285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7" exitCode=143 Jun 03 17:58:45.990481 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.990369 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:45.990481 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.990398 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3fd9c83-7a78-4b0b-9658-0bd112201d77","Type":"ContainerDied","Data":"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7"} Jun 03 17:58:45.990481 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.990439 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3fd9c83-7a78-4b0b-9658-0bd112201d77","Type":"ContainerDied","Data":"ebd6cd2c5abcc2f366e094b797df4761a44d846dde2aff231566a64f8ed6b98a"} Jun 03 17:58:45.990481 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:45.990459 2581 scope.go:117] "RemoveContainer" containerID="285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7" Jun 03 17:58:46.000930 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.000909 2581 scope.go:117] "RemoveContainer" containerID="285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7" Jun 03 17:58:46.001253 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:58:46.001235 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7\": container with ID starting with 285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7 not found: ID does not exist" containerID="285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7" Jun 03 17:58:46.001332 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.001260 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7"} err="failed to get container status \"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7\": rpc error: code = NotFound desc = could not find container \"285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7\": container with ID starting with 285df8b85a18a0e15217ad44371187b3e8f0353a20ccd98e3ffab9b3da691ed7 not found: ID does not exist" Jun 03 17:58:46.112739 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.112542 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrmxt\" (UniqueName: \"kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt\") pod \"a3fd9c83-7a78-4b0b-9658-0bd112201d77\" (UID: \"a3fd9c83-7a78-4b0b-9658-0bd112201d77\") " Jun 03 17:58:46.114854 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.114828 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt" (OuterVolumeSpecName: "kube-api-access-vrmxt") pod "a3fd9c83-7a78-4b0b-9658-0bd112201d77" (UID: "a3fd9c83-7a78-4b0b-9658-0bd112201d77"). InnerVolumeSpecName "kube-api-access-vrmxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:58:46.213447 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.213414 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrmxt\" (UniqueName: \"kubernetes.io/projected/a3fd9c83-7a78-4b0b-9658-0bd112201d77-kube-api-access-vrmxt\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:58:46.313497 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.313465 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:46.315711 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.315691 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:46.336961 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.336921 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:46.337262 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.337250 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" Jun 03 17:58:46.337308 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.337264 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" Jun 03 17:58:46.337353 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.337321 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" containerName="keycloak" Jun 03 17:58:46.339927 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.339912 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.342402 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.342377 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 17:58:46.342569 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.342452 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7ntmg\"" Jun 03 17:58:46.342569 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.342494 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 17:58:46.342569 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.342549 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 17:58:46.342721 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.342597 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 17:58:46.353468 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.353434 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:46.415015 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.414930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmctl\" (UniqueName: \"kubernetes.io/projected/a928e9dd-0ba4-473c-ac6a-c34852283093-kube-api-access-qmctl\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.415015 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.414996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a928e9dd-0ba4-473c-ac6a-c34852283093-test-realms\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.515834 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.515807 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmctl\" (UniqueName: \"kubernetes.io/projected/a928e9dd-0ba4-473c-ac6a-c34852283093-kube-api-access-qmctl\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.515965 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.515859 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a928e9dd-0ba4-473c-ac6a-c34852283093-test-realms\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.516436 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.516420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a928e9dd-0ba4-473c-ac6a-c34852283093-test-realms\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.525352 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.525327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmctl\" (UniqueName: \"kubernetes.io/projected/a928e9dd-0ba4-473c-ac6a-c34852283093-kube-api-access-qmctl\") pod \"maas-keycloak-0\" (UID: \"a928e9dd-0ba4-473c-ac6a-c34852283093\") " pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.657693 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.657643 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:46.789085 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.789058 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 17:58:46.791498 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:58:46.791463 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda928e9dd_0ba4_473c_ac6a_c34852283093.slice/crio-8aedb6d96ad8ce136771768dd4b2b5670d7b3fc65777d02cfe9b612d8ab2c3a7 WatchSource:0}: Error finding container 8aedb6d96ad8ce136771768dd4b2b5670d7b3fc65777d02cfe9b612d8ab2c3a7: Status 404 returned error can't find the container with id 8aedb6d96ad8ce136771768dd4b2b5670d7b3fc65777d02cfe9b612d8ab2c3a7 Jun 03 17:58:46.793149 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.793132 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:58:46.995988 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:46.995956 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a928e9dd-0ba4-473c-ac6a-c34852283093","Type":"ContainerStarted","Data":"8aedb6d96ad8ce136771768dd4b2b5670d7b3fc65777d02cfe9b612d8ab2c3a7"} Jun 03 17:58:47.667189 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:47.667146 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3fd9c83-7a78-4b0b-9658-0bd112201d77" path="/var/lib/kubelet/pods/a3fd9c83-7a78-4b0b-9658-0bd112201d77/volumes" Jun 03 17:58:48.002533 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:48.002481 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a928e9dd-0ba4-473c-ac6a-c34852283093","Type":"ContainerStarted","Data":"0bfa43d55054df52ad917e1336d22c6959a0e3bc4f0c20c0b35ade6edd2f8247"} Jun 03 17:58:48.024176 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:48.024115 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.770201894 podStartE2EDuration="2.02409669s" podCreationTimestamp="2026-06-03 17:58:46 +0000 UTC" firstStartedPulling="2026-06-03 17:58:46.793252486 +0000 UTC m=+621.662551058" lastFinishedPulling="2026-06-03 17:58:47.047147282 +0000 UTC m=+621.916445854" observedRunningTime="2026-06-03 17:58:48.022791674 +0000 UTC m=+622.892090269" watchObservedRunningTime="2026-06-03 17:58:48.02409669 +0000 UTC m=+622.893395284" Jun 03 17:58:48.658079 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:48.658033 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:48.659998 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:48.659955 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:49.658647 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:49.658607 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:50.658531 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:50.658440 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:51.658938 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:51.658885 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:52.659089 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:52.659042 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:53.658177 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:53.658125 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:54.658974 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:54.658918 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:55.659008 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:55.658952 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:56.658748 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:56.658697 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:56.659163 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:56.659111 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:57.658962 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:57.658922 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:58.658985 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:58.658945 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 17:58:59.786577 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:59.786533 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 17:58:59.805656 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:58:59.805597 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 17:59:09.790992 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:09.790938 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a928e9dd-0ba4-473c-ac6a-c34852283093" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 17:59:19.791889 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:19.791852 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 17:59:30.574349 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.574315 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-774499bb68-lnbgs"] Jun 03 17:59:30.577211 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.577193 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.579615 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.579595 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 17:59:30.587712 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.587689 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-774499bb68-lnbgs"] Jun 03 17:59:30.700910 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.700879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-tls-cert\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.701072 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.700915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9g9\" (UniqueName: \"kubernetes.io/projected/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-kube-api-access-hf9g9\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.701072 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.700963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-oidc-ca\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.802253 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.802219 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-tls-cert\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.802430 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.802269 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9g9\" (UniqueName: \"kubernetes.io/projected/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-kube-api-access-hf9g9\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.802430 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.802321 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-oidc-ca\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.802926 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.802908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-oidc-ca\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.804858 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.804837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-tls-cert\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.809840 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.809820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9g9\" (UniqueName: \"kubernetes.io/projected/6bb8570b-d922-4e9f-a3ed-b6f8ddac4125-kube-api-access-hf9g9\") pod \"authorino-774499bb68-lnbgs\" (UID: \"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125\") " pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:30.886413 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:30.886329 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-774499bb68-lnbgs" Jun 03 17:59:31.012666 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:31.012637 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-774499bb68-lnbgs"] Jun 03 17:59:31.014993 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:59:31.014963 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bb8570b_d922_4e9f_a3ed_b6f8ddac4125.slice/crio-0969fbcd7fcad18e2c287092ca9bf961eaa58a4bd7fc68588aa304957e5c7ab8 WatchSource:0}: Error finding container 0969fbcd7fcad18e2c287092ca9bf961eaa58a4bd7fc68588aa304957e5c7ab8: Status 404 returned error can't find the container with id 0969fbcd7fcad18e2c287092ca9bf961eaa58a4bd7fc68588aa304957e5c7ab8 Jun 03 17:59:31.184250 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:31.184173 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774499bb68-lnbgs" event={"ID":"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125","Type":"ContainerStarted","Data":"0969fbcd7fcad18e2c287092ca9bf961eaa58a4bd7fc68588aa304957e5c7ab8"} Jun 03 17:59:32.189647 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.189610 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-774499bb68-lnbgs" event={"ID":"6bb8570b-d922-4e9f-a3ed-b6f8ddac4125","Type":"ContainerStarted","Data":"f1b22d3515283cf012ab5a79073c30f3d8cf3855923f99c50273de2eec70eae6"} Jun 03 17:59:32.207269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.207219 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-774499bb68-lnbgs" podStartSLOduration=1.8386448579999999 podStartE2EDuration="2.207205207s" podCreationTimestamp="2026-06-03 17:59:30 +0000 UTC" firstStartedPulling="2026-06-03 17:59:31.016192593 +0000 UTC m=+665.885491167" lastFinishedPulling="2026-06-03 17:59:31.384752945 +0000 UTC m=+666.254051516" observedRunningTime="2026-06-03 17:59:32.206283566 +0000 UTC m=+667.075582159" watchObservedRunningTime="2026-06-03 17:59:32.207205207 +0000 UTC m=+667.076503801" Jun 03 17:59:32.235717 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.235685 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:59:32.235966 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.235934 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" podUID="7beb4871-6003-4976-adb5-3c705b4d411b" containerName="authorino" containerID="cri-o://8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f" gracePeriod=30 Jun 03 17:59:32.483202 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.483179 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:59:32.620694 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.620653 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkgg4\" (UniqueName: \"kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4\") pod \"7beb4871-6003-4976-adb5-3c705b4d411b\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " Jun 03 17:59:32.620885 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.620791 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert\") pod \"7beb4871-6003-4976-adb5-3c705b4d411b\" (UID: \"7beb4871-6003-4976-adb5-3c705b4d411b\") " Jun 03 17:59:32.622888 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.622861 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4" (OuterVolumeSpecName: "kube-api-access-xkgg4") pod "7beb4871-6003-4976-adb5-3c705b4d411b" (UID: "7beb4871-6003-4976-adb5-3c705b4d411b"). InnerVolumeSpecName "kube-api-access-xkgg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:59:32.631959 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.631933 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7beb4871-6003-4976-adb5-3c705b4d411b" (UID: "7beb4871-6003-4976-adb5-3c705b4d411b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 17:59:32.721884 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.721798 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkgg4\" (UniqueName: \"kubernetes.io/projected/7beb4871-6003-4976-adb5-3c705b4d411b-kube-api-access-xkgg4\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:59:32.721884 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:32.721829 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7beb4871-6003-4976-adb5-3c705b4d411b-tls-cert\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 17:59:33.194804 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.194722 2581 generic.go:358] "Generic (PLEG): container finished" podID="7beb4871-6003-4976-adb5-3c705b4d411b" containerID="8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f" exitCode=0 Jun 03 17:59:33.194804 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.194771 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" Jun 03 17:59:33.195269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.194807 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" event={"ID":"7beb4871-6003-4976-adb5-3c705b4d411b","Type":"ContainerDied","Data":"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f"} Jun 03 17:59:33.195269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.194850 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c9d7f48d-qdxp9" event={"ID":"7beb4871-6003-4976-adb5-3c705b4d411b","Type":"ContainerDied","Data":"6b433023991a55ec8603cf6cc31a128afa38f339e97a5ceb733908303de4d320"} Jun 03 17:59:33.195269 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.194870 2581 scope.go:117] "RemoveContainer" containerID="8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f" Jun 03 17:59:33.204603 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.204588 2581 scope.go:117] "RemoveContainer" containerID="8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f" Jun 03 17:59:33.204851 ip-10-0-128-189 kubenswrapper[2581]: E0603 17:59:33.204835 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f\": container with ID starting with 8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f not found: ID does not exist" containerID="8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f" Jun 03 17:59:33.204894 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.204860 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f"} err="failed to get container status \"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f\": rpc error: code = NotFound desc = could not find container \"8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f\": container with ID starting with 8d46354ef65d2fc3083f26782e31e96adea3b8ef791004323f8ebb101b5c2f5f not found: ID does not exist" Jun 03 17:59:33.215961 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.215936 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:59:33.217951 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.217933 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66c9d7f48d-qdxp9"] Jun 03 17:59:33.665749 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:33.665718 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7beb4871-6003-4976-adb5-3c705b4d411b" path="/var/lib/kubelet/pods/7beb4871-6003-4976-adb5-3c705b4d411b/volumes" Jun 03 17:59:44.846173 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.846135 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2"] Jun 03 17:59:44.846654 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.846476 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7beb4871-6003-4976-adb5-3c705b4d411b" containerName="authorino" Jun 03 17:59:44.846654 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.846487 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7beb4871-6003-4976-adb5-3c705b4d411b" containerName="authorino" Jun 03 17:59:44.846654 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.846567 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="7beb4871-6003-4976-adb5-3c705b4d411b" containerName="authorino" Jun 03 17:59:44.848457 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.848440 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.850864 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.850839 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 17:59:44.850986 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.850867 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dqzzh\"" Jun 03 17:59:44.851719 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.851700 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 17:59:44.851905 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.851881 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 17:59:44.857448 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.857426 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2"] Jun 03 17:59:44.924744 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rsw\" (UniqueName: \"kubernetes.io/projected/a591b202-4a28-4270-815f-16366ed12362-kube-api-access-w7rsw\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.924744 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a591b202-4a28-4270-815f-16366ed12362-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.924973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.924973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.924973 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:44.925082 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:44.924992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026363 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026320 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rsw\" (UniqueName: \"kubernetes.io/projected/a591b202-4a28-4270-815f-16366ed12362-kube-api-access-w7rsw\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026384 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a591b202-4a28-4270-815f-16366ed12362-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026417 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026453 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026585 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026497 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026570 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.026995 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.026970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.027069 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.027006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.027192 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.027178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.029300 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.029277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a591b202-4a28-4270-815f-16366ed12362-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.029419 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.029402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a591b202-4a28-4270-815f-16366ed12362-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.033621 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.033601 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rsw\" (UniqueName: \"kubernetes.io/projected/a591b202-4a28-4270-815f-16366ed12362-kube-api-access-w7rsw\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2\" (UID: \"a591b202-4a28-4270-815f-16366ed12362\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.158789 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.158705 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:45.286346 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:45.286320 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2"] Jun 03 17:59:45.287808 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:59:45.287772 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda591b202_4a28_4270_815f_16366ed12362.slice/crio-322da6f8376cb8903f1fff20ee4058cfef745ba47cc8b4b6ab854b7b3f6190bd WatchSource:0}: Error finding container 322da6f8376cb8903f1fff20ee4058cfef745ba47cc8b4b6ab854b7b3f6190bd: Status 404 returned error can't find the container with id 322da6f8376cb8903f1fff20ee4058cfef745ba47cc8b4b6ab854b7b3f6190bd Jun 03 17:59:46.246584 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:46.246543 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" event={"ID":"a591b202-4a28-4270-815f-16366ed12362","Type":"ContainerStarted","Data":"322da6f8376cb8903f1fff20ee4058cfef745ba47cc8b4b6ab854b7b3f6190bd"} Jun 03 17:59:49.260686 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:49.260650 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" event={"ID":"a591b202-4a28-4270-815f-16366ed12362","Type":"ContainerStarted","Data":"5de802e02830ef56466f8c27f0402e25c08a2be7ea7499fbc5b57867b8100210"} Jun 03 17:59:49.932348 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:49.932302 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn"] Jun 03 17:59:49.934959 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:49.934933 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:49.937209 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:49.937185 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 17:59:49.945907 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:49.945886 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn"] Jun 03 17:59:50.071576 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad0668-373e-44e5-a57a-7e4df5b2c85e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.071720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.071720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.071720 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.071862 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.071862 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.071812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmst7\" (UniqueName: \"kubernetes.io/projected/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kube-api-access-qmst7\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.172886 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.172851 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.172895 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.172935 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173062 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.172974 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmst7\" (UniqueName: \"kubernetes.io/projected/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kube-api-access-qmst7\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173201 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.173124 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad0668-373e-44e5-a57a-7e4df5b2c85e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173201 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.173163 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173361 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.173343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173415 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.173394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.173477 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.173461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.175587 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.175566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aaad0668-373e-44e5-a57a-7e4df5b2c85e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.175733 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.175616 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad0668-373e-44e5-a57a-7e4df5b2c85e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.180804 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.180781 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmst7\" (UniqueName: \"kubernetes.io/projected/aaad0668-373e-44e5-a57a-7e4df5b2c85e-kube-api-access-qmst7\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn\" (UID: \"aaad0668-373e-44e5-a57a-7e4df5b2c85e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.248897 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.248867 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 17:59:50.374953 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:50.374818 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn"] Jun 03 17:59:50.377410 ip-10-0-128-189 kubenswrapper[2581]: W0603 17:59:50.377375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaad0668_373e_44e5_a57a_7e4df5b2c85e.slice/crio-a881b4fd80349891f93485f84b63887b9cdcdd8ee91e68623715f115712aaeec WatchSource:0}: Error finding container a881b4fd80349891f93485f84b63887b9cdcdd8ee91e68623715f115712aaeec: Status 404 returned error can't find the container with id a881b4fd80349891f93485f84b63887b9cdcdd8ee91e68623715f115712aaeec Jun 03 17:59:51.271538 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:51.271482 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" event={"ID":"aaad0668-373e-44e5-a57a-7e4df5b2c85e","Type":"ContainerStarted","Data":"dbc893fa3d62265691d65ec8cd2ed7cbb1db5226c34d4e45abe3ce5d419e1098"} Jun 03 17:59:51.271700 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:51.271540 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" event={"ID":"aaad0668-373e-44e5-a57a-7e4df5b2c85e","Type":"ContainerStarted","Data":"a881b4fd80349891f93485f84b63887b9cdcdd8ee91e68623715f115712aaeec"} Jun 03 17:59:51.272799 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:51.272774 2581 generic.go:358] "Generic (PLEG): container finished" podID="a591b202-4a28-4270-815f-16366ed12362" containerID="5de802e02830ef56466f8c27f0402e25c08a2be7ea7499fbc5b57867b8100210" exitCode=0 Jun 03 17:59:51.272926 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:51.272855 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" event={"ID":"a591b202-4a28-4270-815f-16366ed12362","Type":"ContainerDied","Data":"5de802e02830ef56466f8c27f0402e25c08a2be7ea7499fbc5b57867b8100210"} Jun 03 17:59:53.286001 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:53.285970 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" event={"ID":"a591b202-4a28-4270-815f-16366ed12362","Type":"ContainerStarted","Data":"942346f262eb328a7f09103e29bc9b37b6857febaed10e732620ceb5699e666f"} Jun 03 17:59:53.304377 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:53.304320 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" podStartSLOduration=2.082643216 podStartE2EDuration="9.304302474s" podCreationTimestamp="2026-06-03 17:59:44 +0000 UTC" firstStartedPulling="2026-06-03 17:59:45.289593413 +0000 UTC m=+680.158891988" lastFinishedPulling="2026-06-03 17:59:52.511252673 +0000 UTC m=+687.380551246" observedRunningTime="2026-06-03 17:59:53.302766969 +0000 UTC m=+688.172065562" watchObservedRunningTime="2026-06-03 17:59:53.304302474 +0000 UTC m=+688.173601068" Jun 03 17:59:55.158940 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:55.158894 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:55.158940 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:55.158947 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:55.170981 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:55.170960 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:55.304821 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:55.304789 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2" Jun 03 17:59:56.299087 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:56.299048 2581 generic.go:358] "Generic (PLEG): container finished" podID="aaad0668-373e-44e5-a57a-7e4df5b2c85e" containerID="dbc893fa3d62265691d65ec8cd2ed7cbb1db5226c34d4e45abe3ce5d419e1098" exitCode=0 Jun 03 17:59:56.299451 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:56.299112 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" event={"ID":"aaad0668-373e-44e5-a57a-7e4df5b2c85e","Type":"ContainerDied","Data":"dbc893fa3d62265691d65ec8cd2ed7cbb1db5226c34d4e45abe3ce5d419e1098"} Jun 03 17:59:57.304842 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:57.304806 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" event={"ID":"aaad0668-373e-44e5-a57a-7e4df5b2c85e","Type":"ContainerStarted","Data":"9a03c99f1cd277594d5cb6ede33eb88d943e57ef717a6b6697b05b6deae619f4"} Jun 03 17:59:57.327492 ip-10-0-128-189 kubenswrapper[2581]: I0603 17:59:57.327445 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" podStartSLOduration=8.036846512 podStartE2EDuration="8.327431794s" podCreationTimestamp="2026-06-03 17:59:49 +0000 UTC" firstStartedPulling="2026-06-03 17:59:56.299768571 +0000 UTC m=+691.169067143" lastFinishedPulling="2026-06-03 17:59:56.590353854 +0000 UTC m=+691.459652425" observedRunningTime="2026-06-03 17:59:57.325641134 +0000 UTC m=+692.194939726" watchObservedRunningTime="2026-06-03 17:59:57.327431794 +0000 UTC m=+692.196730385" Jun 03 18:00:00.144051 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.144014 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675160-lphtm"] Jun 03 18:00:00.150324 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.150300 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:00.152800 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.152774 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hqb84\"" Jun 03 18:00:00.153556 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.153534 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675160-lphtm"] Jun 03 18:00:00.156848 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.156826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnw9w\" (UniqueName: \"kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w\") pod \"maas-api-key-cleanup-29675160-lphtm\" (UID: \"c33e32c0-361d-4719-87c1-bb06596598b4\") " pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:00.248993 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.248962 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 18:00:00.249172 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.249050 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 18:00:00.257759 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.257734 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnw9w\" (UniqueName: \"kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w\") pod \"maas-api-key-cleanup-29675160-lphtm\" (UID: \"c33e32c0-361d-4719-87c1-bb06596598b4\") " pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:00.261167 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.261149 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 18:00:00.265297 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.265271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnw9w\" (UniqueName: \"kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w\") pod \"maas-api-key-cleanup-29675160-lphtm\" (UID: \"c33e32c0-361d-4719-87c1-bb06596598b4\") " pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:00.327749 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.327714 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn" Jun 03 18:00:00.462647 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.462625 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:00.587525 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:00.587486 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675160-lphtm"] Jun 03 18:00:00.589276 ip-10-0-128-189 kubenswrapper[2581]: W0603 18:00:00.589232 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33e32c0_361d_4719_87c1_bb06596598b4.slice/crio-3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5 WatchSource:0}: Error finding container 3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5: Status 404 returned error can't find the container with id 3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5 Jun 03 18:00:01.321745 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:01.321703 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" event={"ID":"c33e32c0-361d-4719-87c1-bb06596598b4","Type":"ContainerStarted","Data":"3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5"} Jun 03 18:00:03.842591 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:03.842552 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8"] Jun 03 18:00:04.020042 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.020011 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8"] Jun 03 18:00:04.020198 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.020134 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.022540 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.022497 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 18:00:04.088664 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.088804 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.088804 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5d47e0-e47d-481c-b45e-248cec39f6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.088804 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jhnf\" (UniqueName: \"kubernetes.io/projected/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kube-api-access-2jhnf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.088804 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.088957 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.088821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190039 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.189961 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190039 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190027 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190237 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190050 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190237 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190066 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5d47e0-e47d-481c-b45e-248cec39f6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190237 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190087 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jhnf\" (UniqueName: \"kubernetes.io/projected/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kube-api-access-2jhnf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190237 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190106 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190458 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190558 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.190558 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.190550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.192364 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.192346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5d47e0-e47d-481c-b45e-248cec39f6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.192768 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.192750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5d47e0-e47d-481c-b45e-248cec39f6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.198672 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.198649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jhnf\" (UniqueName: \"kubernetes.io/projected/ce5d47e0-e47d-481c-b45e-248cec39f6b4-kube-api-access-2jhnf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8\" (UID: \"ce5d47e0-e47d-481c-b45e-248cec39f6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.330496 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.330464 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:04.458253 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:04.458227 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8"] Jun 03 18:00:04.461323 ip-10-0-128-189 kubenswrapper[2581]: W0603 18:00:04.461292 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5d47e0_e47d_481c_b45e_248cec39f6b4.slice/crio-d35eb2ebce7950d16b2ddf6464432d1bb0d99328877a9d61486f374699af460e WatchSource:0}: Error finding container d35eb2ebce7950d16b2ddf6464432d1bb0d99328877a9d61486f374699af460e: Status 404 returned error can't find the container with id d35eb2ebce7950d16b2ddf6464432d1bb0d99328877a9d61486f374699af460e Jun 03 18:00:05.344318 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:05.344283 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" event={"ID":"ce5d47e0-e47d-481c-b45e-248cec39f6b4","Type":"ContainerStarted","Data":"948db970b61818e01e87e5c5d5ac0d19f757c05bdd20502e81d248f729bc15a9"} Jun 03 18:00:05.344817 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:05.344328 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" event={"ID":"ce5d47e0-e47d-481c-b45e-248cec39f6b4","Type":"ContainerStarted","Data":"d35eb2ebce7950d16b2ddf6464432d1bb0d99328877a9d61486f374699af460e"} Jun 03 18:00:08.539264 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.539171 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5"] Jun 03 18:00:08.542326 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.542304 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.544719 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.544695 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 18:00:08.551736 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.551710 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5"] Jun 03 18:00:08.629204 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.629371 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a00875-018f-4190-a54f-87713458a1d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.629371 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.629371 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.629487 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl5r6\" (UniqueName: \"kubernetes.io/projected/00a00875-018f-4190-a54f-87713458a1d5-kube-api-access-dl5r6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.629487 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.629404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.730736 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.730702 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a00875-018f-4190-a54f-87713458a1d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.730920 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.730753 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.730920 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.730867 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.730920 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.730909 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl5r6\" (UniqueName: \"kubernetes.io/projected/00a00875-018f-4190-a54f-87713458a1d5-kube-api-access-dl5r6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.731107 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.731054 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.731163 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.731123 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.731163 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.731125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.731366 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.731340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.731524 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.731444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.733172 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.733150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a00875-018f-4190-a54f-87713458a1d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.733448 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.733431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a00875-018f-4190-a54f-87713458a1d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.738657 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.738638 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl5r6\" (UniqueName: \"kubernetes.io/projected/00a00875-018f-4190-a54f-87713458a1d5-kube-api-access-dl5r6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5\" (UID: \"00a00875-018f-4190-a54f-87713458a1d5\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.855306 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.855267 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:08.988571 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:08.988545 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5"] Jun 03 18:00:08.989707 ip-10-0-128-189 kubenswrapper[2581]: W0603 18:00:08.989678 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a00875_018f_4190_a54f_87713458a1d5.slice/crio-826879f38f71d695bce6394e37fad3c2957a3cfbe9daafdd42b78065739a6d3e WatchSource:0}: Error finding container 826879f38f71d695bce6394e37fad3c2957a3cfbe9daafdd42b78065739a6d3e: Status 404 returned error can't find the container with id 826879f38f71d695bce6394e37fad3c2957a3cfbe9daafdd42b78065739a6d3e Jun 03 18:00:09.360411 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:09.360370 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" event={"ID":"00a00875-018f-4190-a54f-87713458a1d5","Type":"ContainerStarted","Data":"03f759d9b4de4aeb63ae1fc5754ad106301818cc29110d97278b18772f08d0fc"} Jun 03 18:00:09.360649 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:09.360420 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" event={"ID":"00a00875-018f-4190-a54f-87713458a1d5","Type":"ContainerStarted","Data":"826879f38f71d695bce6394e37fad3c2957a3cfbe9daafdd42b78065739a6d3e"} Jun 03 18:00:09.361886 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:09.361863 2581 generic.go:358] "Generic (PLEG): container finished" podID="ce5d47e0-e47d-481c-b45e-248cec39f6b4" containerID="948db970b61818e01e87e5c5d5ac0d19f757c05bdd20502e81d248f729bc15a9" exitCode=0 Jun 03 18:00:09.361998 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:09.361926 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" event={"ID":"ce5d47e0-e47d-481c-b45e-248cec39f6b4","Type":"ContainerDied","Data":"948db970b61818e01e87e5c5d5ac0d19f757c05bdd20502e81d248f729bc15a9"} Jun 03 18:00:14.386341 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:14.386305 2581 generic.go:358] "Generic (PLEG): container finished" podID="00a00875-018f-4190-a54f-87713458a1d5" containerID="03f759d9b4de4aeb63ae1fc5754ad106301818cc29110d97278b18772f08d0fc" exitCode=0 Jun 03 18:00:14.386831 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:14.386360 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" event={"ID":"00a00875-018f-4190-a54f-87713458a1d5","Type":"ContainerDied","Data":"03f759d9b4de4aeb63ae1fc5754ad106301818cc29110d97278b18772f08d0fc"} Jun 03 18:00:20.409183 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:20.409094 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" event={"ID":"ce5d47e0-e47d-481c-b45e-248cec39f6b4","Type":"ContainerStarted","Data":"9d0f1c98088d81dbd377c89413d614d2d021844a37855a5c41361a9512fb4364"} Jun 03 18:00:20.429130 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:20.429078 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" podStartSLOduration=6.70570632 podStartE2EDuration="17.429062054s" podCreationTimestamp="2026-06-03 18:00:03 +0000 UTC" firstStartedPulling="2026-06-03 18:00:09.362496938 +0000 UTC m=+704.231795526" lastFinishedPulling="2026-06-03 18:00:20.085852678 +0000 UTC m=+714.955151260" observedRunningTime="2026-06-03 18:00:20.426989239 +0000 UTC m=+715.296287839" watchObservedRunningTime="2026-06-03 18:00:20.429062054 +0000 UTC m=+715.298360647" Jun 03 18:00:21.414973 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:21.414941 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" event={"ID":"00a00875-018f-4190-a54f-87713458a1d5","Type":"ContainerStarted","Data":"47bb31b6cf441ceadc496a0de709dec24e94e630d771fdca3a00fdff016b92f5"} Jun 03 18:00:21.435481 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:21.435430 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" podStartSLOduration=7.171663331 podStartE2EDuration="13.435415293s" podCreationTimestamp="2026-06-03 18:00:08 +0000 UTC" firstStartedPulling="2026-06-03 18:00:14.387145003 +0000 UTC m=+709.256443575" lastFinishedPulling="2026-06-03 18:00:20.650896962 +0000 UTC m=+715.520195537" observedRunningTime="2026-06-03 18:00:21.432407888 +0000 UTC m=+716.301706483" watchObservedRunningTime="2026-06-03 18:00:21.435415293 +0000 UTC m=+716.304713887" Jun 03 18:00:24.331253 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:24.331195 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:24.331780 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:24.331436 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:24.347460 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:24.347428 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:24.444618 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:24.444584 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8" Jun 03 18:00:25.442720 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:25.442682 2581 generic.go:358] "Generic (PLEG): container finished" podID="c33e32c0-361d-4719-87c1-bb06596598b4" containerID="e1ebed89c96c625a8cb3121044430c07a8e1721a1e8f4fcdda1a1d9f0263d98f" exitCode=0 Jun 03 18:00:25.443147 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:25.442767 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" event={"ID":"c33e32c0-361d-4719-87c1-bb06596598b4","Type":"ContainerDied","Data":"e1ebed89c96c625a8cb3121044430c07a8e1721a1e8f4fcdda1a1d9f0263d98f"} Jun 03 18:00:26.582265 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:26.582239 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:26.702002 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:26.701907 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnw9w\" (UniqueName: \"kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w\") pod \"c33e32c0-361d-4719-87c1-bb06596598b4\" (UID: \"c33e32c0-361d-4719-87c1-bb06596598b4\") " Jun 03 18:00:26.704217 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:26.704183 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w" (OuterVolumeSpecName: "kube-api-access-rnw9w") pod "c33e32c0-361d-4719-87c1-bb06596598b4" (UID: "c33e32c0-361d-4719-87c1-bb06596598b4"). InnerVolumeSpecName "kube-api-access-rnw9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 18:00:26.802939 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:26.802888 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnw9w\" (UniqueName: \"kubernetes.io/projected/c33e32c0-361d-4719-87c1-bb06596598b4-kube-api-access-rnw9w\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 03 18:00:27.451784 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:27.451744 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" event={"ID":"c33e32c0-361d-4719-87c1-bb06596598b4","Type":"ContainerDied","Data":"3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5"} Jun 03 18:00:27.451784 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:27.451780 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dd89689610e125dc814922803c3ef68be1a5356ea29cd3e6209cd0f8a25a8f5" Jun 03 18:00:27.451784 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:27.451756 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675160-lphtm" Jun 03 18:00:28.855440 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:28.855403 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:28.855440 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:28.855451 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:28.867950 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:28.867928 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:00:29.471365 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:00:29.471335 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5" Jun 03 18:03:25.623005 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:03:25.622913 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 18:03:25.624328 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:03:25.624304 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 18:03:25.626109 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:03:25.626086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 18:03:25.627173 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:03:25.627155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal_c163294ff817eb9bdf95e12ae1833b8b/kube-rbac-proxy-crio/2.log" Jun 03 18:06:23.841173 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:23.841096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-774499bb68-lnbgs_6bb8570b-d922-4e9f-a3ed-b6f8ddac4125/authorino/0.log" Jun 03 18:06:29.025649 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:29.025600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c696fb4c-bsfnw_cf09870b-f39d-4031-b941-91dec7933732/nginx/0.log" Jun 03 18:06:29.483675 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:29.483648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wjhjd_0258bed9-b393-4aab-9739-ad907b61c815/manager/0.log" Jun 03 18:06:29.706220 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:29.706190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675160-lphtm_c33e32c0-361d-4719-87c1-bb06596598b4/cleanup/0.log" Jun 03 18:06:29.820870 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:29.820789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd67957f9-jcksm_bec9964b-40ff-4966-a4a9-9aef7291c861/manager/0.log" Jun 03 18:06:30.151376 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:30.151299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cbbkt_c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb/copy-manifests/0.log" Jun 03 18:06:30.164302 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:30.164263 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cbbkt_c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb/manager/0.log" Jun 03 18:06:31.432019 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.431978 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/util/0.log" Jun 03 18:06:31.441054 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.441032 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/pull/0.log" Jun 03 18:06:31.448075 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.448051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/extract/0.log" Jun 03 18:06:31.564443 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.564414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/util/0.log" Jun 03 18:06:31.571370 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.571345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/pull/0.log" Jun 03 18:06:31.578200 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.578185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/extract/0.log" Jun 03 18:06:31.693249 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.693175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/util/0.log" Jun 03 18:06:31.700357 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.700328 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/pull/0.log" Jun 03 18:06:31.708765 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.708745 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/extract/0.log" Jun 03 18:06:31.874958 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.874926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/util/0.log" Jun 03 18:06:31.881474 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.881455 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/pull/0.log" Jun 03 18:06:31.888272 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:31.888251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/extract/0.log" Jun 03 18:06:32.051150 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:32.051118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-774499bb68-lnbgs_6bb8570b-d922-4e9f-a3ed-b6f8ddac4125/authorino/0.log" Jun 03 18:06:32.171174 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:32.171144 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-rntlc_7c818b59-783d-4b01-884c-1e2afe6b234f/manager/0.log" Jun 03 18:06:32.404336 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:32.404254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zw8z2_d04a4f33-059c-4fbc-8b2d-83ad4701412b/kuadrant-console-plugin/0.log" Jun 03 18:06:32.522135 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:32.522092 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tmskg_eededdf4-3a56-43af-9d37-2bb1f99201a7/registry-server/0.log" Jun 03 18:06:32.859315 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:32.859282 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-hs5wc_e5b43d40-bc16-4f5e-81d5-2ce7ede25c39/manager/0.log" Jun 03 18:06:33.318689 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:33.318662 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q_6be9e5c4-451c-4607-9729-452026a9d830/istio-proxy/0.log" Jun 03 18:06:34.554169 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.554136 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2_a591b202-4a28-4270-815f-16366ed12362/storage-initializer/0.log" Jun 03 18:06:34.565789 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.565765 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-b2sq2_a591b202-4a28-4270-815f-16366ed12362/main/0.log" Jun 03 18:06:34.709351 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.709322 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn_aaad0668-373e-44e5-a57a-7e4df5b2c85e/main/0.log" Jun 03 18:06:34.716437 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.716402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-cqnzn_aaad0668-373e-44e5-a57a-7e4df5b2c85e/storage-initializer/0.log" Jun 03 18:06:34.828026 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.827946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8_ce5d47e0-e47d-481c-b45e-248cec39f6b4/main/0.log" Jun 03 18:06:34.834320 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.834298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9s4pw8_ce5d47e0-e47d-481c-b45e-248cec39f6b4/storage-initializer/0.log" Jun 03 18:06:34.945144 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.945116 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5_00a00875-018f-4190-a54f-87713458a1d5/storage-initializer/0.log" Jun 03 18:06:34.952182 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:34.952156 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-47dj5_00a00875-018f-4190-a54f-87713458a1d5/main/0.log" Jun 03 18:06:42.489099 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:42.489068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xmltj_0cfaae00-d5b9-437f-a484-32ee3379a627/global-pull-secret-syncer/0.log" Jun 03 18:06:42.602562 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:42.602532 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h2t7m_bbad39c6-d83a-495d-9e4d-7af2fc80f440/konnectivity-agent/0.log" Jun 03 18:06:42.718413 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:42.718382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-189.ec2.internal_08d0c7f0753ab2c047bc1d790cbbe027/haproxy/0.log" Jun 03 18:06:46.033981 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.033954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/extract/0.log" Jun 03 18:06:46.059390 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.059360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/util/0.log" Jun 03 18:06:46.089950 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.089921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vcjrp_833ba47c-01ae-4ac1-84e6-6040d551e554/pull/0.log" Jun 03 18:06:46.124386 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.124358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/extract/0.log" Jun 03 18:06:46.168976 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.168945 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/util/0.log" Jun 03 18:06:46.205251 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.205224 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d6s67_be654607-9ec2-4b9b-855c-8f2e99d4baf8/pull/0.log" Jun 03 18:06:46.241814 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.241780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/extract/0.log" Jun 03 18:06:46.262703 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.262680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/util/0.log" Jun 03 18:06:46.288762 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.288686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cv9l9_e50658f1-b606-446a-99bb-9f46ef3d6012/pull/0.log" Jun 03 18:06:46.316956 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.316928 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/extract/0.log" Jun 03 18:06:46.350678 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.350648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/util/0.log" Jun 03 18:06:46.370373 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.370347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14nqsh_1cfd0251-a7ab-4af4-9080-c9586de59e34/pull/0.log" Jun 03 18:06:46.408820 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.408791 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-774499bb68-lnbgs_6bb8570b-d922-4e9f-a3ed-b6f8ddac4125/authorino/0.log" Jun 03 18:06:46.461584 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.461554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-rntlc_7c818b59-783d-4b01-884c-1e2afe6b234f/manager/0.log" Jun 03 18:06:46.536370 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.536344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zw8z2_d04a4f33-059c-4fbc-8b2d-83ad4701412b/kuadrant-console-plugin/0.log" Jun 03 18:06:46.571492 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.571399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tmskg_eededdf4-3a56-43af-9d37-2bb1f99201a7/registry-server/0.log" Jun 03 18:06:46.670702 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:46.670674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-hs5wc_e5b43d40-bc16-4f5e-81d5-2ce7ede25c39/manager/0.log" Jun 03 18:06:48.053231 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.053202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/alertmanager/0.log" Jun 03 18:06:48.089494 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.089463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/config-reloader/0.log" Jun 03 18:06:48.122371 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.122346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/kube-rbac-proxy-web/0.log" Jun 03 18:06:48.148120 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.148090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/kube-rbac-proxy/0.log" Jun 03 18:06:48.179253 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.179213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/kube-rbac-proxy-metric/0.log" Jun 03 18:06:48.205363 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.205334 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/prom-label-proxy/0.log" Jun 03 18:06:48.235385 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.235353 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc33e8db-4c98-48c0-a5d6-39e2831b63a9/init-config-reloader/0.log" Jun 03 18:06:48.510049 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.510024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrzn8_807abf3b-e9b3-4794-b9b4-930a6f5028f7/node-exporter/0.log" Jun 03 18:06:48.550565 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.550541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrzn8_807abf3b-e9b3-4794-b9b4-930a6f5028f7/kube-rbac-proxy/0.log" Jun 03 18:06:48.588053 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:48.588028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrzn8_807abf3b-e9b3-4794-b9b4-930a6f5028f7/init-textfile/0.log" Jun 03 18:06:49.321975 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:49.321945 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8df55bf4-nnwfb_30bada72-38d6-4008-883f-84e78db212cd/telemeter-client/0.log" Jun 03 18:06:49.351999 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:49.351972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8df55bf4-nnwfb_30bada72-38d6-4008-883f-84e78db212cd/reload/0.log" Jun 03 18:06:49.380094 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:49.380066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8df55bf4-nnwfb_30bada72-38d6-4008-883f-84e78db212cd/kube-rbac-proxy/0.log" Jun 03 18:06:52.533342 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.533310 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl"] Jun 03 18:06:52.533744 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.533714 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33e32c0-361d-4719-87c1-bb06596598b4" containerName="cleanup" Jun 03 18:06:52.533744 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.533727 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33e32c0-361d-4719-87c1-bb06596598b4" containerName="cleanup" Jun 03 18:06:52.533825 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.533786 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="c33e32c0-361d-4719-87c1-bb06596598b4" containerName="cleanup" Jun 03 18:06:52.537037 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.537017 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.539595 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.539572 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjbgd\"/\"default-dockercfg-wrl8k\"" Jun 03 18:06:52.539726 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.539575 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjbgd\"/\"openshift-service-ca.crt\"" Jun 03 18:06:52.540310 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.540296 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjbgd\"/\"kube-root-ca.crt\"" Jun 03 18:06:52.549738 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.549704 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl"] Jun 03 18:06:52.690812 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.690765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4glrg\" (UniqueName: \"kubernetes.io/projected/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-kube-api-access-4glrg\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.691029 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.690840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-podres\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.691029 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.690870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-sys\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.691029 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.690913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-proc\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.691029 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.690946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-lib-modules\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792347 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792244 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4glrg\" (UniqueName: \"kubernetes.io/projected/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-kube-api-access-4glrg\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792347 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792312 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-podres\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792347 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792337 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-sys\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792375 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-proc\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792396 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-lib-modules\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-podres\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-proc\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792466 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-sys\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.792659 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.792552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-lib-modules\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.800824 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.800794 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4glrg\" (UniqueName: \"kubernetes.io/projected/c7390a0f-00ca-46dc-9c40-d1e2fa572d91-kube-api-access-4glrg\") pod \"perf-node-gather-daemonset-z7lnl\" (UID: \"c7390a0f-00ca-46dc-9c40-d1e2fa572d91\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.848640 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.848587 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:52.989596 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.989566 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl"] Jun 03 18:06:52.992256 ip-10-0-128-189 kubenswrapper[2581]: W0603 18:06:52.992223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc7390a0f_00ca_46dc_9c40_d1e2fa572d91.slice/crio-6e9ed508d3d9c5ed0f764cfd2df6f9d16e12c579527bd42ad00cea38aa50d113 WatchSource:0}: Error finding container 6e9ed508d3d9c5ed0f764cfd2df6f9d16e12c579527bd42ad00cea38aa50d113: Status 404 returned error can't find the container with id 6e9ed508d3d9c5ed0f764cfd2df6f9d16e12c579527bd42ad00cea38aa50d113 Jun 03 18:06:52.994132 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:52.994109 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 18:06:53.419519 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.419417 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5sgh_a50a763d-0483-4cef-83ba-d619b78a1ca4/dns/0.log" Jun 03 18:06:53.438026 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.437999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5sgh_a50a763d-0483-4cef-83ba-d619b78a1ca4/kube-rbac-proxy/0.log" Jun 03 18:06:53.478325 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.478295 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9w5p9_2d87b3ce-123d-42d5-b1e1-1fb0efaff8bd/dns-node-resolver/0.log" Jun 03 18:06:53.999635 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.999603 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" event={"ID":"c7390a0f-00ca-46dc-9c40-d1e2fa572d91","Type":"ContainerStarted","Data":"ad3f8bd58f14949947f5647e02e609537c1b7a789122db682da49716f7b0b340"} Jun 03 18:06:53.999635 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.999639 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" event={"ID":"c7390a0f-00ca-46dc-9c40-d1e2fa572d91","Type":"ContainerStarted","Data":"6e9ed508d3d9c5ed0f764cfd2df6f9d16e12c579527bd42ad00cea38aa50d113"} Jun 03 18:06:54.000103 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:53.999663 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:06:54.015926 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:54.015870 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" podStartSLOduration=2.015856236 podStartE2EDuration="2.015856236s" podCreationTimestamp="2026-06-03 18:06:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 18:06:54.013841605 +0000 UTC m=+1108.883140260" watchObservedRunningTime="2026-06-03 18:06:54.015856236 +0000 UTC m=+1108.885154829" Jun 03 18:06:54.035577 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:54.035547 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hnvmc_79b1ea21-d80d-41a4-bc4c-190f6ff33fa4/node-ca/0.log" Jun 03 18:06:54.833415 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:54.833373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbcg4q_6be9e5c4-451c-4607-9729-452026a9d830/istio-proxy/0.log" Jun 03 18:06:55.541116 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:55.541081 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzp87_5f5984a7-272a-4537-b05e-772fb2c5c620/serve-healthcheck-canary/0.log" Jun 03 18:06:56.101111 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:56.101083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5kmd_5fdcd7d0-868c-460f-aa3d-68615e65881b/kube-rbac-proxy/0.log" Jun 03 18:06:56.120677 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:56.120645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5kmd_5fdcd7d0-868c-460f-aa3d-68615e65881b/exporter/0.log" Jun 03 18:06:56.140040 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:56.140007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5kmd_5fdcd7d0-868c-460f-aa3d-68615e65881b/extractor/0.log" Jun 03 18:06:58.160966 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.160925 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c696fb4c-bsfnw_cf09870b-f39d-4031-b941-91dec7933732/nginx/0.log" Jun 03 18:06:58.242243 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.242199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wjhjd_0258bed9-b393-4aab-9739-ad907b61c815/manager/0.log" Jun 03 18:06:58.290260 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.290227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675160-lphtm_c33e32c0-361d-4719-87c1-bb06596598b4/cleanup/0.log" Jun 03 18:06:58.318218 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.318185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd67957f9-jcksm_bec9964b-40ff-4966-a4a9-9aef7291c861/manager/0.log" Jun 03 18:06:58.452128 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.452036 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cbbkt_c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb/manager/0.log" Jun 03 18:06:58.467213 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:58.467186 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cbbkt_c9e892a6-d2e6-440e-b7fe-ca7f72a1ccdb/copy-manifests/0.log" Jun 03 18:06:59.877150 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:59.877120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-854dd8479f-797kl_b118e409-27ee-4b92-a73a-fbf60e1d4a11/manager/0.log" Jun 03 18:06:59.924615 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:06:59.924585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-8nndd_fc4ccb50-6cf5-42cc-9a78-6afee026a4ac/openshift-lws-operator/0.log" Jun 03 18:07:00.015324 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:00.015298 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-z7lnl" Jun 03 18:07:06.578624 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.578593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/kube-multus-additional-cni-plugins/0.log" Jun 03 18:07:06.599909 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.599879 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/egress-router-binary-copy/0.log" Jun 03 18:07:06.620410 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.620380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/cni-plugins/0.log" Jun 03 18:07:06.639090 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.639058 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/bond-cni-plugin/0.log" Jun 03 18:07:06.659219 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.659194 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/routeoverride-cni/0.log" Jun 03 18:07:06.679221 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.679190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/whereabouts-cni-bincopy/0.log" Jun 03 18:07:06.699407 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.699376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzrpg_3326f203-72a2-4385-aa72-a925db2102be/whereabouts-cni/0.log" Jun 03 18:07:06.728723 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.728686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bxsdg_8fc84847-ca50-41bb-8d18-e74dab983fcc/kube-multus/0.log" Jun 03 18:07:06.884501 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.884427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r68wz_4d3d51f1-576f-4969-871a-f4443810e201/network-metrics-daemon/0.log" Jun 03 18:07:06.902625 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:06.902598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r68wz_4d3d51f1-576f-4969-871a-f4443810e201/kube-rbac-proxy/0.log" Jun 03 18:07:08.230248 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.230217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-controller/0.log" Jun 03 18:07:08.245220 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.245166 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/0.log" Jun 03 18:07:08.251160 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.251130 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovn-acl-logging/1.log" Jun 03 18:07:08.267213 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.267167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/kube-rbac-proxy-node/0.log" Jun 03 18:07:08.286488 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.286462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 18:07:08.306291 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.306263 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/northd/0.log" Jun 03 18:07:08.325777 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.325749 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/nbdb/0.log" Jun 03 18:07:08.344450 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.344403 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/sbdb/0.log" Jun 03 18:07:08.450587 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:08.450484 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwrvm_c81e4996-c6e6-4cf1-9c47-e14cb9ece9c9/ovnkube-controller/0.log" Jun 03 18:07:09.592420 ip-10-0-128-189 kubenswrapper[2581]: I0603 18:07:09.592391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4kxzh_ecadf230-c02f-47fc-96ee-ef141792672c/network-check-target-container/0.log"