Jun 03 19:27:49.297903 ip-10-0-133-145 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 19:27:49.297911 ip-10-0-133-145 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 19:27:49.297918 ip-10-0-133-145 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 19:27:49.298072 ip-10-0-133-145 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 19:27:59.444043 ip-10-0-133-145 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 19:27:59.444059 ip-10-0-133-145 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dfa7000dec274de983daa17c8a408f63 -- Jun 03 19:30:35.171605 ip-10-0-133-145 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:30:35.632160 ip-10-0-133-145 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:35.632160 ip-10-0-133-145 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:30:35.632160 ip-10-0-133-145 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:35.632160 ip-10-0-133-145 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:30:35.632160 ip-10-0-133-145 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:30:35.633277 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.633186 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:30:35.638051 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638037 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.638051 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638051 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638054 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638058 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638062 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638065 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638068 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638071 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638074 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638078 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638082 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638084 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638087 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638090 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638092 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638095 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638098 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638100 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638108 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638111 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638114 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.638116 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638117 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638120 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638123 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638125 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638128 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638131 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638134 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638136 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638139 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638142 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638145 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638147 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638150 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638152 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638155 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638157 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638160 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638163 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638166 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638168 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.638608 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638171 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638173 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638176 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638178 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638182 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638186 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638188 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638192 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638194 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638197 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638200 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638202 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638206 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638209 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638212 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638215 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638218 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638221 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638225 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.639088 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638229 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638232 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638248 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638251 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638254 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638257 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638259 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638262 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638265 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638267 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638270 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638274 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638277 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638279 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638282 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638285 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638287 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638290 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638292 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638296 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.639572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638299 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638301 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638304 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638306 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638309 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638311 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638314 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638319 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638323 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638326 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638329 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638331 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638334 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638337 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638339 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638342 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638344 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.638347 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639873 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.640052 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639879 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639883 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639885 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639888 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639891 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639894 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639897 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639899 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639902 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639905 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639908 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639910 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639913 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639916 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639918 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639921 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639924 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639926 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639929 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.640566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639933 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639938 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639941 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639944 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639947 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639950 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639952 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639955 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639957 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639960 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639963 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639965 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639969 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639971 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639974 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639976 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639979 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639981 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639985 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639988 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.641025 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639990 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639993 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639996 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.639998 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640001 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640003 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640006 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640008 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640011 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640014 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640016 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640019 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640021 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640025 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640028 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640030 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640033 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640036 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640038 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640041 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.641542 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640043 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640046 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640049 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640052 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640054 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640057 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640060 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640062 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640065 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640067 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640070 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640073 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640078 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640082 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640085 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640087 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640090 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640093 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640096 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.642033 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640099 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640101 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640104 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640106 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640109 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640112 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640115 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640118 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640121 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640123 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640126 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640130 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640133 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640136 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640139 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640142 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640144 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640147 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640150 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640548 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.642511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640554 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640557 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640560 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640562 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640565 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640568 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640571 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640574 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640577 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640579 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640582 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640585 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640587 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640590 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640601 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640604 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640607 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640609 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640612 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640615 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.642998 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640619 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640623 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640626 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640628 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640631 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640634 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640636 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640639 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640642 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640644 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640647 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640649 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640651 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640654 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640657 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640659 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640662 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640664 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640672 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640675 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.643572 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640681 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640684 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640687 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640690 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640693 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640696 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640699 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640702 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640705 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640707 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640709 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640712 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640714 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640717 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640719 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640722 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640724 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640727 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640729 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.644065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640732 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640734 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640739 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640742 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640745 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640748 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640751 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640753 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640756 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640758 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640761 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640763 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640771 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640775 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640778 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640781 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640786 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640789 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640792 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640795 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.644562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640798 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640800 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640803 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640805 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640808 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640810 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640813 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640816 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640818 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640821 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640823 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640826 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640828 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640831 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640833 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640836 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640838 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.640841 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640909 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640916 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640923 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:30:35.645045 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640929 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640935 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640940 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640946 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640958 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640962 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640966 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640981 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640985 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640989 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640992 2573 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640995 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.640999 2573 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641002 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641005 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641014 2573 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641017 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641020 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641023 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641026 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641030 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641034 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641037 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:30:35.645607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641041 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641044 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641047 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641049 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641052 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641055 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641059 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641062 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641065 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641068 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641071 2573 flags.go:64] FLAG: --enable-server="true" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641074 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641080 2573 flags.go:64] FLAG: --event-burst="100" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641084 2573 flags.go:64] FLAG: --event-qps="50" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641089 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641093 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641096 2573 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641099 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641102 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641105 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641108 2573 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641111 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641113 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641116 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641119 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:30:35.646156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641122 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641125 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641128 2573 flags.go:64] FLAG: --feature-gates="" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641131 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641134 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641137 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641140 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641143 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641146 2573 flags.go:64] FLAG: --help="false" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641148 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641151 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641154 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641157 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641160 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641163 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641166 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641169 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641172 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641174 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641177 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641182 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641184 2573 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641189 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641191 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:30:35.646812 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641195 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641198 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641200 2573 flags.go:64] FLAG: --lock-file="" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641203 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641206 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641209 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641214 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641217 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641220 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641223 2573 flags.go:64] FLAG: --logging-format="text" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641225 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641229 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641232 2573 flags.go:64] FLAG: --manifest-url="" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641246 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641251 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641254 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641257 2573 flags.go:64] FLAG: --max-pods="110" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641260 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641263 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641266 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641269 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641272 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641275 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641278 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641284 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:30:35.647606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641287 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641290 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641293 2573 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641297 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641303 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641307 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641311 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641314 2573 flags.go:64] FLAG: --port="10250" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641317 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641320 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031dc87295fa38611" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641323 2573 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641326 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641329 2573 flags.go:64] FLAG: --register-node="true" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641331 2573 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641335 2573 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641338 2573 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641341 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641343 2573 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641347 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641350 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641353 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641356 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641358 2573 flags.go:64] FLAG: --runonce="false" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641361 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641364 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:30:35.648701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641367 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641369 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641372 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641375 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641378 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641381 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641383 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641386 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641389 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641392 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641395 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641400 2573 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641404 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641409 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641413 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641415 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641420 2573 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641423 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641425 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641428 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641431 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641433 2573 flags.go:64] FLAG: --v="2" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641437 2573 flags.go:64] FLAG: --version="false" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641441 2573 flags.go:64] FLAG: --vmodule="" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641445 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:30:35.649659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641448 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641561 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641564 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641567 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641570 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641573 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641575 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641579 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641584 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641587 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641590 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641593 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641595 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641598 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641601 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641603 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641606 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641608 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641611 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641615 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.650310 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641617 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641620 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641623 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641626 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641628 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641631 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641634 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641636 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641639 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641642 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641644 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641646 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641649 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641651 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641654 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641656 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641659 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641661 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641664 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641666 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.651154 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641669 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641671 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641674 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641676 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641679 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641681 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641684 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641688 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641692 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641694 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641697 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641701 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641703 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641706 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641709 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641713 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641715 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641718 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641720 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.652017 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641723 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641726 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641728 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641731 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641733 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641736 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641738 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641741 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641743 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641746 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641748 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641751 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641753 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641756 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641758 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641761 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641763 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641766 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641768 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641771 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.652678 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641774 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641776 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641778 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641781 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641784 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641786 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641789 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641791 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641794 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641797 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641800 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641802 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641805 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641809 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641812 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641815 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641818 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641821 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641823 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.653164 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.641826 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.641831 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.649407 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.649425 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.650342 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.650355 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650441 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650449 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650455 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650460 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650465 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650469 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650473 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650478 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.653727 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650483 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650487 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650491 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650496 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650500 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650504 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650508 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650515 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650522 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650527 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650532 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650536 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650541 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650546 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650550 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650555 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650559 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650564 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650571 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.654077 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650577 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650582 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650588 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650593 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650598 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650603 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650607 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650611 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650616 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650620 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650625 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650629 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650634 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650638 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650642 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650646 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650650 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650655 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650659 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650663 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.654578 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650667 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650672 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650676 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650681 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650685 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650689 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650694 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650698 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650702 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650706 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650710 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650714 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650718 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650724 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650728 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650733 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650737 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650741 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650746 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650750 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.655065 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650754 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650758 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650762 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650766 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650771 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650775 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650779 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650785 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650791 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650795 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650799 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650804 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650809 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650814 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650818 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650822 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650826 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650830 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650834 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.655565 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650838 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650842 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650846 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650850 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650854 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650859 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650863 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650867 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650871 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650876 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650881 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.650885 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.650893 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651404 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651421 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:30:35.656069 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651427 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651432 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651437 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651442 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651447 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651452 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651457 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651462 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651466 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651471 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651476 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651486 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651491 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651495 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651501 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651506 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651510 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651515 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651519 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:30:35.656474 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651524 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651529 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651534 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651539 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651549 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651553 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651558 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651563 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651568 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651573 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651580 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651587 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651592 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651597 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651602 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651606 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651610 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651622 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651626 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651631 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:30:35.656939 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651635 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651640 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651645 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651649 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651654 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651659 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651663 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651668 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651673 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651677 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651686 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651691 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651695 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651700 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651704 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651709 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651716 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651722 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:30:35.657463 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651729 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651734 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651739 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651745 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651756 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651761 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651766 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651772 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651777 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651782 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651787 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651792 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651797 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651802 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651806 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651812 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651822 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651827 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651831 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651836 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:30:35.657895 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651840 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651845 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651850 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651855 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651860 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651864 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651869 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651874 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651884 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651888 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651893 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651898 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651903 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651907 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651912 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651917 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651922 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651927 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:30:35.658396 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:35.651932 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.651940 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.652377 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.655611 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.657293 2573 server.go:1019] "Starting client certificate rotation" Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.657388 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:30:35.658825 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.657419 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:30:35.660271 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.660257 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:30:35.661650 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.661595 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:30:35.670790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.670775 2573 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:30:35.674815 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.674802 2573 log.go:25] "Validated CRI v1 image API" Jun 03 19:30:35.675567 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.675554 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:30:35.678159 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.678139 2573 fs.go:135] Filesystem UUIDs: map[6d1a65da-e53d-4fe7-8f47-eb6844a8d1ee:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 abe7c220-cf79-4615-b08e-d794be0d8f6a:/dev/nvme0n1p3] Jun 03 19:30:35.678204 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.678160 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:30:35.684827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.684719 2573 manager.go:216] Machine: {Timestamp:2026-06-03 19:30:35.683408586 +0000 UTC m=+0.379264295 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100285 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f4e723fb0936bfdae5ae800f2230 SystemUUID:ec28f4e7-23fb-0936-bfda-e5ae800f2230 BootID:dfa7000d-ec27-4de9-83da-a17c8a408f63 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:ec:76:0a:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:ec:76:0a:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:83:ba:a4:a0:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:30:35.684827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.684819 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:30:35.684943 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.684889 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:30:35.685365 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.685345 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:30:35.686018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.685990 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:30:35.686140 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.686023 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:30:35.686809 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.686799 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:30:35.686846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.686811 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:30:35.686846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.686819 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:30:35.686846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.686832 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:30:35.688140 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.688130 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:30:35.692676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692665 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:30:35.692929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692919 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:30:35.692957 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692950 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:30:35.692989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692961 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:30:35.692989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692976 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:30:35.692989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.692984 2573 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:30:35.693121 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.693054 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:30:35.693585 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.693563 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:30:35.693662 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.693596 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:30:35.696401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.696382 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:30:35.698734 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.698714 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:30:35.698816 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.698746 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:30:35.700082 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700071 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700086 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700092 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700098 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700107 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700113 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700121 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700126 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700132 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700138 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700152 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:30:35.700187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700157 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:30:35.700997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700988 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:30:35.700997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.700997 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:30:35.704410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.704396 2573 server.go:1268] "Started kubelet" Jun 03 19:30:35.704504 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.704457 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:30:35.704504 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.704471 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:30:35.704504 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.704439 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:30:35.704504 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.704487 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:30:35.704665 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.704585 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:30:35.704665 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.704623 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:30:35.706000 ip-10-0-133-145 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:30:35.707770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.707757 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:30:35.709137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.709120 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:30:35.710272 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.709142 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-145.ec2.internal.18b5a8fdcc66ac96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-145.ec2.internal,UID:ip-10-0-133-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-145.ec2.internal,},FirstTimestamp:2026-06-03 19:30:35.704372374 +0000 UTC m=+0.400228130,LastTimestamp:2026-06-03 19:30:35.704372374 +0000 UTC m=+0.400228130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-145.ec2.internal,}" Jun 03 19:30:35.713217 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.713193 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:30:35.715830 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.715815 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:30:35.715894 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.715832 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:30:35.715947 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.715912 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:35.716633 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.716608 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:30:35.716719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.716660 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:30:35.716719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.716672 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:30:35.716823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.716802 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:30:35.716823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.716811 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717835 2573 factory.go:153] Registering CRI-O factory Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717851 2573 factory.go:223] Registration of the crio container factory successfully Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717895 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717903 2573 factory.go:55] Registering systemd factory Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717911 2573 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717929 2573 factory.go:103] Registering Raw factory Jun 03 19:30:35.718089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.717944 2573 manager.go:1196] Started watching for new ooms in manager Jun 03 19:30:35.719565 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.719549 2573 manager.go:349] Starting recovery of all containers Jun 03 19:30:35.728640 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.728495 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:30:35.728762 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.728585 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:30:35.730205 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.730182 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8wnbx" Jun 03 19:30:35.730784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.730771 2573 manager.go:354] Recovery completed Jun 03 19:30:35.734694 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.734681 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.736481 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736460 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.736557 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736498 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.736557 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736512 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.736993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736976 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:30:35.736993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736991 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:30:35.737132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.737008 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:30:35.737132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.736992 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.737627 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.737613 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8wnbx" Jun 03 19:30:35.737720 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.737705 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.737771 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.737733 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.737771 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.737743 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.739124 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.739111 2573 policy_none.go:49] "None policy: Start" Jun 03 19:30:35.739124 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.739126 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:30:35.739214 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.739140 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:30:35.740826 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.740814 2573 policy_none.go:47] "Start" Jun 03 19:30:35.777858 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.777843 2573 manager.go:337] "Starting Device Plugin manager" Jun 03 19:30:35.777946 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.777876 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:30:35.777946 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.777888 2573 server.go:87] "Starting device plugin registration server" Jun 03 19:30:35.778105 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.778091 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:30:35.778199 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.778106 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:30:35.778266 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.778219 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:30:35.778316 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.778301 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:30:35.778316 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.778309 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:30:35.778724 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.778705 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:30:35.778802 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.778753 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:35.793688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.793659 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:30:35.802546 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.794714 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:30:35.802546 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.794757 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:30:35.802546 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.794781 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:30:35.802546 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.794819 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:30:35.802546 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.796892 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:35.878888 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.878874 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.879620 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.879605 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.879699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.879635 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.879699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.879649 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.879699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.879674 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.889515 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.889471 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.889515 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.889491 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-145.ec2.internal\": node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:35.895792 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.895770 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal"] Jun 03 19:30:35.895866 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.895824 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.897481 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.897466 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.897562 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.897495 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.897562 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.897510 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.899975 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.899961 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.900065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.900110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900079 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.900735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900720 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.900735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900728 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.900873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900751 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.900873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900765 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.900873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900791 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.900873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.900808 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.902999 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.902983 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.903065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.903011 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:30:35.903668 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.903652 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:30:35.903743 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.903679 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:30:35.903743 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.903692 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:30:35.910644 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.910629 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:35.917841 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.917822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.917948 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.917844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.917948 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:35.917861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/320fd542d1a0a5133cb1d86dfcc2a9af-config\") pod \"kube-apiserver-proxy-ip-10-0-133-145.ec2.internal\" (UID: \"320fd542d1a0a5133cb1d86dfcc2a9af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.922762 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.922747 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-145.ec2.internal\" not found" node="ip-10-0-133-145.ec2.internal" Jun 03 19:30:35.926770 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:35.926755 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-145.ec2.internal\" not found" node="ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.011456 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.011426 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.018766 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.018843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.018843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.018921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/320fd542d1a0a5133cb1d86dfcc2a9af-config\") pod \"kube-apiserver-proxy-ip-10-0-133-145.ec2.internal\" (UID: \"320fd542d1a0a5133cb1d86dfcc2a9af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.018921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/320fd542d1a0a5133cb1d86dfcc2a9af-config\") pod \"kube-apiserver-proxy-ip-10-0-133-145.ec2.internal\" (UID: \"320fd542d1a0a5133cb1d86dfcc2a9af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.018921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.018881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a8817bc8687d8308f65b4a0df424e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal\" (UID: \"03a8817bc8687d8308f65b4a0df424e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.111927 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.111901 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.212719 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.212663 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.227088 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.227070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.233534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.233519 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:36.312809 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.312775 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.413309 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.413285 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.513920 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.513852 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.614466 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.614438 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.655936 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.655909 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:30:36.656526 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.656105 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:30:36.675326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.675307 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:36.714938 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.714913 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.741159 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.741124 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:25:35 +0000 UTC" deadline="2027-11-11 08:58:17.942346248 +0000 UTC" Jun 03 19:30:36.741273 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.741164 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12613h27m41.201193201s" Jun 03 19:30:36.772567 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:36.772512 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a8817bc8687d8308f65b4a0df424e5.slice/crio-3b5bcba5a134864bdb767ec8cb8927cf041e1fb20f54c0ae386d26da0e863719 WatchSource:0}: Error finding container 3b5bcba5a134864bdb767ec8cb8927cf041e1fb20f54c0ae386d26da0e863719: Status 404 returned error can't find the container with id 3b5bcba5a134864bdb767ec8cb8927cf041e1fb20f54c0ae386d26da0e863719 Jun 03 19:30:36.773049 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:36.773029 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320fd542d1a0a5133cb1d86dfcc2a9af.slice/crio-928350f69acdc35a4b99498d1f68de36e56eed53a19d8381d9fc30ceae93a8a5 WatchSource:0}: Error finding container 928350f69acdc35a4b99498d1f68de36e56eed53a19d8381d9fc30ceae93a8a5: Status 404 returned error can't find the container with id 928350f69acdc35a4b99498d1f68de36e56eed53a19d8381d9fc30ceae93a8a5 Jun 03 19:30:36.781016 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.780999 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:30:36.797932 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.797890 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" event={"ID":"320fd542d1a0a5133cb1d86dfcc2a9af","Type":"ContainerStarted","Data":"928350f69acdc35a4b99498d1f68de36e56eed53a19d8381d9fc30ceae93a8a5"} Jun 03 19:30:36.798958 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.798934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" event={"ID":"03a8817bc8687d8308f65b4a0df424e5","Type":"ContainerStarted","Data":"3b5bcba5a134864bdb767ec8cb8927cf041e1fb20f54c0ae386d26da0e863719"} Jun 03 19:30:36.815036 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.815017 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.915492 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:36.915474 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-145.ec2.internal\" not found" Jun 03 19:30:36.953310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:36.953288 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:37.016272 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.016233 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" Jun 03 19:30:37.023893 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.023839 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:30:37.025764 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.025752 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" Jun 03 19:30:37.035960 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.035941 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:30:37.199636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.199606 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:37.694799 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.694765 2573 apiserver.go:52] "Watching apiserver" Jun 03 19:30:37.702111 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.702076 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:30:37.702555 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.702527 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4dhdg","openshift-multus/multus-additional-cni-plugins-vdhr9","openshift-network-diagnostics/network-check-target-4g7l2","openshift-network-operator/iptables-alerter-thqxm","kube-system/konnectivity-agent-762t7","kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mfmsm","openshift-image-registry/node-ca-cm7lm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal","openshift-multus/multus-4669k","openshift-multus/network-metrics-daemon-77lpm","openshift-ovn-kubernetes/ovnkube-node-d9sbz","kube-system/global-pull-secret-syncer-6p4tr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs"] Jun 03 19:30:37.705282 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.705233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.707827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.707547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.707827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.707648 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:30:37.707827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.707656 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:30:37.707827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.707669 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8tcvl\"" Jun 03 19:30:37.710261 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.709663 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.710261 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.710006 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.710261 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.710173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:30:37.710763 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.710539 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.710763 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.710575 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cdlvp\"" Jun 03 19:30:37.710763 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.710603 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:37.712140 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.711807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.713859 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.713839 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.714369 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.714084 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.714436 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.714411 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h95s7\"" Jun 03 19:30:37.714677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.714661 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.716270 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.716233 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.716361 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.716294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.718169 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.716632 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:30:37.718169 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.717068 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lpfkx\"" Jun 03 19:30:37.718169 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.717336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.720663 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.719326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.720663 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.719707 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.721712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.721049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j9qqb\"" Jun 03 19:30:37.721712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.721163 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:30:37.721712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.721162 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.721712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.721289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4669k" Jun 03 19:30:37.721712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.721311 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mwj7b\"" Jun 03 19:30:37.722213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.722192 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:30:37.722384 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.722227 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.722820 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.722802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.723786 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.723764 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tzxpq\"" Jun 03 19:30:37.723888 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.723791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:37.723888 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.723845 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:37.725071 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.724551 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:30:37.725071 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.724798 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:30:37.725233 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.725091 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.725233 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.725114 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.726705 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-registration-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.726784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-device-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.726784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.726784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726755 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.726784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysconfig\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-run\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-etc-tuned\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-kubernetes\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-var-lib-kubelet\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgk62\" (UniqueName: \"kubernetes.io/projected/dbaecb1e-f61d-4783-a091-6b4803679001-kube-api-access-bgk62\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb1fc591-025d-40f7-8b8c-c33b92125a66-serviceca\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-socket-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa3f6443-6c02-4091-a04b-054ca3683d30-hosts-file\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.726987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8vv\" (UniqueName: \"kubernetes.io/projected/fa3f6443-6c02-4091-a04b-054ca3683d30-kube-api-access-9j8vv\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.727002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b153b22-fd10-428a-8daf-4bfe23079226-konnectivity-ca\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c44c91c-f288-4089-9075-eaa375c7dff4-iptables-alerter-script\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chr86\" (UniqueName: \"kubernetes.io/projected/5c44c91c-f288-4089-9075-eaa375c7dff4-kube-api-access-chr86\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-systemd\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3f6443-6c02-4091-a04b-054ca3683d30-tmp-dir\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdr7c\" (UniqueName: \"kubernetes.io/projected/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-kube-api-access-xdr7c\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-conf\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-lib-modules\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b153b22-fd10-428a-8daf-4bfe23079226-agent-certs\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-sys-fs\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvwdl\" (UniqueName: \"kubernetes.io/projected/fb1fc591-025d-40f7-8b8c-c33b92125a66-kube-api-access-jvwdl\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrrb\" (UniqueName: \"kubernetes.io/projected/e92270f1-35ed-4159-aaf5-41914fb4f65b-kube-api-access-7wrrb\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c44c91c-f288-4089-9075-eaa375c7dff4-host-slash\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-modprobe-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.727544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-sys\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.728361 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-host\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.728361 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-tmp\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.728361 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.727604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb1fc591-025d-40f7-8b8c-c33b92125a66-host\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.728878 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.728856 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:30:37.728966 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.728891 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:30:37.729294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.729105 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:30:37.729294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.729222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.729448 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.729298 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:37.729841 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.729797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7tgkh\"" Jun 03 19:30:37.729929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.729840 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:30:37.729929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.729855 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:30:37.730085 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.730067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:30:37.731820 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.731801 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.732994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.732937 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:30:37.733902 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.733852 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:30:37.734298 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.734133 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:30:37.734298 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.734177 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8dvl\"" Jun 03 19:30:37.749699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.749677 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tzdb" Jun 03 19:30:37.756836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.756818 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tzdb" Jun 03 19:30:37.817604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.817580 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:30:37.828065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-env-overrides\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-systemd\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3f6443-6c02-4091-a04b-054ca3683d30-tmp-dir\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cnibin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-os-release\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cni-binary-copy\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828191 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-systemd\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.828217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-k8s-cni-cncf-io\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-sys-fs\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrrb\" (UniqueName: \"kubernetes.io/projected/e92270f1-35ed-4159-aaf5-41914fb4f65b-kube-api-access-7wrrb\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-kubelet-config\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-bin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-sys-fs\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-netd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-script-lib\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75gjf\" (UniqueName: \"kubernetes.io/projected/9f7d172d-80a2-4ced-9dfd-b2da531e7227-kube-api-access-75gjf\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-tmp\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb1fc591-025d-40f7-8b8c-c33b92125a66-host\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-kubelet\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-systemd-units\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.828570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3f6443-6c02-4091-a04b-054ca3683d30-tmp-dir\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828595 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb1fc591-025d-40f7-8b8c-c33b92125a66-host\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-slash\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.828988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-os-release\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829038 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysconfig\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-run\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-multus\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysconfig\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-kubelet\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.829158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829142 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:30:37.829601 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.829209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-run\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.830392 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovn-node-metrics-cert\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830502 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-system-cni-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.830556 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb1fc591-025d-40f7-8b8c-c33b92125a66-serviceca\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.830556 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c44c91c-f288-4089-9075-eaa375c7dff4-iptables-alerter-script\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.830651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-system-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.830651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-netns\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-etc-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chr86\" (UniqueName: \"kubernetes.io/projected/5c44c91c-f288-4089-9075-eaa375c7dff4-kube-api-access-chr86\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.830791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-var-lib-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-config\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-netns\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-bin\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cnibin\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq75k\" (UniqueName: \"kubernetes.io/projected/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-kube-api-access-qq75k\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb1fc591-025d-40f7-8b8c-c33b92125a66-serviceca\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.830971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.830945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdr7c\" (UniqueName: \"kubernetes.io/projected/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-kube-api-access-xdr7c\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-conf\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.831046 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-lib-modules\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b153b22-fd10-428a-8daf-4bfe23079226-agent-certs\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.831125 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:38.331103996 +0000 UTC m=+3.026959713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-etc-kubernetes\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvwdl\" (UniqueName: \"kubernetes.io/projected/fb1fc591-025d-40f7-8b8c-c33b92125a66-kube-api-access-jvwdl\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.831294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c44c91c-f288-4089-9075-eaa375c7dff4-host-slash\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.831767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-lib-modules\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.831767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.831767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831723 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-conf\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.831915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-ovn\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.831915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-log-socket\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.831915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831865 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c44c91c-f288-4089-9075-eaa375c7dff4-host-slash\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.831915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831941 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c44c91c-f288-4089-9075-eaa375c7dff4-iptables-alerter-script\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.831977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-modprobe-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-sys\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-host\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-modprobe-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832116 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-sys\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-host\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-registration-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-device-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.832417 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-dbus\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-daemon-config\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-multus-certs\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpf84\" (UniqueName: \"kubernetes.io/projected/525d846b-c6fa-4b54-bf97-cf9e2f594a69-kube-api-access-xpf84\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-etc-tuned\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-socket-dir-parent\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-kubernetes\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832648 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-registration-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.832765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832707 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-var-lib-kubelet\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-var-lib-kubelet\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-tmp\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgk62\" (UniqueName: \"kubernetes.io/projected/dbaecb1e-f61d-4783-a091-6b4803679001-kube-api-access-bgk62\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-socket-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-kubernetes\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa3f6443-6c02-4091-a04b-054ca3683d30-hosts-file\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8vv\" (UniqueName: \"kubernetes.io/projected/fa3f6443-6c02-4091-a04b-054ca3683d30-kube-api-access-9j8vv\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-conf-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.832998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbaecb1e-f61d-4783-a091-6b4803679001-etc-sysctl-d\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b153b22-fd10-428a-8daf-4bfe23079226-konnectivity-ca\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa3f6443-6c02-4091-a04b-054ca3683d30-hosts-file\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.833231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-hostroot\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.833859 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-socket-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.833859 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e92270f1-35ed-4159-aaf5-41914fb4f65b-device-dir\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.833859 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-systemd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.833859 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.833571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-node-log\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.834954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.834679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b153b22-fd10-428a-8daf-4bfe23079226-konnectivity-ca\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.835152 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.835114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b153b22-fd10-428a-8daf-4bfe23079226-agent-certs\") pod \"konnectivity-agent-762t7\" (UID: \"4b153b22-fd10-428a-8daf-4bfe23079226\") " pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:37.835373 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.835228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbaecb1e-f61d-4783-a091-6b4803679001-etc-tuned\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.836654 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.836636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrrb\" (UniqueName: \"kubernetes.io/projected/e92270f1-35ed-4159-aaf5-41914fb4f65b-kube-api-access-7wrrb\") pod \"aws-ebs-csi-driver-node-2vmcs\" (UID: \"e92270f1-35ed-4159-aaf5-41914fb4f65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:37.839153 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.839127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvwdl\" (UniqueName: \"kubernetes.io/projected/fb1fc591-025d-40f7-8b8c-c33b92125a66-kube-api-access-jvwdl\") pod \"node-ca-cm7lm\" (UID: \"fb1fc591-025d-40f7-8b8c-c33b92125a66\") " pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:37.843213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.843165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chr86\" (UniqueName: \"kubernetes.io/projected/5c44c91c-f288-4089-9075-eaa375c7dff4-kube-api-access-chr86\") pod \"iptables-alerter-thqxm\" (UID: \"5c44c91c-f288-4089-9075-eaa375c7dff4\") " pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:37.843213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.843204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdr7c\" (UniqueName: \"kubernetes.io/projected/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-kube-api-access-xdr7c\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:37.843977 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.843958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8vv\" (UniqueName: \"kubernetes.io/projected/fa3f6443-6c02-4091-a04b-054ca3683d30-kube-api-access-9j8vv\") pod \"node-resolver-4dhdg\" (UID: \"fa3f6443-6c02-4091-a04b-054ca3683d30\") " pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:37.844433 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.844401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgk62\" (UniqueName: \"kubernetes.io/projected/dbaecb1e-f61d-4783-a091-6b4803679001-kube-api-access-bgk62\") pod \"tuned-mfmsm\" (UID: \"dbaecb1e-f61d-4783-a091-6b4803679001\") " pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:37.935249 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-multus\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-kubelet\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovn-node-metrics-cert\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-system-cni-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-system-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-multus\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-netns\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-kubelet\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-etc-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-var-lib-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-netns\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-system-cni-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935453 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-config\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-etc-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-var-lib-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-system-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-netns\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-bin\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cnibin\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-netns\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq75k\" (UniqueName: \"kubernetes.io/projected/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-kube-api-access-qq75k\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-etc-kubernetes\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.935852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-ovn\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935718 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-bin\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-log-socket\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cnibin\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-openvswitch\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-dbus\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935945 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-config\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-daemon-config\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.935993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-multus-certs\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpf84\" (UniqueName: \"kubernetes.io/projected/525d846b-c6fa-4b54-bf97-cf9e2f594a69-kube-api-access-xpf84\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-dbus\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.936671 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-socket-dir-parent\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-etc-kubernetes\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-conf-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-hostroot\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-systemd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-node-log\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-env-overrides\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936324 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-conf-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-ovn\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936387 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-socket-dir-parent\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-run-systemd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936470 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-hostroot\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-log-socket\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-node-log\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-multus-certs\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.936588 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cnibin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.937534 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.936644 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:38.436625421 +0000 UTC m=+3.132481119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-daemon-config\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-os-release\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cnibin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cni-binary-copy\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-os-release\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-k8s-cni-cncf-io\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-multus-cni-dir\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-run-k8s-cni-cncf-io\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.936980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-kubelet-config\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-bin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df90e458-d4ec-408a-84af-e78b50a9de78-kubelet-config\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-netd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-script-lib\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75gjf\" (UniqueName: \"kubernetes.io/projected/9f7d172d-80a2-4ced-9dfd-b2da531e7227-kube-api-access-75gjf\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.938355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937183 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-kubelet\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-env-overrides\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-systemd-units\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/525d846b-c6fa-4b54-bf97-cf9e2f594a69-cni-binary-copy\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-slash\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-os-release\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-os-release\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-kubelet\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-systemd-units\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-slash\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937494 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f7d172d-80a2-4ced-9dfd-b2da531e7227-host-cni-netd\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/525d846b-c6fa-4b54-bf97-cf9e2f594a69-host-var-lib-cni-bin\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937649 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovnkube-script-lib\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.939227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.937986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f7d172d-80a2-4ced-9dfd-b2da531e7227-ovn-node-metrics-cert\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.942518 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.942497 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:37.942518 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.942521 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:37.942681 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.942534 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:37.942681 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:37.942590 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:38.442578093 +0000 UTC m=+3.138433790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:37.942919 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.942903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq75k\" (UniqueName: \"kubernetes.io/projected/ec73668e-d4f7-4a21-96e1-7c551cf5e5b3-kube-api-access-qq75k\") pod \"multus-additional-cni-plugins-vdhr9\" (UID: \"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3\") " pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:37.944795 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.944774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75gjf\" (UniqueName: \"kubernetes.io/projected/9f7d172d-80a2-4ced-9dfd-b2da531e7227-kube-api-access-75gjf\") pod \"ovnkube-node-d9sbz\" (UID: \"9f7d172d-80a2-4ced-9dfd-b2da531e7227\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:37.945003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:37.944966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpf84\" (UniqueName: \"kubernetes.io/projected/525d846b-c6fa-4b54-bf97-cf9e2f594a69-kube-api-access-xpf84\") pod \"multus-4669k\" (UID: \"525d846b-c6fa-4b54-bf97-cf9e2f594a69\") " pod="openshift-multus/multus-4669k" Jun 03 19:30:38.019840 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.019811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:38.027035 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.027005 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" Jun 03 19:30:38.038648 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.038626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dhdg" Jun 03 19:30:38.044357 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.044339 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" Jun 03 19:30:38.051953 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.051936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-thqxm" Jun 03 19:30:38.058322 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.058305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cm7lm" Jun 03 19:30:38.064985 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.064945 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4669k" Jun 03 19:30:38.071538 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.071517 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:30:38.076100 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.076083 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" Jun 03 19:30:38.178555 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.178525 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:30:38.341418 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.341388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:38.341572 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.341537 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:38.341635 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.341603 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:39.341587214 +0000 UTC m=+4.037442913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:38.442595 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.442560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:38.442747 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.442689 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:38.442747 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.442745 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:39.442729821 +0000 UTC m=+4.138585519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:38.543164 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.543125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:38.543320 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.543292 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:38.543320 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.543317 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:38.543412 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.543329 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:38.543412 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:38.543390 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:39.543376789 +0000 UTC m=+4.239232486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:38.627933 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.627909 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92270f1_35ed_4159_aaf5_41914fb4f65b.slice/crio-57edd73693ef5f6d456fdb394c4e907a1992d4d57f27e6b7e919708b6aef5bb4 WatchSource:0}: Error finding container 57edd73693ef5f6d456fdb394c4e907a1992d4d57f27e6b7e919708b6aef5bb4: Status 404 returned error can't find the container with id 57edd73693ef5f6d456fdb394c4e907a1992d4d57f27e6b7e919708b6aef5bb4 Jun 03 19:30:38.648096 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.648071 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7d172d_80a2_4ced_9dfd_b2da531e7227.slice/crio-cd9799283c82f049522167d5d7478a987374a343a2ae7817aca6d0cdc6f7542b WatchSource:0}: Error finding container cd9799283c82f049522167d5d7478a987374a343a2ae7817aca6d0cdc6f7542b: Status 404 returned error can't find the container with id cd9799283c82f049522167d5d7478a987374a343a2ae7817aca6d0cdc6f7542b Jun 03 19:30:38.648930 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.648905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525d846b_c6fa_4b54_bf97_cf9e2f594a69.slice/crio-9cc702a2c00537f21c559145041f46ebea38b026f81456fe77b9e9fc78b7641e WatchSource:0}: Error finding container 9cc702a2c00537f21c559145041f46ebea38b026f81456fe77b9e9fc78b7641e: Status 404 returned error can't find the container with id 9cc702a2c00537f21c559145041f46ebea38b026f81456fe77b9e9fc78b7641e Jun 03 19:30:38.653074 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.653054 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c44c91c_f288_4089_9075_eaa375c7dff4.slice/crio-eb80728b06631f82bddbd61e390a46b6a52182e160b9613ffcec0691199e38e4 WatchSource:0}: Error finding container eb80728b06631f82bddbd61e390a46b6a52182e160b9613ffcec0691199e38e4: Status 404 returned error can't find the container with id eb80728b06631f82bddbd61e390a46b6a52182e160b9613ffcec0691199e38e4 Jun 03 19:30:38.656788 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.656752 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1fc591_025d_40f7_8b8c_c33b92125a66.slice/crio-443b6d6405e8354b15e2cbd426c37b833301af090e0cd100449b29f3c2e144a6 WatchSource:0}: Error finding container 443b6d6405e8354b15e2cbd426c37b833301af090e0cd100449b29f3c2e144a6: Status 404 returned error can't find the container with id 443b6d6405e8354b15e2cbd426c37b833301af090e0cd100449b29f3c2e144a6 Jun 03 19:30:38.657833 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.657746 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3f6443_6c02_4091_a04b_054ca3683d30.slice/crio-39581daed9b557855fff97a8fbedd1e89523dd73de8ed3bd9ff2bd8104b3d35a WatchSource:0}: Error finding container 39581daed9b557855fff97a8fbedd1e89523dd73de8ed3bd9ff2bd8104b3d35a: Status 404 returned error can't find the container with id 39581daed9b557855fff97a8fbedd1e89523dd73de8ed3bd9ff2bd8104b3d35a Jun 03 19:30:38.659185 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.659160 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbaecb1e_f61d_4783_a091_6b4803679001.slice/crio-095a89b5122034ace507b2dc318108ee995beca1a64961eac66841de58d5f7c8 WatchSource:0}: Error finding container 095a89b5122034ace507b2dc318108ee995beca1a64961eac66841de58d5f7c8: Status 404 returned error can't find the container with id 095a89b5122034ace507b2dc318108ee995beca1a64961eac66841de58d5f7c8 Jun 03 19:30:38.661397 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.660561 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b153b22_fd10_428a_8daf_4bfe23079226.slice/crio-7c0842dd4c178026805fb7e049128ac0661831ab4a713ef34932e653f1bf9d13 WatchSource:0}: Error finding container 7c0842dd4c178026805fb7e049128ac0661831ab4a713ef34932e653f1bf9d13: Status 404 returned error can't find the container with id 7c0842dd4c178026805fb7e049128ac0661831ab4a713ef34932e653f1bf9d13 Jun 03 19:30:38.661788 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:30:38.661767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec73668e_d4f7_4a21_96e1_7c551cf5e5b3.slice/crio-abbe75b68601dc27e7cdf0aac6825aec75456163cf4a1ea385bf16c016450750 WatchSource:0}: Error finding container abbe75b68601dc27e7cdf0aac6825aec75456163cf4a1ea385bf16c016450750: Status 404 returned error can't find the container with id abbe75b68601dc27e7cdf0aac6825aec75456163cf4a1ea385bf16c016450750 Jun 03 19:30:38.759838 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.759704 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:37 +0000 UTC" deadline="2028-01-26 09:16:08.123174561 +0000 UTC" Jun 03 19:30:38.759838 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.759836 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14437h45m29.363340865s" Jun 03 19:30:38.805636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.805608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" event={"ID":"320fd542d1a0a5133cb1d86dfcc2a9af","Type":"ContainerStarted","Data":"860e7b320b86ce7710e1346c80ce806676969fe2ce578a17adb08fb6077777e7"} Jun 03 19:30:38.809719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.809691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerStarted","Data":"abbe75b68601dc27e7cdf0aac6825aec75456163cf4a1ea385bf16c016450750"} Jun 03 19:30:38.813652 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.813631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-762t7" event={"ID":"4b153b22-fd10-428a-8daf-4bfe23079226","Type":"ContainerStarted","Data":"7c0842dd4c178026805fb7e049128ac0661831ab4a713ef34932e653f1bf9d13"} Jun 03 19:30:38.814764 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.814741 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"cd9799283c82f049522167d5d7478a987374a343a2ae7817aca6d0cdc6f7542b"} Jun 03 19:30:38.815706 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.815686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" event={"ID":"dbaecb1e-f61d-4783-a091-6b4803679001","Type":"ContainerStarted","Data":"095a89b5122034ace507b2dc318108ee995beca1a64961eac66841de58d5f7c8"} Jun 03 19:30:38.818465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.818445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dhdg" event={"ID":"fa3f6443-6c02-4091-a04b-054ca3683d30","Type":"ContainerStarted","Data":"39581daed9b557855fff97a8fbedd1e89523dd73de8ed3bd9ff2bd8104b3d35a"} Jun 03 19:30:38.821080 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.821060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cm7lm" event={"ID":"fb1fc591-025d-40f7-8b8c-c33b92125a66","Type":"ContainerStarted","Data":"443b6d6405e8354b15e2cbd426c37b833301af090e0cd100449b29f3c2e144a6"} Jun 03 19:30:38.822106 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.822083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-thqxm" event={"ID":"5c44c91c-f288-4089-9075-eaa375c7dff4","Type":"ContainerStarted","Data":"eb80728b06631f82bddbd61e390a46b6a52182e160b9613ffcec0691199e38e4"} Jun 03 19:30:38.823294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.823265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4669k" event={"ID":"525d846b-c6fa-4b54-bf97-cf9e2f594a69","Type":"ContainerStarted","Data":"9cc702a2c00537f21c559145041f46ebea38b026f81456fe77b9e9fc78b7641e"} Jun 03 19:30:38.824326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:38.824293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" event={"ID":"e92270f1-35ed-4159-aaf5-41914fb4f65b","Type":"ContainerStarted","Data":"57edd73693ef5f6d456fdb394c4e907a1992d4d57f27e6b7e919708b6aef5bb4"} Jun 03 19:30:39.350543 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.349944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:39.350543 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.350116 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:39.350543 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.350178 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:41.350159708 +0000 UTC m=+6.046015420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:39.450906 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.450871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:39.451066 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.451054 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:39.451140 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.451115 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:41.451096759 +0000 UTC m=+6.146952462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:39.551877 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.551841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:39.552060 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.552014 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:39.552060 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.552032 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:39.552060 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.552045 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:39.552220 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.552102 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:41.552085358 +0000 UTC m=+6.247941069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:39.760892 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.760777 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:37 +0000 UTC" deadline="2027-12-16 15:54:39.839148601 +0000 UTC" Jun 03 19:30:39.760892 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.760815 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13460h24m0.07833792s" Jun 03 19:30:39.796385 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.796358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:39.796539 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.796478 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:39.796892 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.796862 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:39.796970 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.796953 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:39.797184 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.797166 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:39.797307 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:39.797285 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:39.846362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.845279 2573 generic.go:356] "Generic (PLEG): container finished" podID="03a8817bc8687d8308f65b4a0df424e5" containerID="1ed53223b9a653257d0635b8af8a7d71251f4f76a8e3573270bac2749355fcec" exitCode=0 Jun 03 19:30:39.846362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.846138 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" event={"ID":"03a8817bc8687d8308f65b4a0df424e5","Type":"ContainerDied","Data":"1ed53223b9a653257d0635b8af8a7d71251f4f76a8e3573270bac2749355fcec"} Jun 03 19:30:39.864089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:39.864021 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-145.ec2.internal" podStartSLOduration=2.864001758 podStartE2EDuration="2.864001758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:38.82032941 +0000 UTC m=+3.516185132" watchObservedRunningTime="2026-06-03 19:30:39.864001758 +0000 UTC m=+4.559857479" Jun 03 19:30:40.866266 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:40.865535 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" event={"ID":"03a8817bc8687d8308f65b4a0df424e5","Type":"ContainerStarted","Data":"469d3c50650aa23c44f7bb23c137bbe61ffd0e3fb813031faff19f3c34a07ed4"} Jun 03 19:30:40.882905 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:40.882503 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-145.ec2.internal" podStartSLOduration=3.882482581 podStartE2EDuration="3.882482581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:40.881672473 +0000 UTC m=+5.577528193" watchObservedRunningTime="2026-06-03 19:30:40.882482581 +0000 UTC m=+5.578338301" Jun 03 19:30:41.369410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.368779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:41.369410 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.368987 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:41.369410 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.369057 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:45.36903085 +0000 UTC m=+10.064886551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:41.469614 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.469575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:41.469780 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.469747 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:41.469839 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.469812 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:45.469791656 +0000 UTC m=+10.165647360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:41.570029 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.569990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:41.570228 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.570207 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:41.570228 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.570229 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:41.570391 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.570259 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:41.570391 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.570319 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:45.570300005 +0000 UTC m=+10.266155715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:41.796497 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.795909 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:41.796497 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.796047 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:41.796497 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.796426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:41.796773 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.796539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:41.796773 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:41.796434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:41.796773 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:41.796623 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:43.795356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:43.795320 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:43.795816 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:43.795447 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:43.795893 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:43.795876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:43.796010 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:43.795988 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:43.796167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:43.796128 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:43.796292 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:43.796226 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:45.399073 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.398572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:45.399073 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.398702 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:45.399073 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.398765 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:53.398744274 +0000 UTC m=+18.094599973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:45.499873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.499845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:45.500033 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.499994 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:45.500101 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.500069 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:53.500048939 +0000 UTC m=+18.195904642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:45.600458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.600422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:45.600625 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.600607 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:45.600701 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.600630 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:45.600701 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.600643 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:45.600793 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.600705 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:53.600686438 +0000 UTC m=+18.296542171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:45.796651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.796579 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:45.796798 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.796684 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:45.797896 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.797874 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:45.798554 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.798525 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:45.798658 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:45.798595 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:45.798728 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:45.798709 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:47.795910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:47.795858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:47.795910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:47.795880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:47.796440 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:47.795988 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:47.796440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:47.796016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:47.796440 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:47.796107 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:47.796440 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:47.796206 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:49.795872 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:49.795839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:49.796364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:49.795839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:49.796364 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:49.795957 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:49.796364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:49.795856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:49.796364 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:49.796014 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:49.796364 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:49.796113 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:51.796045 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:51.796008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:51.796630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:51.796011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:51.796630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:51.796147 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:51.796630 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:51.796145 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:51.796630 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:51.796254 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:51.796630 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:51.796367 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:53.458288 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.458222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:53.458708 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.458407 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:53.458708 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.458488 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:09.458465876 +0000 UTC m=+34.154321588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:53.559233 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.559192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:53.559427 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.559347 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:53.559427 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.559417 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:09.559397311 +0000 UTC m=+34.255253009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:53.660426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.660383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:53.660579 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.660547 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:53.660579 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.660571 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:53.660693 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.660585 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:53.660693 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.660639 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:09.660626176 +0000 UTC m=+34.356481878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:53.795103 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.795019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:53.795277 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.795166 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:53.795277 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.795034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:53.795394 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.795273 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:53.795394 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:53.795028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:53.795394 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:53.795350 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:55.796148 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:55.796071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:55.796148 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:55.796127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:55.796702 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:55.796190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:55.796702 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:55.796272 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:55.796702 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:55.796289 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:55.796702 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:55.796356 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:56.900084 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.899871 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" event={"ID":"e92270f1-35ed-4159-aaf5-41914fb4f65b","Type":"ContainerStarted","Data":"80d41ca5f75993c14ea56c0d8b68bfd846d6edd82444f6ab43a3d23f04f93f20"} Jun 03 19:30:56.901300 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.901275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerStarted","Data":"de2e6d47fda336287f02e752ca33033067db37dac45d7fa36130f4772b3886d5"} Jun 03 19:30:56.902606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.902581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-762t7" event={"ID":"4b153b22-fd10-428a-8daf-4bfe23079226","Type":"ContainerStarted","Data":"15f03990c4aa21a9c62d2368f0000749ec5a06580d0c6141e1b9b1295c545576"} Jun 03 19:30:56.903949 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.903927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"7cdf15498733ae70a14a1e477489c0493716550ae6e04f424ddcd7e8066f6769"} Jun 03 19:30:56.906504 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.905531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" event={"ID":"dbaecb1e-f61d-4783-a091-6b4803679001","Type":"ContainerStarted","Data":"177f6fb864c5682310bf22fbe7a2dcd3e9477ecaefaf3ffb91a0a8cb10984ff3"} Jun 03 19:30:56.908092 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.908061 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dhdg" event={"ID":"fa3f6443-6c02-4091-a04b-054ca3683d30","Type":"ContainerStarted","Data":"4ff67f87d87f84864cfe843829a5e9ed95ee97ff1cbaaf74fbeeed92ffcaf7ad"} Jun 03 19:30:56.909798 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.909772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cm7lm" event={"ID":"fb1fc591-025d-40f7-8b8c-c33b92125a66","Type":"ContainerStarted","Data":"c2fa18f320221c7249ac290c59f72e2b7bb32fbadf851b58a27f0ed57a665b66"} Jun 03 19:30:56.911116 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.911095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4669k" event={"ID":"525d846b-c6fa-4b54-bf97-cf9e2f594a69","Type":"ContainerStarted","Data":"1e795733eb8e011ec87c23735ed865dd20a5c6649dbbfcb64da02fe89ed3ee0f"} Jun 03 19:30:56.935882 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.935835 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4dhdg" podStartSLOduration=3.979343237 podStartE2EDuration="21.935818528s" totalImagesPullingTime="17.956475291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:56.935471948 +0000 UTC m=+21.631327669" watchObservedRunningTime="2026-06-03 19:30:56.935818528 +0000 UTC m=+21.631674248" Jun 03 19:30:56.951171 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.951127 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mfmsm" podStartSLOduration=2.998831022 podStartE2EDuration="20.951109823s" totalImagesPullingTime="17.952278801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:56.950609984 +0000 UTC m=+21.646465703" watchObservedRunningTime="2026-06-03 19:30:56.951109823 +0000 UTC m=+21.646965541" Jun 03 19:30:56.969877 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:56.969839 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-762t7" podStartSLOduration=12.314837511 podStartE2EDuration="21.969823818s" totalImagesPullingTime="9.654986307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:56.969747862 +0000 UTC m=+21.665603581" watchObservedRunningTime="2026-06-03 19:30:56.969823818 +0000 UTC m=+21.665679536" Jun 03 19:30:57.002139 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.002098 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cm7lm" podStartSLOduration=3.04342648 podStartE2EDuration="21.00208247s" totalImagesPullingTime="17.95865599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.001559353 +0000 UTC m=+21.697415073" watchObservedRunningTime="2026-06-03 19:30:57.00208247 +0000 UTC m=+21.697938205" Jun 03 19:30:57.041969 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.041918 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4669k" podStartSLOduration=3.065753929 podStartE2EDuration="21.041905518s" totalImagesPullingTime="17.976151589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.041439172 +0000 UTC m=+21.737294890" watchObservedRunningTime="2026-06-03 19:30:57.041905518 +0000 UTC m=+21.737761243" Jun 03 19:30:57.795554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.795524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:57.795554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.795545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:57.795778 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.795545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:57.795778 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:57.795634 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:57.795778 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:57.795693 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:57.795927 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:57.795792 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:57.914026 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.913998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-thqxm" event={"ID":"5c44c91c-f288-4089-9075-eaa375c7dff4","Type":"ContainerStarted","Data":"a444d70e528b4e0ab51b631af7fa2de5aed1c237d64f195f14c4043a940d8fdc"} Jun 03 19:30:57.915587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.915563 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="de2e6d47fda336287f02e752ca33033067db37dac45d7fa36130f4772b3886d5" exitCode=0 Jun 03 19:30:57.915712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.915654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"de2e6d47fda336287f02e752ca33033067db37dac45d7fa36130f4772b3886d5"} Jun 03 19:30:57.918529 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.918513 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:30:57.918830 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.918811 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f7d172d-80a2-4ced-9dfd-b2da531e7227" containerID="7bb223bc0839254723d00fab7f61ad5fdbc87c2817cb659950a246aeb999ac50" exitCode=1 Jun 03 19:30:57.918948 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.918920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"cf343c67216d59e69dcf68c86e36f4acdb578cbdebc919b733834c7579e09c90"} Jun 03 19:30:57.919016 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.918996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"93c4c72e7b254add6f763720daecca8cef88ebde2120e0ac1d886833e210c653"} Jun 03 19:30:57.919082 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.919029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"f09323a2764884b1e4bbe05939295a9b7886960c3fde9b938a02b157b69c5e32"} Jun 03 19:30:57.919082 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.919065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"a121edb2486f5ce16dfaf01dbf89065d26474b42d96abc39121420a10f675aeb"} Jun 03 19:30:57.919181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.919098 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerDied","Data":"7bb223bc0839254723d00fab7f61ad5fdbc87c2817cb659950a246aeb999ac50"} Jun 03 19:30:57.930441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:57.930404 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-thqxm" podStartSLOduration=3.968303408 podStartE2EDuration="21.930391766s" totalImagesPullingTime="17.962088358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:57.930095044 +0000 UTC m=+22.625950762" watchObservedRunningTime="2026-06-03 19:30:57.930391766 +0000 UTC m=+22.626247484" Jun 03 19:30:58.150446 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.150402 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:58.630428 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.630397 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:30:58.788799 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.788680 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:30:58.6304158Z","UUID":"61b00509-6c86-4205-9862-17cfcdb87c48","Handler":null,"Name":"","Endpoint":""} Jun 03 19:30:58.790192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.790174 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:30:58.790292 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.790208 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:30:58.922121 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:58.922089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" event={"ID":"e92270f1-35ed-4159-aaf5-41914fb4f65b","Type":"ContainerStarted","Data":"c2d42f5012ac31fa0344faeb8cda91c9cf3188f2bf75a24f765394ae85148d6c"} Jun 03 19:30:59.727409 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.727336 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:59.727982 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.727961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:59.795170 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.795149 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:30:59.795284 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.795149 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:30:59.795341 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.795317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:30:59.795341 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:59.795319 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:30:59.795443 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:59.795404 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:30:59.795509 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:30:59.795489 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:30:59.927416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.927256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:30:59.927799 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.927779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"521c6ce38c4779423156a178be0356cf85738fe36076b029e603c29635b3813b"} Jun 03 19:30:59.929688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.929666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" event={"ID":"e92270f1-35ed-4159-aaf5-41914fb4f65b","Type":"ContainerStarted","Data":"2b73e628b8689bc5c8e5bb2f330f89bca7fc64c163c133efb4c3ef7810a8f297"} Jun 03 19:30:59.930527 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.930508 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-762t7" Jun 03 19:30:59.960792 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:30:59.960742 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vmcs" podStartSLOduration=4.470428926 podStartE2EDuration="24.960723484s" totalImagesPullingTime="20.490294558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:59.946623882 +0000 UTC m=+24.642479601" watchObservedRunningTime="2026-06-03 19:30:59.960723484 +0000 UTC m=+24.656579207" Jun 03 19:31:01.795289 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.795201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:01.795289 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.795220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:01.795289 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.795209 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:01.796395 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:01.795365 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:31:01.796395 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:01.795429 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:31:01.796395 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:01.795483 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:31:01.938185 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.937943 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:31:01.938572 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.938545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"1b08a0c0a720dd42c04a6777da8d0012102075e49ab9fb12de9c7c940227df08"} Jun 03 19:31:01.938888 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.938868 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:01.939065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.939046 2573 scope.go:117] "RemoveContainer" containerID="7bb223bc0839254723d00fab7f61ad5fdbc87c2817cb659950a246aeb999ac50" Jun 03 19:31:01.956914 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:01.956884 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:02.954260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.949458 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:31:02.954260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.951173 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" event={"ID":"9f7d172d-80a2-4ced-9dfd-b2da531e7227","Type":"ContainerStarted","Data":"2a753fe10657c24eb080c03b39301171cdec7d0408b525fcf5f57d86c05e1391"} Jun 03 19:31:02.954260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.952467 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:02.954260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.952554 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:02.974878 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.974849 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:02.978350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:02.978267 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" podStartSLOduration=8.943878311 podStartE2EDuration="26.978246997s" totalImagesPullingTime="18.034368686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:02.97680236 +0000 UTC m=+27.672658079" watchObservedRunningTime="2026-06-03 19:31:02.978246997 +0000 UTC m=+27.674102709" Jun 03 19:31:03.657587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.657544 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g7l2"] Jun 03 19:31:03.657767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.657690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:03.657827 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:03.657786 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:31:03.660539 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.660515 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77lpm"] Jun 03 19:31:03.660704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.660689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:03.660824 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:03.660800 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:31:03.661103 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.661080 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6p4tr"] Jun 03 19:31:03.661196 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:03.661181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:03.661323 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:03.661300 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:31:04.795305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:04.795270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:04.795305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:04.795298 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:04.795760 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:04.795315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:04.795760 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:04.795395 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:31:04.795760 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:04.795488 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:31:04.795760 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:04.795566 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:31:04.957469 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:04.957441 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="e1b39ac06f05953248744e2fe6c6cd2c38e85f6611df6d70589859da8ce7979e" exitCode=0 Jun 03 19:31:04.957617 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:04.957530 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"e1b39ac06f05953248744e2fe6c6cd2c38e85f6611df6d70589859da8ce7979e"} Jun 03 19:31:05.961672 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:05.961639 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="766ea0bdd821222c42f437270d0742e99e3e289c712fe84ec20829f42d8be5d2" exitCode=0 Jun 03 19:31:05.962018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:05.961710 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"766ea0bdd821222c42f437270d0742e99e3e289c712fe84ec20829f42d8be5d2"} Jun 03 19:31:06.795225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:06.795070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:06.795351 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:06.795070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:06.795419 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:06.795344 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:31:06.795419 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:06.795071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:06.795419 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:06.795372 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:31:06.795556 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:06.795439 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:31:06.966114 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:06.966040 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="eb39f2ee09e5911cbb0481601b35e768af6c4942be81c900cb5a474236817a0f" exitCode=0 Jun 03 19:31:06.966114 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:06.966082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"eb39f2ee09e5911cbb0481601b35e768af6c4942be81c900cb5a474236817a0f"} Jun 03 19:31:08.795143 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:08.795113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:08.795736 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:08.795113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:08.795736 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:08.795219 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:31:08.795736 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:08.795115 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:08.795736 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:08.795320 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g7l2" podUID="59c90d82-321d-4986-8c72-a8bf50425844" Jun 03 19:31:08.795736 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:08.795398 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p4tr" podUID="df90e458-d4ec-408a-84af-e78b50a9de78" Jun 03 19:31:09.484161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:09.484124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:09.484346 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.484305 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:09.484408 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.484377 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:41.484358129 +0000 UTC m=+66.180213829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:31:09.584531 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:09.584498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:09.584678 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.584660 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:09.584748 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.584736 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret podName:df90e458-d4ec-408a-84af-e78b50a9de78 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:41.58471553 +0000 UTC m=+66.280571230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret") pod "global-pull-secret-syncer-6p4tr" (UID: "df90e458-d4ec-408a-84af-e78b50a9de78") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:31:09.685042 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:09.685008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:09.685196 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.685177 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:31:09.685257 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.685200 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:31:09.685257 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.685211 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mp67c for pod openshift-network-diagnostics/network-check-target-4g7l2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:09.685347 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:09.685275 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c podName:59c90d82-321d-4986-8c72-a8bf50425844 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:41.685260341 +0000 UTC m=+66.381116054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp67c" (UniqueName: "kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c") pod "network-check-target-4g7l2" (UID: "59c90d82-321d-4986-8c72-a8bf50425844") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:31:10.661097 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.661073 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-145.ec2.internal" event="NodeReady" Jun 03 19:31:10.661640 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.661203 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:31:10.696496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.696468 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:31:10.698912 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.698891 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.701440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.701413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:31:10.701606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.701548 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:31:10.701786 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.701765 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:31:10.701885 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.701859 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tr6t\"" Jun 03 19:31:10.707940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.707891 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:31:10.710006 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.709988 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2drfp"] Jun 03 19:31:10.711829 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.711815 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.713285 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.713226 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:31:10.714364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.714161 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\"" Jun 03 19:31:10.714364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.714177 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:31:10.714364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.714266 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:31:10.715724 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.715702 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nnnlv"] Jun 03 19:31:10.717439 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.717422 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:10.719793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.719774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:31:10.719925 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.719800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:31:10.719925 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.719836 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gvlhb\"" Jun 03 19:31:10.720082 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.720061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:31:10.723702 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.723556 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2drfp"] Jun 03 19:31:10.728505 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.728460 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nnnlv"] Jun 03 19:31:10.745512 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.745492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.793808 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.793935 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.793935 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.793935 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.793935 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.794141 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.794141 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.793977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq5r\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.794141 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.794031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.795297 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.795276 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:10.795379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.795301 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:10.795450 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.795430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:10.797879 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.797856 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:31:10.798122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.798014 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:31:10.798122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.798025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:31:10.798122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.798051 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:31:10.798122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.798021 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\"" Jun 03 19:31:10.798122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.798022 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\"" Jun 03 19:31:10.830024 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.830004 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:10.895098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408ccba7-220b-4d2d-a232-617e6a90ab8c-tmp-dir\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.895264 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895178 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895264 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq5r\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895412 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkks\" (UniqueName: \"kubernetes.io/projected/fffae973-7b4c-446f-96b2-8164848342a2-kube-api-access-qjkks\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:10.895412 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895412 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fffae973-7b4c-446f-96b2-8164848342a2-cert\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:10.895412 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/408ccba7-220b-4d2d-a232-617e6a90ab8c-config-volume\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.895611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.895586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgmgm\" (UniqueName: \"kubernetes.io/projected/408ccba7-220b-4d2d-a232-617e6a90ab8c-kube-api-access-wgmgm\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.896413 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:10.896095 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:10.896413 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:10.896126 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:10.896413 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:10.896180 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:11.396161599 +0000 UTC m=+36.092017295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:10.896413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.896214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.896413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.896216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.896724 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.896603 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.899823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.899801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.899921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.899805 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.904366 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.904344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq5r\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.904665 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.904645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:10.996709 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.996709 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgmgm\" (UniqueName: \"kubernetes.io/projected/408ccba7-220b-4d2d-a232-617e6a90ab8c-kube-api-access-wgmgm\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408ccba7-220b-4d2d-a232-617e6a90ab8c-tmp-dir\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkks\" (UniqueName: \"kubernetes.io/projected/fffae973-7b4c-446f-96b2-8164848342a2-kube-api-access-qjkks\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:10.996790 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fffae973-7b4c-446f-96b2-8164848342a2-cert\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:10.996870 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:11.496850362 +0000 UTC m=+36.192706059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:10.996898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.996895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/408ccba7-220b-4d2d-a232-617e6a90ab8c-config-volume\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.997219 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.997199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408ccba7-220b-4d2d-a232-617e6a90ab8c-tmp-dir\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.997506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.997481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/408ccba7-220b-4d2d-a232-617e6a90ab8c-config-volume\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:10.999523 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:10.999503 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fffae973-7b4c-446f-96b2-8164848342a2-cert\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:11.006057 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.006031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkks\" (UniqueName: \"kubernetes.io/projected/fffae973-7b4c-446f-96b2-8164848342a2-kube-api-access-qjkks\") pod \"ingress-canary-nnnlv\" (UID: \"fffae973-7b4c-446f-96b2-8164848342a2\") " pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:11.006146 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.006066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgmgm\" (UniqueName: \"kubernetes.io/projected/408ccba7-220b-4d2d-a232-617e6a90ab8c-kube-api-access-wgmgm\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:11.030385 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.030357 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nnnlv" Jun 03 19:31:11.173407 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.173267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nnnlv"] Jun 03 19:31:11.177270 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:31:11.177226 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffae973_7b4c_446f_96b2_8164848342a2.slice/crio-80ee4fb81dba8cd14ec1a1e3333f52e32047f01303aded436700a4ea03eec70e WatchSource:0}: Error finding container 80ee4fb81dba8cd14ec1a1e3333f52e32047f01303aded436700a4ea03eec70e: Status 404 returned error can't find the container with id 80ee4fb81dba8cd14ec1a1e3333f52e32047f01303aded436700a4ea03eec70e Jun 03 19:31:11.399154 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.399118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:11.399300 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:11.399281 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:11.399345 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:11.399301 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:11.399378 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:11.399355 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:12.39933973 +0000 UTC m=+37.095195427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:11.500069 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.500044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:11.500183 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:11.500156 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:11.500224 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:11.500208 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:12.500191805 +0000 UTC m=+37.196047522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:11.979658 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.979621 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nnnlv" event={"ID":"fffae973-7b4c-446f-96b2-8164848342a2","Type":"ContainerStarted","Data":"80ee4fb81dba8cd14ec1a1e3333f52e32047f01303aded436700a4ea03eec70e"} Jun 03 19:31:11.982760 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.982735 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="ddae45f49b181e27bb1f239f0534046a21e7fb3ec0c1989991ffeb1a89ab99eb" exitCode=0 Jun 03 19:31:11.982877 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:11.982778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"ddae45f49b181e27bb1f239f0534046a21e7fb3ec0c1989991ffeb1a89ab99eb"} Jun 03 19:31:12.407397 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:12.407368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:12.407541 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:12.407520 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:12.407583 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:12.407543 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:12.407631 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:12.407600 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:14.407585007 +0000 UTC m=+39.103440720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:12.508312 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:12.508273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:12.508493 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:12.508414 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:12.508493 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:12.508484 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:14.508466447 +0000 UTC m=+39.204322148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:12.967224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:12.967184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:12.989605 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:12.989567 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec73668e-d4f7-4a21-96e1-7c551cf5e5b3" containerID="fc2113f85d572a810f0098967d8348c0944bef6d5dabcf532a5eb83d5c8b5912" exitCode=0 Jun 03 19:31:12.990044 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:12.989638 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerDied","Data":"fc2113f85d572a810f0098967d8348c0944bef6d5dabcf532a5eb83d5c8b5912"} Jun 03 19:31:13.028943 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:13.028911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:13.995565 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:13.995373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" event={"ID":"ec73668e-d4f7-4a21-96e1-7c551cf5e5b3","Type":"ContainerStarted","Data":"b02ca52c65f73f7ec5c73b9dedc6c7cfa947ec2a6fb1052f25c05af5b6521d9b"} Jun 03 19:31:13.996807 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:13.996785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nnnlv" event={"ID":"fffae973-7b4c-446f-96b2-8164848342a2","Type":"ContainerStarted","Data":"fc32666ea2df4d44fb43c6fe3a9f4d76edf115c811927da140542b0d65e7887d"} Jun 03 19:31:14.019550 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.019510 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vdhr9" podStartSLOduration=8.516295516 podStartE2EDuration="38.019498632s" totalImagesPullingTime="29.503203116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:14.017745344 +0000 UTC m=+38.713601099" watchObservedRunningTime="2026-06-03 19:31:14.019498632 +0000 UTC m=+38.715354351" Jun 03 19:31:14.033573 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.033540 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nnnlv" podStartSLOduration=1.913338217 podStartE2EDuration="4.033529479s" totalImagesPullingTime="2.120191262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:14.032331357 +0000 UTC m=+38.728187087" watchObservedRunningTime="2026-06-03 19:31:14.033529479 +0000 UTC m=+38.729385197" Jun 03 19:31:14.118338 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.118306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.172609 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.172580 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.424863 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.424828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:14.425025 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:14.424949 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:14.425025 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:14.424961 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:14.425025 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:14.425012 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:18.424997548 +0000 UTC m=+43.120853245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:14.525896 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.525870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:14.526028 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:14.526012 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:14.526077 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:14.526068 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:18.526052719 +0000 UTC m=+43.221908416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:14.797634 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.797600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:14.869610 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:14.869582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:17.352863 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:17.352831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:17.922116 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:17.922087 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:18.454830 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:18.454798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:18.455303 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:18.454979 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:18.455303 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:18.455004 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:18.455303 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:18.455085 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:26.455064631 +0000 UTC m=+51.150920345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:18.555704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:18.555675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:18.555829 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:18.555815 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:18.555890 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:18.555883 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:26.555867018 +0000 UTC m=+51.251722715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:24.114656 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:24.114617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:24.215028 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:24.215002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.254817 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.254782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.307435 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.307406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.374799 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.374771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.689723 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.689693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.747986 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.747957 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.857269 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.857214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:25.907829 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:25.907802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:26.514120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:26.514088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:26.514491 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:26.514187 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:26.514491 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:26.514200 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:26.514491 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:26.514276 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:42.514260687 +0000 UTC m=+67.210116384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:26.614488 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:26.614463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:26.614621 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:26.614606 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:26.614672 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:26.614662 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:31:42.614646348 +0000 UTC m=+67.310502046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:34.967678 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:34.967650 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9sbz" Jun 03 19:31:35.115380 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:35.115345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:35.173578 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:35.173547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:41.521533 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.521495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:31:41.524123 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.524103 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:31:41.532128 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:41.532108 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:31:41.532184 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:41.532173 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:32:45.532150236 +0000 UTC m=+130.228005946 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : secret "metrics-daemon-secret" not found Jun 03 19:31:41.622014 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.621989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:41.624458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.624443 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:31:41.636046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.636026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df90e458-d4ec-408a-84af-e78b50a9de78-original-pull-secret\") pod \"global-pull-secret-syncer-6p4tr\" (UID: \"df90e458-d4ec-408a-84af-e78b50a9de78\") " pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:41.718332 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.718308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p4tr" Jun 03 19:31:41.722604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.722581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:41.725506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.725492 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:31:41.735570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.735551 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:31:41.745845 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.745826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp67c\" (UniqueName: \"kubernetes.io/projected/59c90d82-321d-4986-8c72-a8bf50425844-kube-api-access-mp67c\") pod \"network-check-target-4g7l2\" (UID: \"59c90d82-321d-4986-8c72-a8bf50425844\") " pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:41.853069 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:41.853035 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6p4tr"] Jun 03 19:31:41.856564 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:31:41.856536 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf90e458_d4ec_408a_84af_e78b50a9de78.slice/crio-581ed2cc9f916ed959445683687c201a5b06c297fe24b67d7e5cadd8773c6753 WatchSource:0}: Error finding container 581ed2cc9f916ed959445683687c201a5b06c297fe24b67d7e5cadd8773c6753: Status 404 returned error can't find the container with id 581ed2cc9f916ed959445683687c201a5b06c297fe24b67d7e5cadd8773c6753 Jun 03 19:31:42.015836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.015811 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\"" Jun 03 19:31:42.024063 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.024047 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:42.062556 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.062527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6p4tr" event={"ID":"df90e458-d4ec-408a-84af-e78b50a9de78","Type":"ContainerStarted","Data":"581ed2cc9f916ed959445683687c201a5b06c297fe24b67d7e5cadd8773c6753"} Jun 03 19:31:42.170720 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.170690 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g7l2"] Jun 03 19:31:42.173655 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:31:42.173625 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c90d82_321d_4986_8c72_a8bf50425844.slice/crio-71501c649307e7fb4cdc2132a66e3f45bb10d0f581ba281b73a4e4639efa77e5 WatchSource:0}: Error finding container 71501c649307e7fb4cdc2132a66e3f45bb10d0f581ba281b73a4e4639efa77e5: Status 404 returned error can't find the container with id 71501c649307e7fb4cdc2132a66e3f45bb10d0f581ba281b73a4e4639efa77e5 Jun 03 19:31:42.529584 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.529552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:31:42.530040 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:42.529705 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:31:42.530040 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:42.529726 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:31:42.530040 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:42.529797 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:32:14.52977472 +0000 UTC m=+99.225630434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:31:42.630418 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:42.630383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:31:42.630557 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:42.630542 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:31:42.630622 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:31:42.630611 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:32:14.630592503 +0000 UTC m=+99.326448220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:31:43.067434 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:43.067402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g7l2" event={"ID":"59c90d82-321d-4986-8c72-a8bf50425844","Type":"ContainerStarted","Data":"71501c649307e7fb4cdc2132a66e3f45bb10d0f581ba281b73a4e4639efa77e5"} Jun 03 19:31:47.078568 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.078529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6p4tr" event={"ID":"df90e458-d4ec-408a-84af-e78b50a9de78","Type":"ContainerStarted","Data":"40274cdddba99dc692c82a16745271c910ca59782da6b50b23432008dc660536"} Jun 03 19:31:47.079912 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.079890 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g7l2" event={"ID":"59c90d82-321d-4986-8c72-a8bf50425844","Type":"ContainerStarted","Data":"dea556122b6e399594a46e377c14291bd1fb5dadc5b3876dde8f6c4a2fa2abc4"} Jun 03 19:31:47.080040 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.080022 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:31:47.096410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.096369 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6p4tr" podStartSLOduration=66.426800233 podStartE2EDuration="1m11.096352057s" totalImagesPullingTime="4.669551824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:47.095261688 +0000 UTC m=+71.791117400" watchObservedRunningTime="2026-06-03 19:31:47.096352057 +0000 UTC m=+71.792207776" Jun 03 19:31:47.096703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.096685 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:47.111315 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.111282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4g7l2" podStartSLOduration=66.763043608 podStartE2EDuration="1m11.111269848s" totalImagesPullingTime="4.34822624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:47.111094439 +0000 UTC m=+71.806950160" watchObservedRunningTime="2026-06-03 19:31:47.111269848 +0000 UTC m=+71.807125566" Jun 03 19:31:47.195566 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.195536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:47.294272 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.294228 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:47.347233 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:47.347214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:50.873416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:50.873309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:31:50.924434 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:31:50.924407 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:32:14.549760 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:32:14.549711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:32:14.550320 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:14.549841 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:32:14.550320 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:14.549857 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:32:14.550320 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:14.549942 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:33:18.549919347 +0000 UTC m=+163.245775048 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:32:14.650692 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:32:14.650657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:32:14.650822 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:14.650800 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:32:14.650883 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:14.650872 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:33:18.650856316 +0000 UTC m=+163.346712014 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:32:18.084999 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:32:18.084969 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4g7l2" Jun 03 19:32:45.550184 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:32:45.550149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:32:45.550687 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:45.550276 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:32:45.550687 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:32:45.550337 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:47.550321989 +0000 UTC m=+252.246177686 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : secret "metrics-daemon-secret" not found Jun 03 19:33:13.709884 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:13.709842 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" Jun 03 19:33:13.725000 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:13.724973 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2drfp" podUID="408ccba7-220b-4d2d-a232-617e6a90ab8c" Jun 03 19:33:13.806285 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:13.806258 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:33:14.281003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:14.280979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:33:14.281134 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:14.280982 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2drfp" Jun 03 19:33:18.569877 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:18.569825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:33:18.570379 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:18.569964 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:33:18.570379 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:18.569981 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58654f7dd9-jgc47: secret "image-registry-tls" not found Jun 03 19:33:18.570379 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:18.570045 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls podName:fe624a77-1259-4b39-946e-a63ab20ecc84 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:20.570029583 +0000 UTC m=+285.265885283 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls") pod "image-registry-58654f7dd9-jgc47" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84") : secret "image-registry-tls" not found Jun 03 19:33:18.670327 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:18.670291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:33:18.670469 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:18.670440 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:33:18.670520 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:33:18.670510 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls podName:408ccba7-220b-4d2d-a232-617e6a90ab8c nodeName:}" failed. No retries permitted until 2026-06-03 19:35:20.670493115 +0000 UTC m=+285.366348813 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls") pod "dns-default-2drfp" (UID: "408ccba7-220b-4d2d-a232-617e6a90ab8c") : secret "dns-default-metrics-tls" not found Jun 03 19:33:25.796882 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:25.796841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:33:35.022917 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:33:35.022882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:42.755880 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.755842 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l"] Jun 03 19:34:42.758731 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.758712 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" Jun 03 19:34:42.759208 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.759186 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv"] Jun 03 19:34:42.761700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.761684 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq"] Jun 03 19:34:42.761826 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.761810 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.762385 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.762363 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kmggs\"" Jun 03 19:34:42.762476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.762441 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.762476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.762454 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.764648 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.764633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.768328 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.768673 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.768884 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.769132 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqw49\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.769357 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.769654 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.769855 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.770133 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-98ntg\"" Jun 03 19:34:42.770900 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.770393 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.772515 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.772498 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-hznlb"] Jun 03 19:34:42.776012 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.775990 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g"] Jun 03 19:34:42.776146 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.776126 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.779405 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.779387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l"] Jun 03 19:34:42.779506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.779413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq"] Jun 03 19:34:42.779506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.779431 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv"] Jun 03 19:34:42.779506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.779484 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" Jun 03 19:34:42.780547 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.780526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 19:34:42.780621 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.780531 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2mmr5\"" Jun 03 19:34:42.780676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.780537 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 19:34:42.781087 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.781067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.781272 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.781220 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.783943 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.783913 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ktkgr\"" Jun 03 19:34:42.785646 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.785628 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g"] Jun 03 19:34:42.787962 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.787945 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 19:34:42.790828 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.790803 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-hznlb"] Jun 03 19:34:42.808139 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.808114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:42.829464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhm6b\" (UniqueName: \"kubernetes.io/projected/24713439-7263-4467-a5de-0ad27e2c6140-kube-api-access-jhm6b\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:42.829554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srrq9\" (UniqueName: \"kubernetes.io/projected/cb4c9830-aa9e-414e-9d3a-cbed47f98248-kube-api-access-srrq9\") pod \"volume-data-source-validator-78dd696465-7tz2l\" (UID: \"cb4c9830-aa9e-414e-9d3a-cbed47f98248\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" Jun 03 19:34:42.829554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:42.829624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cf4553-6400-44f0-96b6-890d2d4e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.829624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cf4553-6400-44f0-96b6-890d2d4e5e1d-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.829688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.829630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzz5\" (UniqueName: \"kubernetes.io/projected/11cf4553-6400-44f0-96b6-890d2d4e5e1d-kube-api-access-8hzz5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.863472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.863455 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f"] Jun 03 19:34:42.866213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.866197 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c99bfd76f-46v5r"] Jun 03 19:34:42.866327 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.866313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:42.868873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.868858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:42.869886 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.869869 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 19:34:42.869886 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.869879 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.870200 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.870186 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4jgq8\"" Jun 03 19:34:42.872580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 19:34:42.872708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872667 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:34:42.872708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872701 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 19:34:42.872843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4hjmf\"" Jun 03 19:34:42.872843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872777 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.872970 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.872953 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 19:34:42.873032 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.873019 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:34:42.873123 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.873035 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 19:34:42.873123 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.873055 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 19:34:42.880604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.880585 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f"] Jun 03 19:34:42.881803 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.881784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c99bfd76f-46v5r"] Jun 03 19:34:42.893323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.893300 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:42.930273 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2e010408-d4d8-4013-8f9f-cf71e1791243-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:42.930363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhm6b\" (UniqueName: \"kubernetes.io/projected/24713439-7263-4467-a5de-0ad27e2c6140-kube-api-access-jhm6b\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:42.930363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:42.930363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-snapshots\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqj4\" (UniqueName: \"kubernetes.io/projected/0659720b-b038-4398-b8e7-a91de5e42748-kube-api-access-9dqj4\") pod \"network-check-source-dbd9cf844-cl25g\" (UID: \"0659720b-b038-4398-b8e7-a91de5e42748\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" Jun 03 19:34:42.930517 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpkr\" (UniqueName: \"kubernetes.io/projected/2e010408-d4d8-4013-8f9f-cf71e1791243-kube-api-access-4rpkr\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:42.930517 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cf4553-6400-44f0-96b6-890d2d4e5e1d-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.930517 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7gz\" (UniqueName: \"kubernetes.io/projected/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-kube-api-access-zh7gz\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930517 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930484 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-trusted-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930517 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srrq9\" (UniqueName: \"kubernetes.io/projected/cb4c9830-aa9e-414e-9d3a-cbed47f98248-kube-api-access-srrq9\") pod \"volume-data-source-validator-78dd696465-7tz2l\" (UID: \"cb4c9830-aa9e-414e-9d3a-cbed47f98248\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" Jun 03 19:34:42.930742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:42.930742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-service-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cf4553-6400-44f0-96b6-890d2d4e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.930742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-serving-cert\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzz5\" (UniqueName: \"kubernetes.io/projected/11cf4553-6400-44f0-96b6-890d2d4e5e1d-kube-api-access-8hzz5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.930981 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:42.930746 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:34:42.930981 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-tmp\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:42.930981 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:42.930807 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls podName:24713439-7263-4467-a5de-0ad27e2c6140 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.430789717 +0000 UTC m=+248.126645419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-xc7cq" (UID: "24713439-7263-4467-a5de-0ad27e2c6140") : secret "samples-operator-tls" not found Jun 03 19:34:42.931083 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.930983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11cf4553-6400-44f0-96b6-890d2d4e5e1d-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.932725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.932709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11cf4553-6400-44f0-96b6-890d2d4e5e1d-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.941441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.941423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzz5\" (UniqueName: \"kubernetes.io/projected/11cf4553-6400-44f0-96b6-890d2d4e5e1d-kube-api-access-8hzz5\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv\" (UID: \"11cf4553-6400-44f0-96b6-890d2d4e5e1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:42.941587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.941569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srrq9\" (UniqueName: \"kubernetes.io/projected/cb4c9830-aa9e-414e-9d3a-cbed47f98248-kube-api-access-srrq9\") pod \"volume-data-source-validator-78dd696465-7tz2l\" (UID: \"cb4c9830-aa9e-414e-9d3a-cbed47f98248\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" Jun 03 19:34:42.941783 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:42.941768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhm6b\" (UniqueName: \"kubernetes.io/projected/24713439-7263-4467-a5de-0ad27e2c6140-kube-api-access-jhm6b\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:43.031352 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-tmp\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.031352 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2e010408-d4d8-4013-8f9f-cf71e1791243-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.031352 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-snapshots\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqj4\" (UniqueName: \"kubernetes.io/projected/0659720b-b038-4398-b8e7-a91de5e42748-kube-api-access-9dqj4\") pod \"network-check-source-dbd9cf844-cl25g\" (UID: \"0659720b-b038-4398-b8e7-a91de5e42748\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpkr\" (UniqueName: \"kubernetes.io/projected/2e010408-d4d8-4013-8f9f-cf71e1791243-kube-api-access-4rpkr\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.031455 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7gz\" (UniqueName: \"kubernetes.io/projected/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-kube-api-access-zh7gz\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.031544 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.531527447 +0000 UTC m=+248.227383146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-stats-auth\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031587 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.031602 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-trusted-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmr4b\" (UniqueName: \"kubernetes.io/projected/623f04e8-7671-43f5-8390-773d6ce68100-kube-api-access-tmr4b\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-service-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-default-certificate\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-tmp\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.031881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-serving-cert\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.032035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-snapshots\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032307 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.032157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2e010408-d4d8-4013-8f9f-cf71e1791243-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.032307 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.032197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-service-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.032601 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.032585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-trusted-ca-bundle\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.034192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.034155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-serving-cert\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.034310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.034209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:43.040068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.040046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7gz\" (UniqueName: \"kubernetes.io/projected/ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7-kube-api-access-zh7gz\") pod \"insights-operator-69684796bc-hznlb\" (UID: \"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7\") " pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.040217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.040199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqj4\" (UniqueName: \"kubernetes.io/projected/0659720b-b038-4398-b8e7-a91de5e42748-kube-api-access-9dqj4\") pod \"network-check-source-dbd9cf844-cl25g\" (UID: \"0659720b-b038-4398-b8e7-a91de5e42748\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" Jun 03 19:34:43.040725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.040707 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpkr\" (UniqueName: \"kubernetes.io/projected/2e010408-d4d8-4013-8f9f-cf71e1791243-kube-api-access-4rpkr\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.072656 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.072634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" Jun 03 19:34:43.078662 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.078645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" Jun 03 19:34:43.094666 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.094635 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-hznlb" Jun 03 19:34:43.099477 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.099460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" Jun 03 19:34:43.136175 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.136147 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmr4b\" (UniqueName: \"kubernetes.io/projected/623f04e8-7671-43f5-8390-773d6ce68100-kube-api-access-tmr4b\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.136326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.136206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-default-certificate\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.136389 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.136347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.136440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.136389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-stats-auth\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.136440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.136411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.136539 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.136522 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:43.136590 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.136578 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.636559829 +0000 UTC m=+248.332415543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:43.136649 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.136624 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.636604973 +0000 UTC m=+248.332460693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:43.137958 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.137931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:43.140249 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.140097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-default-certificate\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.141653 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.141157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-stats-auth\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.147119 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.147091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmr4b\" (UniqueName: \"kubernetes.io/projected/623f04e8-7671-43f5-8390-773d6ce68100-kube-api-access-tmr4b\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.224227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.224149 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l"] Jun 03 19:34:43.226019 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:34:43.225965 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4c9830_aa9e_414e_9d3a_cbed47f98248.slice/crio-7434134ae55323ea3b22eec69d4042e5b651817ffedc00e61e991b8e9bb53aa9 WatchSource:0}: Error finding container 7434134ae55323ea3b22eec69d4042e5b651817ffedc00e61e991b8e9bb53aa9: Status 404 returned error can't find the container with id 7434134ae55323ea3b22eec69d4042e5b651817ffedc00e61e991b8e9bb53aa9 Jun 03 19:34:43.239426 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:34:43.239388 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cf4553_6400_44f0_96b6_890d2d4e5e1d.slice/crio-10dcf41b2e4633ee098dc66e49faaaa9163870690d9924d9e7da248a6b46ac0f WatchSource:0}: Error finding container 10dcf41b2e4633ee098dc66e49faaaa9163870690d9924d9e7da248a6b46ac0f: Status 404 returned error can't find the container with id 10dcf41b2e4633ee098dc66e49faaaa9163870690d9924d9e7da248a6b46ac0f Jun 03 19:34:43.242277 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.242216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv"] Jun 03 19:34:43.254217 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.254188 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g"] Jun 03 19:34:43.259790 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:34:43.259767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0659720b_b038_4398_b8e7_a91de5e42748.slice/crio-d5d3c5a53e59520e45fb8e66147825f4c3ea09c686366701d9a2571efafdfe6b WatchSource:0}: Error finding container d5d3c5a53e59520e45fb8e66147825f4c3ea09c686366701d9a2571efafdfe6b: Status 404 returned error can't find the container with id d5d3c5a53e59520e45fb8e66147825f4c3ea09c686366701d9a2571efafdfe6b Jun 03 19:34:43.273145 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.273049 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-hznlb"] Jun 03 19:34:43.275301 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:34:43.275276 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8abb5d_ba0e_48fb_adfa_fc46d20a21c7.slice/crio-9605f936fa2556acbca7f526ca5f848f2280d812ff5c5a80dd142943eb64e070 WatchSource:0}: Error finding container 9605f936fa2556acbca7f526ca5f848f2280d812ff5c5a80dd142943eb64e070: Status 404 returned error can't find the container with id 9605f936fa2556acbca7f526ca5f848f2280d812ff5c5a80dd142943eb64e070 Jun 03 19:34:43.439961 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.439932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:43.440122 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.440097 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:34:43.440183 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.440176 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls podName:24713439-7263-4467-a5de-0ad27e2c6140 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.440152997 +0000 UTC m=+249.136008710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-xc7cq" (UID: "24713439-7263-4467-a5de-0ad27e2c6140") : secret "samples-operator-tls" not found Jun 03 19:34:43.488881 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.488854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-hznlb" event={"ID":"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7","Type":"ContainerStarted","Data":"9605f936fa2556acbca7f526ca5f848f2280d812ff5c5a80dd142943eb64e070"} Jun 03 19:34:43.489851 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.489824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" event={"ID":"cb4c9830-aa9e-414e-9d3a-cbed47f98248","Type":"ContainerStarted","Data":"7434134ae55323ea3b22eec69d4042e5b651817ffedc00e61e991b8e9bb53aa9"} Jun 03 19:34:43.490955 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.490933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" event={"ID":"11cf4553-6400-44f0-96b6-890d2d4e5e1d","Type":"ContainerStarted","Data":"10dcf41b2e4633ee098dc66e49faaaa9163870690d9924d9e7da248a6b46ac0f"} Jun 03 19:34:43.492160 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.492139 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" event={"ID":"0659720b-b038-4398-b8e7-a91de5e42748","Type":"ContainerStarted","Data":"cb16e125e033c3e2fba3d5e645d9a4b9b9566885990353b29fc1e4f57d2a02b3"} Jun 03 19:34:43.492248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.492180 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" event={"ID":"0659720b-b038-4398-b8e7-a91de5e42748","Type":"ContainerStarted","Data":"d5d3c5a53e59520e45fb8e66147825f4c3ea09c686366701d9a2571efafdfe6b"} Jun 03 19:34:43.507845 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.507806 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cl25g" podStartSLOduration=1.507793613 podStartE2EDuration="1.507793613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:43.50696631 +0000 UTC m=+248.202822027" watchObservedRunningTime="2026-06-03 19:34:43.507793613 +0000 UTC m=+248.203649309" Jun 03 19:34:43.540403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.540379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:43.540518 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.540486 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:43.540573 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.540532 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.540520036 +0000 UTC m=+249.236375733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:43.640947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.640917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.641075 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:43.641061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:43.641145 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.641090 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:43.641194 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.641153 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.641135765 +0000 UTC m=+249.336991466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:43.641307 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:43.641293 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.641274356 +0000 UTC m=+249.337130066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:44.448033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.447993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:44.448446 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.448174 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:34:44.448446 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.448231 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls podName:24713439-7263-4467-a5de-0ad27e2c6140 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.448212543 +0000 UTC m=+251.144068241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-xc7cq" (UID: "24713439-7263-4467-a5de-0ad27e2c6140") : secret "samples-operator-tls" not found Jun 03 19:34:44.499703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.499628 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" event={"ID":"cb4c9830-aa9e-414e-9d3a-cbed47f98248","Type":"ContainerStarted","Data":"69343779e2c69806a4c43e570129718f644883707caf8fcd15cad9921859131d"} Jun 03 19:34:44.548661 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.548608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:44.548837 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.548820 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:44.548911 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.548889 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.548868469 +0000 UTC m=+251.244724180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:44.590688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.590606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:44.641307 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.641278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:44.649443 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.649379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:44.649543 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.649529 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:44.649587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:44.649558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:44.649626 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.649592 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.649573974 +0000 UTC m=+251.345429676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:44.649684 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:44.649665 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.649650385 +0000 UTC m=+251.345506085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:46.465460 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.465426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:46.465897 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.465605 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:34:46.465897 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.465683 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls podName:24713439-7263-4467-a5de-0ad27e2c6140 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.465663066 +0000 UTC m=+255.161518768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-xc7cq" (UID: "24713439-7263-4467-a5de-0ad27e2c6140") : secret "samples-operator-tls" not found Jun 03 19:34:46.507368 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.507330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" event={"ID":"11cf4553-6400-44f0-96b6-890d2d4e5e1d","Type":"ContainerStarted","Data":"c847c93cb201f8a1bf9b0720cdd054f9a9fc4b050a0d41c81e3a987c0b18991c"} Jun 03 19:34:46.508691 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.508667 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-hznlb" event={"ID":"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7","Type":"ContainerStarted","Data":"ee8f355dffe2165975e858368b2194812900b9b4c4c672f96bc5a826ff414dee"} Jun 03 19:34:46.524249 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.524200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7tz2l" podStartSLOduration=3.3555071180000002 podStartE2EDuration="4.524189428s" totalImagesPullingTime="1.16868231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:44.514395211 +0000 UTC m=+249.210250931" watchObservedRunningTime="2026-06-03 19:34:46.524189428 +0000 UTC m=+251.220045147" Jun 03 19:34:46.525003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.524977 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" podStartSLOduration=1.883041746 podStartE2EDuration="4.524971077s" totalImagesPullingTime="2.641929331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:46.523067678 +0000 UTC m=+251.218923397" watchObservedRunningTime="2026-06-03 19:34:46.524971077 +0000 UTC m=+251.220826795" Jun 03 19:34:46.566843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.566816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:46.566977 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.566916 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:46.566977 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.566968 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.56695486 +0000 UTC m=+255.262810557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:46.667595 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.667560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:46.667762 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.667725 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:46.667833 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.667797 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.667777392 +0000 UTC m=+255.363633093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:46.667946 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.667929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:46.668260 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:46.668226 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.668206894 +0000 UTC m=+255.364062602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:46.830496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.830415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:46.928167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:46.928128 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:47.026357 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:47.026329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:47.418698 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:47.418651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:47.575874 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:47.575845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:34:47.576225 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:47.575959 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:34:47.576225 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:47.576008 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs podName:b91d5e97-8471-4b51-8ea7-2bc33f6674c7 nodeName:}" failed. No retries permitted until 2026-06-03 19:36:49.575995159 +0000 UTC m=+374.271850856 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs") pod "network-metrics-daemon-77lpm" (UID: "b91d5e97-8471-4b51-8ea7-2bc33f6674c7") : secret "metrics-daemon-secret" not found Jun 03 19:34:48.038011 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.037982 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.090052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.090028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.409624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.409594 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.510087 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.510058 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.681282 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.681200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:48.784030 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:48.784002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:49.647649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:49.647620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:49.697355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:49.697328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:49.931869 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:49.931804 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dhdg_fa3f6443-6c02-4091-a04b-054ca3683d30/dns-node-resolver/0.log" Jun 03 19:34:50.279304 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.279175 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-hznlb" podStartSLOduration=5.669673169 podStartE2EDuration="8.279156849s" totalImagesPullingTime="2.60948368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:46.53785658 +0000 UTC m=+251.233712299" watchObservedRunningTime="2026-06-03 19:34:50.279156849 +0000 UTC m=+254.975012567" Jun 03 19:34:50.279541 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.279525 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k772c"] Jun 03 19:34:50.282377 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.282363 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.284772 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.284753 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 19:34:50.285049 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.285028 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 19:34:50.285167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.285050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 19:34:50.286376 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.286354 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 19:34:50.286376 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.286374 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v6wwn\"" Jun 03 19:34:50.289315 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.288968 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k772c"] Jun 03 19:34:50.307404 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.307381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:50.357067 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.357042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:50.401577 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.401558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/009d9b37-1002-42d8-8ef3-62636055bace-signing-key\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.401677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.401599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/009d9b37-1002-42d8-8ef3-62636055bace-signing-cabundle\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.401677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.401642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkhv\" (UniqueName: \"kubernetes.io/projected/009d9b37-1002-42d8-8ef3-62636055bace-kube-api-access-zmkhv\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.502562 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.502531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/009d9b37-1002-42d8-8ef3-62636055bace-signing-key\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.502711 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.502577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/009d9b37-1002-42d8-8ef3-62636055bace-signing-cabundle\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.502711 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.502614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:50.502711 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.502632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkhv\" (UniqueName: \"kubernetes.io/projected/009d9b37-1002-42d8-8ef3-62636055bace-kube-api-access-zmkhv\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.502855 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.502753 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:34:50.502855 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.502817 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls podName:24713439-7263-4467-a5de-0ad27e2c6140 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.502802693 +0000 UTC m=+263.198658390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-xc7cq" (UID: "24713439-7263-4467-a5de-0ad27e2c6140") : secret "samples-operator-tls" not found Jun 03 19:34:50.503305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.503287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/009d9b37-1002-42d8-8ef3-62636055bace-signing-cabundle\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.504919 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.504898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/009d9b37-1002-42d8-8ef3-62636055bace-signing-key\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.510700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.510682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkhv\" (UniqueName: \"kubernetes.io/projected/009d9b37-1002-42d8-8ef3-62636055bace-kube-api-access-zmkhv\") pod \"service-ca-7d74d578b8-k772c\" (UID: \"009d9b37-1002-42d8-8ef3-62636055bace\") " pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.592081 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.592054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k772c" Jun 03 19:34:50.603114 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.603084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:50.603658 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.603634 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:50.603752 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.603723 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.603702039 +0000 UTC m=+263.299557740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:50.704333 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.704303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:50.704707 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.704347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:50.704707 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.704460 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:50.704707 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.704515 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.704499637 +0000 UTC m=+263.400355336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:50.704707 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:50.704529 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.704523217 +0000 UTC m=+263.400378914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:50.709967 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.709934 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k772c"] Jun 03 19:34:50.712622 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:34:50.712599 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009d9b37_1002_42d8_8ef3_62636055bace.slice/crio-613a9fcc1a6492734fda8097a37fb5a8f07df86bbf13afe112b5108c85bf9db8 WatchSource:0}: Error finding container 613a9fcc1a6492734fda8097a37fb5a8f07df86bbf13afe112b5108c85bf9db8: Status 404 returned error can't find the container with id 613a9fcc1a6492734fda8097a37fb5a8f07df86bbf13afe112b5108c85bf9db8 Jun 03 19:34:50.932777 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:50.932713 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cm7lm_fb1fc591-025d-40f7-8b8c-c33b92125a66/node-ca/0.log" Jun 03 19:34:51.161629 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:51.161597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:51.523398 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:51.523366 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k772c" event={"ID":"009d9b37-1002-42d8-8ef3-62636055bace","Type":"ContainerStarted","Data":"613a9fcc1a6492734fda8097a37fb5a8f07df86bbf13afe112b5108c85bf9db8"} Jun 03 19:34:51.932055 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:51.932024 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nnnlv_fffae973-7b4c-446f-96b2-8164848342a2/serve-healthcheck-canary/0.log" Jun 03 19:34:52.734613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:52.734582 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv_11cf4553-6400-44f0-96b6-890d2d4e5e1d/kube-storage-version-migrator-operator/0.log" Jun 03 19:34:53.532941 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:53.532911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k772c" event={"ID":"009d9b37-1002-42d8-8ef3-62636055bace","Type":"ContainerStarted","Data":"a58076059556f969c35320d86623631f1a70c3dcc472426971962add36ccac58"} Jun 03 19:34:53.547253 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:53.547187 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-k772c" podStartSLOduration=1.317214737 podStartE2EDuration="3.54716976s" totalImagesPullingTime="2.229955023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:53.546741363 +0000 UTC m=+258.242597083" watchObservedRunningTime="2026-06-03 19:34:53.54716976 +0000 UTC m=+258.243025480" Jun 03 19:34:54.179670 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:54.179637 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:54.537310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:54.537212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:54.742886 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:54.742853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:54.844166 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:54.844131 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:54.943036 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:54.943007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:55.044449 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:55.044414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:55.233262 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:55.233170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:56.443380 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:56.443348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:56.624867 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:56.624838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:56.828760 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:56.828687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:57.020580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:57.020547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:57.219051 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:57.219022 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.215778 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.215748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.418540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.418507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.531398 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.531326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.568329 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.568303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:58.570649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.570629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24713439-7263-4467-a5de-0ad27e2c6140-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-xc7cq\" (UID: \"24713439-7263-4467-a5de-0ad27e2c6140\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:58.632075 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.632048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:58.669349 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.669323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:34:58.669496 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:58.669477 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:58.669562 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:58.669551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls podName:2e010408-d4d8-4013-8f9f-cf71e1791243 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:14.669533103 +0000 UTC m=+279.365388812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-qzq8f" (UID: "2e010408-d4d8-4013-8f9f-cf71e1791243") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:34:58.687173 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.687154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" Jun 03 19:34:58.770018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.769990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:58.770156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.770031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:34:58.770156 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:58.770127 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 19:34:58.770281 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:58.770154 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:14.770137036 +0000 UTC m=+279.465992736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : configmap references non-existent config key: service-ca.crt Jun 03 19:34:58.770281 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:34:58.770177 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs podName:623f04e8-7671-43f5-8390-773d6ce68100 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:14.770170237 +0000 UTC m=+279.466025933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs") pod "router-default-5c99bfd76f-46v5r" (UID: "623f04e8-7671-43f5-8390-773d6ce68100") : secret "router-metrics-certs-default" not found Jun 03 19:34:58.809571 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.809472 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq"] Jun 03 19:34:58.825853 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:58.825822 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:59.024086 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:59.024055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:59.216796 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:59.216766 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:34:59.551441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:59.551357 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" event={"ID":"24713439-7263-4467-a5de-0ad27e2c6140","Type":"ContainerStarted","Data":"3a25c796338d46bbaae7e9ed0f8d7a9053e0a49bf44dd3234ed849a5165c4779"} Jun 03 19:34:59.807208 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:34:59.807132 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:00.216980 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:00.216946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:00.418326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:00.418295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:00.823291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:00.823230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:01.023577 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:01.023546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:01.124255 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:01.124202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:01.438464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:01.438384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:01.561004 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:01.560970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" event={"ID":"24713439-7263-4467-a5de-0ad27e2c6140","Type":"ContainerStarted","Data":"75296d58051c735cb9039efb92571cd69ef9db0c4f2ede2c342a5552e0171f83"} Jun 03 19:35:01.561172 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:01.561016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" event={"ID":"24713439-7263-4467-a5de-0ad27e2c6140","Type":"ContainerStarted","Data":"701449bc09d6affb84f476e659ee5c604d3b53d06159a1efe47e9a5e43741fb6"} Jun 03 19:35:02.220139 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:02.220103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:02.493420 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:02.493337 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:02.615735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:02.615706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:02.828550 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:02.828469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:03.019961 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:03.019918 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:03.422360 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:03.422313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:04.017547 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:04.017520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:04.418189 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:04.418158 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:04.818196 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:04.818119 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:05.020468 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:05.020439 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:05.218514 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:05.218486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:09.842924 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:09.842891 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:09.943580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:09.943554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:10.001081 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:10.001058 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:10.332909 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:10.332886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:10.398583 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:10.398554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:10.526432 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:10.526405 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:11.533201 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:11.533173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:11.586808 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:11.586778 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:11.652112 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:11.652082 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:11.750442 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:11.750413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:11.850640 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:11.850619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:12.144042 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.143956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:12.154320 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.154277 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-xc7cq" podStartSLOduration=28.09030805 podStartE2EDuration="30.154262023s" totalImagesPullingTime="2.063953973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:01.575944137 +0000 UTC m=+266.271799857" watchObservedRunningTime="2026-06-03 19:35:12.154262023 +0000 UTC m=+276.850117739" Jun 03 19:35:12.154841 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.154826 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zdnmz"] Jun 03 19:35:12.157273 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.157259 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.159512 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.159492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkz7f\"" Jun 03 19:35:12.159788 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.159775 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:35:12.159854 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.159778 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:35:12.173376 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.173358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zdnmz"] Jun 03 19:35:12.286561 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.286535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af512cef-3556-49d8-8726-7ed4af20f2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.286561 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.286565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af512cef-3556-49d8-8726-7ed4af20f2be-crio-socket\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.286732 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.286583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af512cef-3556-49d8-8726-7ed4af20f2be-data-volume\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.286732 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.286714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af512cef-3556-49d8-8726-7ed4af20f2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.286800 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.286752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfn8f\" (UniqueName: \"kubernetes.io/projected/af512cef-3556-49d8-8726-7ed4af20f2be-kube-api-access-zfn8f\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.294642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.294606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:12.388048 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af512cef-3556-49d8-8726-7ed4af20f2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388211 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfn8f\" (UniqueName: \"kubernetes.io/projected/af512cef-3556-49d8-8726-7ed4af20f2be-kube-api-access-zfn8f\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388211 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af512cef-3556-49d8-8726-7ed4af20f2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388211 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af512cef-3556-49d8-8726-7ed4af20f2be-crio-socket\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af512cef-3556-49d8-8726-7ed4af20f2be-data-volume\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af512cef-3556-49d8-8726-7ed4af20f2be-crio-socket\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388569 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af512cef-3556-49d8-8726-7ed4af20f2be-data-volume\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.388623 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.388610 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af512cef-3556-49d8-8726-7ed4af20f2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.390282 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.390263 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af512cef-3556-49d8-8726-7ed4af20f2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.394801 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.394739 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:12.396731 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.396710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfn8f\" (UniqueName: \"kubernetes.io/projected/af512cef-3556-49d8-8726-7ed4af20f2be-kube-api-access-zfn8f\") pod \"insights-runtime-extractor-zdnmz\" (UID: \"af512cef-3556-49d8-8726-7ed4af20f2be\") " pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.465847 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.465820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zdnmz" Jun 03 19:35:12.587533 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:12.587502 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zdnmz"] Jun 03 19:35:12.590511 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:12.590484 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf512cef_3556_49d8_8726_7ed4af20f2be.slice/crio-11b65287db051a51fc3c2c6df1070fdccb02feaa67881f0ce608b3376fea6a98 WatchSource:0}: Error finding container 11b65287db051a51fc3c2c6df1070fdccb02feaa67881f0ce608b3376fea6a98: Status 404 returned error can't find the container with id 11b65287db051a51fc3c2c6df1070fdccb02feaa67881f0ce608b3376fea6a98 Jun 03 19:35:13.595951 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:13.595914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdnmz" event={"ID":"af512cef-3556-49d8-8726-7ed4af20f2be","Type":"ContainerStarted","Data":"d00d2c217300fc76a777983bf03f49dddc42f18ef1f45b7b5c4d493f4f0f736e"} Jun 03 19:35:13.596323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:13.595975 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdnmz" event={"ID":"af512cef-3556-49d8-8726-7ed4af20f2be","Type":"ContainerStarted","Data":"ee02ab62d748668b677a48b81d6c521be483d7663f1c7c54a723a57e6864e61f"} Jun 03 19:35:13.596323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:13.595995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdnmz" event={"ID":"af512cef-3556-49d8-8726-7ed4af20f2be","Type":"ContainerStarted","Data":"11b65287db051a51fc3c2c6df1070fdccb02feaa67881f0ce608b3376fea6a98"} Jun 03 19:35:14.706774 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.706735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:35:14.709587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.709560 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e010408-d4d8-4013-8f9f-cf71e1791243-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-qzq8f\" (UID: \"2e010408-d4d8-4013-8f9f-cf71e1791243\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:35:14.807459 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.807427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:14.807611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.807485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:14.808155 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.808128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/623f04e8-7671-43f5-8390-773d6ce68100-service-ca-bundle\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:14.809987 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.809959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/623f04e8-7671-43f5-8390-773d6ce68100-metrics-certs\") pod \"router-default-5c99bfd76f-46v5r\" (UID: \"623f04e8-7671-43f5-8390-773d6ce68100\") " pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:14.975125 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.975061 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" Jun 03 19:35:14.980250 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:14.980221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:15.185173 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.185146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c99bfd76f-46v5r"] Jun 03 19:35:15.187800 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:15.187769 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623f04e8_7671_43f5_8390_773d6ce68100.slice/crio-db246db85041fb2aa1a62453306de6384def18b19613731f81746057dcc1f3b6 WatchSource:0}: Error finding container db246db85041fb2aa1a62453306de6384def18b19613731f81746057dcc1f3b6: Status 404 returned error can't find the container with id db246db85041fb2aa1a62453306de6384def18b19613731f81746057dcc1f3b6 Jun 03 19:35:15.198733 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.198708 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f"] Jun 03 19:35:15.201140 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:15.201119 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e010408_d4d8_4013_8f9f_cf71e1791243.slice/crio-cb74b22b2a6ed203f66b953963a3bd935e8e828a2cf6db072929cf949c0e6478 WatchSource:0}: Error finding container cb74b22b2a6ed203f66b953963a3bd935e8e828a2cf6db072929cf949c0e6478: Status 404 returned error can't find the container with id cb74b22b2a6ed203f66b953963a3bd935e8e828a2cf6db072929cf949c0e6478 Jun 03 19:35:15.602956 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.602937 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" event={"ID":"2e010408-d4d8-4013-8f9f-cf71e1791243","Type":"ContainerStarted","Data":"cb74b22b2a6ed203f66b953963a3bd935e8e828a2cf6db072929cf949c0e6478"} Jun 03 19:35:15.604864 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.604842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdnmz" event={"ID":"af512cef-3556-49d8-8726-7ed4af20f2be","Type":"ContainerStarted","Data":"7ed366004b50c114404997160a8d6e272c9f4bb009a1fa1d90a7dc20e0759b4a"} Jun 03 19:35:15.606088 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.606068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" event={"ID":"623f04e8-7671-43f5-8390-773d6ce68100","Type":"ContainerStarted","Data":"84dd1e89c9b48e3cc961cd187bb2740ec613bba805b9716bf0105d187ef16e98"} Jun 03 19:35:15.606175 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.606104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" event={"ID":"623f04e8-7671-43f5-8390-773d6ce68100","Type":"ContainerStarted","Data":"db246db85041fb2aa1a62453306de6384def18b19613731f81746057dcc1f3b6"} Jun 03 19:35:15.621838 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.621799 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zdnmz" podStartSLOduration=0.838286672 podStartE2EDuration="3.621769329s" totalImagesPullingTime="2.783482657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:15.620626743 +0000 UTC m=+280.316482461" watchObservedRunningTime="2026-06-03 19:35:15.621769329 +0000 UTC m=+280.317625048" Jun 03 19:35:15.641134 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.641097 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" podStartSLOduration=33.641086693 podStartE2EDuration="33.641086693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:15.639850361 +0000 UTC m=+280.335706080" watchObservedRunningTime="2026-06-03 19:35:15.641086693 +0000 UTC m=+280.336942408" Jun 03 19:35:15.980726 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.980693 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:15.983872 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:15.983848 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:16.610094 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:16.610062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:16.611348 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:16.611320 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c99bfd76f-46v5r" Jun 03 19:35:16.775410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:16.775377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:16.828736 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:16.828701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.282173 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:17.282108 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2drfp" podUID="408ccba7-220b-4d2d-a232-617e6a90ab8c" Jun 03 19:35:17.282173 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:17.282108 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" Jun 03 19:35:17.462687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.462608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.564692 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.564664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.614422 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.614385 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" event={"ID":"2e010408-d4d8-4013-8f9f-cf71e1791243","Type":"ContainerStarted","Data":"e1ea9a09d4ae6d990bad40e1895c91ae181b449acdde5d109e419cbdf792b645"} Jun 03 19:35:17.614590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.614438 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:17.614590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.614395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:17.617178 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.617154 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm"] Jun 03 19:35:17.620149 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.620131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:17.622271 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.622256 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7d22x\"" Jun 03 19:35:17.622348 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.622259 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 19:35:17.627095 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.627071 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm"] Jun 03 19:35:17.634738 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.634710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.647651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.647609 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-qzq8f" podStartSLOduration=33.703591568 podStartE2EDuration="35.647596753s" totalImagesPullingTime="1.944005185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:17.634397024 +0000 UTC m=+282.330252756" watchObservedRunningTime="2026-06-03 19:35:17.647596753 +0000 UTC m=+282.343452472" Jun 03 19:35:17.734362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.734233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d705b782-0f50-48f8-8dd8-1d4adc5f1876-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lq6pm\" (UID: \"d705b782-0f50-48f8-8dd8-1d4adc5f1876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:17.835646 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.835611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d705b782-0f50-48f8-8dd8-1d4adc5f1876-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lq6pm\" (UID: \"d705b782-0f50-48f8-8dd8-1d4adc5f1876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:17.837981 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.837963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d705b782-0f50-48f8-8dd8-1d4adc5f1876-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lq6pm\" (UID: \"d705b782-0f50-48f8-8dd8-1d4adc5f1876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:17.848795 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.848772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:17.931100 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:17.931063 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:18.050860 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.050726 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm"] Jun 03 19:35:18.053369 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:18.053340 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd705b782_0f50_48f8_8dd8_1d4adc5f1876.slice/crio-c40f68bda30ad5443b7a896ebfb5d947373386236587350784b459f4dd83892e WatchSource:0}: Error finding container c40f68bda30ad5443b7a896ebfb5d947373386236587350784b459f4dd83892e: Status 404 returned error can't find the container with id c40f68bda30ad5443b7a896ebfb5d947373386236587350784b459f4dd83892e Jun 03 19:35:18.153492 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.153463 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:35:18.157722 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.157706 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.160431 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160408 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 19:35:18.160515 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160443 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 19:35:18.160515 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160476 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 19:35:18.160515 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160496 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 19:35:18.160658 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160444 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 19:35:18.160658 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.160537 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 19:35:18.161255 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.161217 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2n26n\"" Jun 03 19:35:18.161255 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.161248 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 19:35:18.169936 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.168411 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:35:18.238669 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.238833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238701 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.238833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.238833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238794 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.238833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.238979 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.238860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gvt\" (UniqueName: \"kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.339690 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gvt\" (UniqueName: \"kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.339858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340589 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.340564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340678 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.340599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.340678 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.340622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.342619 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.342600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.342787 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.342769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.347418 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.347399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gvt\" (UniqueName: \"kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt\") pod \"console-7d8bc79499-ktj4z\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.469586 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.469537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:18.590003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.589934 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:35:18.592740 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:18.592703 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc56020_e277_4c85_82cf_3bc755120522.slice/crio-7bfb8c2f3bcb4c8662043a0cac093c7a751f773dd25f67765dd23f518da3688f WatchSource:0}: Error finding container 7bfb8c2f3bcb4c8662043a0cac093c7a751f773dd25f67765dd23f518da3688f: Status 404 returned error can't find the container with id 7bfb8c2f3bcb4c8662043a0cac093c7a751f773dd25f67765dd23f518da3688f Jun 03 19:35:18.618896 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.618868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" event={"ID":"d705b782-0f50-48f8-8dd8-1d4adc5f1876","Type":"ContainerStarted","Data":"c40f68bda30ad5443b7a896ebfb5d947373386236587350784b459f4dd83892e"} Jun 03 19:35:18.620004 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:18.619979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bc79499-ktj4z" event={"ID":"8fc56020-e277-4c85-82cf-3bc755120522","Type":"ContainerStarted","Data":"7bfb8c2f3bcb4c8662043a0cac093c7a751f773dd25f67765dd23f518da3688f"} Jun 03 19:35:19.350000 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.349973 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:19.405003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.404961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:19.625054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.625015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" event={"ID":"d705b782-0f50-48f8-8dd8-1d4adc5f1876","Type":"ContainerStarted","Data":"e3592d7be6fa1d8c06aaf4d93f357a64c0c28012415b41960ce96ce287bc7114"} Jun 03 19:35:19.625322 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.625258 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:19.630549 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.630526 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" Jun 03 19:35:19.640864 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:19.640821 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lq6pm" podStartSLOduration=1.469478283 podStartE2EDuration="2.640806466s" totalImagesPullingTime="1.171328183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:19.639564964 +0000 UTC m=+284.335420697" watchObservedRunningTime="2026-06-03 19:35:19.640806466 +0000 UTC m=+284.336662202" Jun 03 19:35:20.645102 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.645064 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:20.661176 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.661150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:20.663530 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.663510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"image-registry-58654f7dd9-jgc47\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:20.712117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.712084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:20.762119 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.762091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:20.764747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.764720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/408ccba7-220b-4d2d-a232-617e6a90ab8c-metrics-tls\") pod \"dns-default-2drfp\" (UID: \"408ccba7-220b-4d2d-a232-617e6a90ab8c\") " pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:20.919355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.919269 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\"" Jun 03 19:35:20.919355 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.919269 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tr6t\"" Jun 03 19:35:20.926915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.926894 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:20.927042 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:20.927011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:21.034080 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:21.034046 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:21.754275 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:21.754223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:21.807165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:21.807135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:21.971682 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:21.971660 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:35:21.975525 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:21.975505 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe624a77_1259_4b39_946e_a63ab20ecc84.slice/crio-e30c6f8c64049569ccaadab27309a78bebf2a561c3240e7404d47bb9a0ac57f8 WatchSource:0}: Error finding container e30c6f8c64049569ccaadab27309a78bebf2a561c3240e7404d47bb9a0ac57f8: Status 404 returned error can't find the container with id e30c6f8c64049569ccaadab27309a78bebf2a561c3240e7404d47bb9a0ac57f8 Jun 03 19:35:21.991920 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:21.991895 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2drfp"] Jun 03 19:35:21.995172 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:21.995139 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408ccba7_220b_4d2d_a232_617e6a90ab8c.slice/crio-cb63d7c3e0882da34838cad396f89e4742c155a88f5aad9013c69d12c2ca6d82 WatchSource:0}: Error finding container cb63d7c3e0882da34838cad396f89e4742c155a88f5aad9013c69d12c2ca6d82: Status 404 returned error can't find the container with id cb63d7c3e0882da34838cad396f89e4742c155a88f5aad9013c69d12c2ca6d82 Jun 03 19:35:22.639030 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.638988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" event={"ID":"fe624a77-1259-4b39-946e-a63ab20ecc84","Type":"ContainerStarted","Data":"06371c7688ceb37690e98fe1570b44ca112e385397678e5b4c692b3be7e9cff8"} Jun 03 19:35:22.639667 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.639425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" event={"ID":"fe624a77-1259-4b39-946e-a63ab20ecc84","Type":"ContainerStarted","Data":"e30c6f8c64049569ccaadab27309a78bebf2a561c3240e7404d47bb9a0ac57f8"} Jun 03 19:35:22.639667 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.639632 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:22.645197 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.645171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2drfp" event={"ID":"408ccba7-220b-4d2d-a232-617e6a90ab8c","Type":"ContainerStarted","Data":"cb63d7c3e0882da34838cad396f89e4742c155a88f5aad9013c69d12c2ca6d82"} Jun 03 19:35:22.646922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.646894 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bc79499-ktj4z" event={"ID":"8fc56020-e277-4c85-82cf-3bc755120522","Type":"ContainerStarted","Data":"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e"} Jun 03 19:35:22.662904 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:22.662865 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" podStartSLOduration=286.662852049 podStartE2EDuration="4m46.662852049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:22.660849852 +0000 UTC m=+287.356705572" watchObservedRunningTime="2026-06-03 19:35:22.662852049 +0000 UTC m=+287.358707745" Jun 03 19:35:24.656295 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:24.656261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2drfp" event={"ID":"408ccba7-220b-4d2d-a232-617e6a90ab8c","Type":"ContainerStarted","Data":"7abc1732383125664e2709d94a45ac9f42fb03b6fc633ea558c6d5fb55fa3f8d"} Jun 03 19:35:24.656766 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:24.656319 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2drfp" event={"ID":"408ccba7-220b-4d2d-a232-617e6a90ab8c","Type":"ContainerStarted","Data":"a3087de1c36e694998790b61e4e70bad4fe5e6c9052f15e8d54703325d20eb6b"} Jun 03 19:35:24.656766 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:24.656370 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:24.672715 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:24.672671 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8bc79499-ktj4z" podStartSLOduration=3.370472647 podStartE2EDuration="6.672659781s" totalImagesPullingTime="3.302187134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:22.678514839 +0000 UTC m=+287.374370559" watchObservedRunningTime="2026-06-03 19:35:24.672659781 +0000 UTC m=+289.368515503" Jun 03 19:35:24.673222 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:24.673200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2drfp" podStartSLOduration=252.618856094 podStartE2EDuration="4m14.673193387s" totalImagesPullingTime="2.054337293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:24.671452271 +0000 UTC m=+289.367307990" watchObservedRunningTime="2026-06-03 19:35:24.673193387 +0000 UTC m=+289.369049116" Jun 03 19:35:26.352841 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:26.352795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:26.940288 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:26.940251 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:35:26.943463 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:26.943442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:26.955581 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:26.953896 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 19:35:26.955581 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:26.954876 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:35:27.010050 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch2qd\" (UniqueName: \"kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010383 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.010383 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.010216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch2qd\" (UniqueName: \"kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.111535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.111438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.112286 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.112228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.112416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.112228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.112416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.112332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.112416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.112367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.113790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.113763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.113790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.113779 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.118460 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.118440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch2qd\" (UniqueName: \"kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd\") pod \"console-7bcfff7dfc-678n4\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.258267 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.258161 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:27.383353 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.383323 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:35:27.386199 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:27.386173 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f11e84_8839_45b7_b853_b29372f171d3.slice/crio-9a5094cde06d22447cbc3b767875dc1a04a81ce49781d10789d773212c617e9a WatchSource:0}: Error finding container 9a5094cde06d22447cbc3b767875dc1a04a81ce49781d10789d773212c617e9a: Status 404 returned error can't find the container with id 9a5094cde06d22447cbc3b767875dc1a04a81ce49781d10789d773212c617e9a Jun 03 19:35:27.667934 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.667896 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfff7dfc-678n4" event={"ID":"19f11e84-8839-45b7-b853-b29372f171d3","Type":"ContainerStarted","Data":"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf"} Jun 03 19:35:27.668090 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.667948 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfff7dfc-678n4" event={"ID":"19f11e84-8839-45b7-b853-b29372f171d3","Type":"ContainerStarted","Data":"9a5094cde06d22447cbc3b767875dc1a04a81ce49781d10789d773212c617e9a"} Jun 03 19:35:27.684221 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:27.684178 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcfff7dfc-678n4" podStartSLOduration=1.684164555 podStartE2EDuration="1.684164555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:27.683796056 +0000 UTC m=+292.379651787" watchObservedRunningTime="2026-06-03 19:35:27.684164555 +0000 UTC m=+292.380020273" Jun 03 19:35:28.347565 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.347517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:28.405615 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.405583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:28.470281 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.470253 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:28.470434 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.470307 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:35:28.471706 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.471679 2573 patch_prober.go:28] interesting pod/console-7d8bc79499-ktj4z container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 03 19:35:28.471826 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:28.471724 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8bc79499-ktj4z" podUID="8fc56020-e277-4c85-82cf-3bc755120522" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 03 19:35:28.797767 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:28.797674 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-77lpm" podUID="b91d5e97-8471-4b51-8ea7-2bc33f6674c7" Jun 03 19:35:30.629690 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:30.629649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:32.772430 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:32.772397 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:32.910790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:32.910764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.006105 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.006067 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.052944 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.052869 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fkwhv"] Jun 03 19:35:33.056424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.056408 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.058643 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.058620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgvtv\"" Jun 03 19:35:33.059550 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.059533 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:35:33.059731 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.059579 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:35:33.059858 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.059591 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:35:33.059858 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.059607 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:35:33.082123 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.082091 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.164261 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-metrics-client-ca\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-textfile\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-wtmp\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-root\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-tls\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-sys\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.164687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.164607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jkbj\" (UniqueName: \"kubernetes.io/projected/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-kube-api-access-2jkbj\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.213340 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.213312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.265267 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-wtmp\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-root\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-tls\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-sys\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-root\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265382 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265374 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkbj\" (UniqueName: \"kubernetes.io/projected/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-kube-api-access-2jkbj\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265721 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-wtmp\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265721 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-sys\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265721 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-metrics-client-ca\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265721 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-textfile\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-textfile\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.265973 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.266027 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.265967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-metrics-client-ca\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.267699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.267682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.267780 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.267756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-node-exporter-tls\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.272918 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.272897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jkbj\" (UniqueName: \"kubernetes.io/projected/e12c7a0a-be02-4bd3-8640-0d4aa38ca392-kube-api-access-2jkbj\") pod \"node-exporter-fkwhv\" (UID: \"e12c7a0a-be02-4bd3-8640-0d4aa38ca392\") " pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.311052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.310995 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.368475 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.368454 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fkwhv" Jun 03 19:35:33.383046 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:33.383024 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12c7a0a_be02_4bd3_8640_0d4aa38ca392.slice/crio-1abc25ae69733caf5eee5065460be31a8360c4319a9ea7465c16ee4fa1d3952a WatchSource:0}: Error finding container 1abc25ae69733caf5eee5065460be31a8360c4319a9ea7465c16ee4fa1d3952a: Status 404 returned error can't find the container with id 1abc25ae69733caf5eee5065460be31a8360c4319a9ea7465c16ee4fa1d3952a Jun 03 19:35:33.410392 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.410366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.471543 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.471517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.554698 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.554667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.654370 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.654340 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.691455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.691425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkwhv" event={"ID":"e12c7a0a-be02-4bd3-8640-0d4aa38ca392","Type":"ContainerStarted","Data":"1abc25ae69733caf5eee5065460be31a8360c4319a9ea7465c16ee4fa1d3952a"} Jun 03 19:35:33.712358 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.712332 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:33.998037 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:33.997929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:34.077816 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.077782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:34.083410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.083386 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:35:34.086877 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.086860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.089323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089286 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 19:35:34.089323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 19:35:34.089487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 19:35:34.089487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089466 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 19:35:34.089487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089475 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 19:35:34.089626 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089507 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 19:35:34.089909 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089882 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 19:35:34.090003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089969 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7hf5\"" Jun 03 19:35:34.090059 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.090031 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 19:35:34.090106 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.089886 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 19:35:34.099332 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.099309 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:35:34.174535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174535 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wbwm\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.174974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.175216 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.174986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.175216 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.175008 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.275989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.275899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.275989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.275948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.275989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.275978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wbwm\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.276441 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:34.276399 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 19:35:34.280304 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:34.276473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls podName:55a5ecd6-cc23-4727-8042-5911bf001652 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:34.776452694 +0000 UTC m=+299.472308403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652") : secret "alertmanager-main-tls" not found Jun 03 19:35:34.280304 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.276675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.280304 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:34.276821 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle podName:55a5ecd6-cc23-4727-8042-5911bf001652 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:34.77680565 +0000 UTC m=+299.472661354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652") : configmap references non-existent config key: ca-bundle.crt Jun 03 19:35:34.280304 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.277504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.280304 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.279542 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.280931 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.280907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.281658 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.281627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.282452 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.281917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.282452 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.282348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.282596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.282452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.282869 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.282771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.283121 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.283080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.284929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.284891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wbwm\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.346753 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.346723 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:34.662142 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.662121 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2drfp" Jun 03 19:35:34.702146 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.702119 2573 generic.go:356] "Generic (PLEG): container finished" podID="e12c7a0a-be02-4bd3-8640-0d4aa38ca392" containerID="715d69d707d955a7547531051ae89b2befba983aaa05cad2806990f7796d289f" exitCode=0 Jun 03 19:35:34.702300 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.702205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkwhv" event={"ID":"e12c7a0a-be02-4bd3-8640-0d4aa38ca392","Type":"ContainerDied","Data":"715d69d707d955a7547531051ae89b2befba983aaa05cad2806990f7796d289f"} Jun 03 19:35:34.781800 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.781775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.782053 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.782026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.782772 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.782746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.784451 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.784426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:34.991134 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.991068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:34.994954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.994930 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg"] Jun 03 19:35:34.998595 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.998577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:34.998956 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:34.998629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:35:35.001101 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001072 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 19:35:35.001199 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001145 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 19:35:35.001199 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001107 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 19:35:35.001562 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001544 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 19:35:35.001635 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001593 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-qktnufdcpecc\"" Jun 03 19:35:35.001713 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001696 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 19:35:35.001816 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.001800 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9n7ws\"" Jun 03 19:35:35.010970 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.010949 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg"] Jun 03 19:35:35.084876 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.084851 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.084919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.084944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.084987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtqs\" (UniqueName: \"kubernetes.io/projected/c33c5f76-4db9-48e9-90a7-875c4a5996d4-kube-api-access-vjtqs\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.085020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085271 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.085048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085271 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.085073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-grpc-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.085271 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.085108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33c5f76-4db9-48e9-90a7-875c4a5996d4-metrics-client-ca\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.131664 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.131591 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:35:35.133693 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:35.133666 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a5ecd6_cc23_4727_8042_5911bf001652.slice/crio-36fa0d8097f8c0ed53097f98e23e339e9e03f4ed6b37a15facb62e100dfa0008 WatchSource:0}: Error finding container 36fa0d8097f8c0ed53097f98e23e339e9e03f4ed6b37a15facb62e100dfa0008: Status 404 returned error can't find the container with id 36fa0d8097f8c0ed53097f98e23e339e9e03f4ed6b37a15facb62e100dfa0008 Jun 03 19:35:35.186390 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186498 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186498 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtqs\" (UniqueName: \"kubernetes.io/projected/c33c5f76-4db9-48e9-90a7-875c4a5996d4-kube-api-access-vjtqs\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186498 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186498 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186750 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-grpc-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186811 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33c5f76-4db9-48e9-90a7-875c4a5996d4-metrics-client-ca\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.186923 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.186846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.187677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.187649 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33c5f76-4db9-48e9-90a7-875c4a5996d4-metrics-client-ca\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.188984 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.188962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.189093 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.189077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.189360 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.189341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.189401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.189346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.189910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.189893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-grpc-tls\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.189960 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.189938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33c5f76-4db9-48e9-90a7-875c4a5996d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.193950 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.193926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtqs\" (UniqueName: \"kubernetes.io/projected/c33c5f76-4db9-48e9-90a7-875c4a5996d4-kube-api-access-vjtqs\") pod \"thanos-querier-9ffd8dbb9-cwvdg\" (UID: \"c33c5f76-4db9-48e9-90a7-875c4a5996d4\") " pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.307994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.307931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:35.451653 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.451625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg"] Jun 03 19:35:35.455071 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:35.455039 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33c5f76_4db9_48e9_90a7_875c4a5996d4.slice/crio-ef5bd6dd57d5fa6e6b9596522d98d790644ed557a5aa3025fe84b75c55106457 WatchSource:0}: Error finding container ef5bd6dd57d5fa6e6b9596522d98d790644ed557a5aa3025fe84b75c55106457: Status 404 returned error can't find the container with id ef5bd6dd57d5fa6e6b9596522d98d790644ed557a5aa3025fe84b75c55106457 Jun 03 19:35:35.707596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.707566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"ef5bd6dd57d5fa6e6b9596522d98d790644ed557a5aa3025fe84b75c55106457"} Jun 03 19:35:35.709929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.709899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkwhv" event={"ID":"e12c7a0a-be02-4bd3-8640-0d4aa38ca392","Type":"ContainerStarted","Data":"aa5f2442017523ace3fd428de50afd250c34dfd635079ff91edfd17e0e6136d7"} Jun 03 19:35:35.710044 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.709945 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkwhv" event={"ID":"e12c7a0a-be02-4bd3-8640-0d4aa38ca392","Type":"ContainerStarted","Data":"13cee03d2c6f80aa400dfd2522a0ed3b79991553221bde06d94c255d5f9e2464"} Jun 03 19:35:35.711199 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.711170 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"36fa0d8097f8c0ed53097f98e23e339e9e03f4ed6b37a15facb62e100dfa0008"} Jun 03 19:35:35.729823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.729774 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fkwhv" podStartSLOduration=1.692229524 podStartE2EDuration="2.729757149s" totalImagesPullingTime="972.492562ms" totalInitContainerRuntime="65.035063ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:35.728737157 +0000 UTC m=+300.424592878" watchObservedRunningTime="2026-06-03 19:35:35.729757149 +0000 UTC m=+300.425612870" Jun 03 19:35:35.745201 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.745172 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:35:35.745947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.745919 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:35:35.759465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.759445 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:35:35.933580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:35.933550 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.032776 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:36.032480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.213577 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:36.213544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.314152 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:36.314077 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:36.716283 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:36.716231 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863" exitCode=0 Jun 03 19:35:36.716283 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:36.716266 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863"} Jun 03 19:35:37.258782 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.258744 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:37.259269 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.258810 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:37.260329 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.260297 2573 patch_prober.go:28] interesting pod/console-7bcfff7dfc-678n4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 03 19:35:37.260454 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.260352 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bcfff7dfc-678n4" podUID="19f11e84-8839-45b7-b853-b29372f171d3" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 03 19:35:37.534472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.534451 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:35:37.722120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.722089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"7717c5cfc386d5c65a83739771c2a5ab51e08cb42247368ee17929d0c2ea280b"} Jun 03 19:35:37.722293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.722149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"8f856c4b59e84f6a353986aa6a0224793013bbc4d2635fe2d08e715477d57d19"} Jun 03 19:35:37.722293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.722178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"91152f95b9f0cb13b929bb1b916d01a08a97cb481d067568535aacf85bccab6f"} Jun 03 19:35:37.797081 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.797000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:37.805580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.805550 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp"] Jun 03 19:35:37.814391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.814364 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:35:37.814534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.814492 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:37.816785 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.816188 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp"] Jun 03 19:35:37.818683 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.818128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 19:35:37.820110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.819900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mxghd\"" Jun 03 19:35:37.841511 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.841488 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:35:37.844974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.844943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:37.853852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.853831 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:35:37.913060 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.913029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:37.913255 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:37.913087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfgm\" (UniqueName: \"kubernetes.io/projected/65fea322-25e0-4190-8948-34c8e0ff1603-kube-api-access-ldfgm\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.014021 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.013965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfgm\" (UniqueName: \"kubernetes.io/projected/65fea322-25e0-4190-8948-34c8e0ff1603-kube-api-access-ldfgm\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:38.014120 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014194 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:35:38.014191 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert podName:65fea322-25e0-4190-8948-34c8e0ff1603 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:38.514169984 +0000 UTC m=+303.210025697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert") pod "monitoring-plugin-9b9fc658-fxsxp" (UID: "65fea322-25e0-4190-8948-34c8e0ff1603") : secret "monitoring-plugin-cert" not found Jun 03 19:35:38.014590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014318 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sq5v\" (UniqueName: \"kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.014590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.014428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.023311 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.023283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfgm\" (UniqueName: \"kubernetes.io/projected/65fea322-25e0-4190-8948-34c8e0ff1603-kube-api-access-ldfgm\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.115312 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115376 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.115716 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.115489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sq5v\" (UniqueName: \"kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.116155 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.116133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.116284 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.116131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.116284 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.116209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.116284 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.116214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.117839 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.117819 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.117968 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.117951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.124187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.124167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sq5v\" (UniqueName: \"kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v\") pod \"console-5b78545c67-jr9mr\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.156267 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.156221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:38.519281 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.519201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.521736 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.521717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/65fea322-25e0-4190-8948-34c8e0ff1603-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-fxsxp\" (UID: \"65fea322-25e0-4190-8948-34c8e0ff1603\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.731464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.731437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"6fd02b16dbe15a4ac693e27e259153d73730297b010cea03cfd4020d7f2a5714"} Jun 03 19:35:38.734310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.734204 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6"} Jun 03 19:35:38.734416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.734329 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:38.796742 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.795933 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:35:38.920921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:38.920888 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp"] Jun 03 19:35:38.932111 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:35:38.932080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fea322_25e0_4190_8948_34c8e0ff1603.slice/crio-c95dd0b2fcaadf1fc52209061c40509ab064d1f4dcc1fd200561ee0745e93dbf WatchSource:0}: Error finding container c95dd0b2fcaadf1fc52209061c40509ab064d1f4dcc1fd200561ee0745e93dbf: Status 404 returned error can't find the container with id c95dd0b2fcaadf1fc52209061c40509ab064d1f4dcc1fd200561ee0745e93dbf Jun 03 19:35:39.087129 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.087105 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:39.201564 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.201525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:39.741626 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.741587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3"} Jun 03 19:35:39.742046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.741656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308"} Jun 03 19:35:39.742046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.741684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117"} Jun 03 19:35:39.742046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.741709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968"} Jun 03 19:35:39.742046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.741745 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerStarted","Data":"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579"} Jun 03 19:35:39.742775 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.742754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" event={"ID":"65fea322-25e0-4190-8948-34c8e0ff1603","Type":"ContainerStarted","Data":"c95dd0b2fcaadf1fc52209061c40509ab064d1f4dcc1fd200561ee0745e93dbf"} Jun 03 19:35:39.744117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.744095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b78545c67-jr9mr" event={"ID":"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778","Type":"ContainerStarted","Data":"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b"} Jun 03 19:35:39.744215 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.744130 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b78545c67-jr9mr" event={"ID":"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778","Type":"ContainerStarted","Data":"99d04e6e27ae269169e049ae35bcef5836506de044c468e24df39e542881aa79"} Jun 03 19:35:39.746887 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.746865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"9a3467763c01f73fb28cf0592a315071e17c9f9c26e4a23c5db6a8e0cd90fa76"} Jun 03 19:35:39.746968 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.746911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" event={"ID":"c33c5f76-4db9-48e9-90a7-875c4a5996d4","Type":"ContainerStarted","Data":"3f1e67784b556113acc6664e9023b69d15a79db82a0966fce5746a7455cc7683"} Jun 03 19:35:39.747039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.747025 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:39.766756 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.766685 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4802892229999998 podStartE2EDuration="5.766665223s" totalImagesPullingTime="3.268552906s" totalInitContainerRuntime="17.823094ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:39.764535577 +0000 UTC m=+304.460391309" watchObservedRunningTime="2026-06-03 19:35:39.766665223 +0000 UTC m=+304.462520945" Jun 03 19:35:39.782705 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.782665 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b78545c67-jr9mr" podStartSLOduration=2.782652434 podStartE2EDuration="2.782652434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:39.782080036 +0000 UTC m=+304.477935767" watchObservedRunningTime="2026-06-03 19:35:39.782652434 +0000 UTC m=+304.478508152" Jun 03 19:35:39.802860 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:39.802472 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" podStartSLOduration=2.796884933 podStartE2EDuration="5.802453597s" totalImagesPullingTime="3.005568664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:39.801704974 +0000 UTC m=+304.497560694" watchObservedRunningTime="2026-06-03 19:35:39.802453597 +0000 UTC m=+304.498309317" Jun 03 19:35:40.754401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.754218 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" event={"ID":"65fea322-25e0-4190-8948-34c8e0ff1603","Type":"ContainerStarted","Data":"7f566d35781f773d76e51d9322d5e1bbe308f03bc84e09dd9992867239a7b8e3"} Jun 03 19:35:40.754401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.754298 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:40.758994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.758970 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" Jun 03 19:35:40.764957 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.764933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:40.770393 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.770356 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-fxsxp" podStartSLOduration=2.260087196 podStartE2EDuration="3.77034381s" totalImagesPullingTime="1.510256614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:40.768684067 +0000 UTC m=+305.464539787" watchObservedRunningTime="2026-06-03 19:35:40.77034381 +0000 UTC m=+305.466199567" Jun 03 19:35:40.863618 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.863589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:40.931791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.931759 2573 patch_prober.go:28] interesting pod/image-registry-58654f7dd9-jgc47 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 19:35:40.931944 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:40.931807 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:35:41.795977 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:41.795940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:35:43.655648 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:43.655620 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:35:43.768762 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:43.768731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:43.822302 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:43.822275 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:43.938581 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:43.938505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.040039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:44.040007 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.282540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:44.282468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.338846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:44.338821 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:44.686277 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:44.686248 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:35:44.761414 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:44.761382 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:45.135065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:45.135035 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:45.212548 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:45.212521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:45.760954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:45.760930 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9ffd8dbb9-cwvdg" Jun 03 19:35:46.107310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:46.107278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:46.209774 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:46.209713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:47.263450 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:47.263422 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:47.267312 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:47.267291 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:35:47.405552 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:47.405517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:47.504359 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:47.504324 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:48.157308 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.157276 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:48.157487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.157335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:48.162117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.162089 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:48.789805 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.789778 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:35:48.833768 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.833743 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:35:48.946946 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:48.946915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:49.053052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:49.052970 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:49.149989 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:49.149958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:51.276564 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:51.276534 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:51.378167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:51.378143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:51.800689 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:51.800657 2573 generic.go:356] "Generic (PLEG): container finished" podID="11cf4553-6400-44f0-96b6-890d2d4e5e1d" containerID="c847c93cb201f8a1bf9b0720cdd054f9a9fc4b050a0d41c81e3a987c0b18991c" exitCode=0 Jun 03 19:35:51.800689 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:51.800687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" event={"ID":"11cf4553-6400-44f0-96b6-890d2d4e5e1d","Type":"ContainerDied","Data":"c847c93cb201f8a1bf9b0720cdd054f9a9fc4b050a0d41c81e3a987c0b18991c"} Jun 03 19:35:51.800938 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:51.800926 2573 scope.go:117] "RemoveContainer" containerID="c847c93cb201f8a1bf9b0720cdd054f9a9fc4b050a0d41c81e3a987c0b18991c" Jun 03 19:35:52.683285 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:52.683254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:52.783049 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:52.782998 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:52.806159 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:52.806134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv" event={"ID":"11cf4553-6400-44f0-96b6-890d2d4e5e1d","Type":"ContainerStarted","Data":"b2ec0b968d4a66711ebeb6fb8e61de34ee4cf5d8177c82bf6f591a8483e1886d"} Jun 03 19:35:52.881734 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:52.881709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:53.361615 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:53.361577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:35:53.464315 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:35:53.464283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:01.848661 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:01.848631 2573 generic.go:356] "Generic (PLEG): container finished" podID="ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7" containerID="ee8f355dffe2165975e858368b2194812900b9b4c4c672f96bc5a826ff414dee" exitCode=0 Jun 03 19:36:01.848973 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:01.848692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-hznlb" event={"ID":"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7","Type":"ContainerDied","Data":"ee8f355dffe2165975e858368b2194812900b9b4c4c672f96bc5a826ff414dee"} Jun 03 19:36:01.849065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:01.849048 2573 scope.go:117] "RemoveContainer" containerID="ee8f355dffe2165975e858368b2194812900b9b4c4c672f96bc5a826ff414dee" Jun 03 19:36:02.843526 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:02.843489 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d8bc79499-ktj4z" podUID="8fc56020-e277-4c85-82cf-3bc755120522" containerName="console" containerID="cri-o://a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e" gracePeriod=15 Jun 03 19:36:02.854993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:02.854965 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-hznlb" event={"ID":"ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7","Type":"ContainerStarted","Data":"423587591a9af831178a0ae2a174c1d15923a2472af60cd71b91246eee6812b0"} Jun 03 19:36:03.081764 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.081742 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:36:03.130293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130217 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130292 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130336 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130369 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130480 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42gvt\" (UniqueName: \"kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130528 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config\") pod \"8fc56020-e277-4c85-82cf-3bc755120522\" (UID: \"8fc56020-e277-4c85-82cf-3bc755120522\") " Jun 03 19:36:03.130636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130609 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config" (OuterVolumeSpecName: "console-config") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:03.130737 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130714 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:03.130821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130723 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca" (OuterVolumeSpecName: "service-ca") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:03.130871 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130844 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-console-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.130871 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130858 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-oauth-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.130871 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.130868 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fc56020-e277-4c85-82cf-3bc755120522-service-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.132626 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.132607 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:03.132744 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.132721 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt" (OuterVolumeSpecName: "kube-api-access-42gvt") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "kube-api-access-42gvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:03.132744 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.132728 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8fc56020-e277-4c85-82cf-3bc755120522" (UID: "8fc56020-e277-4c85-82cf-3bc755120522"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:03.232072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.232045 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.232072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.232067 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42gvt\" (UniqueName: \"kubernetes.io/projected/8fc56020-e277-4c85-82cf-3bc755120522-kube-api-access-42gvt\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.232072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.232076 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fc56020-e277-4c85-82cf-3bc755120522-console-oauth-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:03.404180 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.404088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:03.860051 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.860022 2573 generic.go:356] "Generic (PLEG): container finished" podID="8fc56020-e277-4c85-82cf-3bc755120522" containerID="a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e" exitCode=0 Jun 03 19:36:03.860466 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.860066 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bc79499-ktj4z" Jun 03 19:36:03.860466 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.860065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bc79499-ktj4z" event={"ID":"8fc56020-e277-4c85-82cf-3bc755120522","Type":"ContainerDied","Data":"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e"} Jun 03 19:36:03.860466 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.860186 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bc79499-ktj4z" event={"ID":"8fc56020-e277-4c85-82cf-3bc755120522","Type":"ContainerDied","Data":"7bfb8c2f3bcb4c8662043a0cac093c7a751f773dd25f67765dd23f518da3688f"} Jun 03 19:36:03.860466 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.860211 2573 scope.go:117] "RemoveContainer" containerID="a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e" Jun 03 19:36:03.868294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.868274 2573 scope.go:117] "RemoveContainer" containerID="a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e" Jun 03 19:36:03.868571 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:03.868549 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e\": container with ID starting with a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e not found: ID does not exist" containerID="a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e" Jun 03 19:36:03.868647 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.868584 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e"} err="failed to get container status \"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e\": rpc error: code = NotFound desc = could not find container \"a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e\": container with ID starting with a30525e5140d9e29d436dff5456461cc2c9a2d7e491e4ec6108db0252312568e not found: ID does not exist" Jun 03 19:36:03.889291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.889262 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:36:03.891152 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:03.891128 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8bc79499-ktj4z"] Jun 03 19:36:05.800431 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:05.800401 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc56020-e277-4c85-82cf-3bc755120522" path="/var/lib/kubelet/pods/8fc56020-e277-4c85-82cf-3bc755120522/volumes" Jun 03 19:36:09.705491 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:09.705447 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerName="registry" containerID="cri-o://06371c7688ceb37690e98fe1570b44ca112e385397678e5b4c692b3be7e9cff8" gracePeriod=30 Jun 03 19:36:09.888624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:09.888592 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerID="06371c7688ceb37690e98fe1570b44ca112e385397678e5b4c692b3be7e9cff8" exitCode=0 Jun 03 19:36:09.888746 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:09.888622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" event={"ID":"fe624a77-1259-4b39-946e-a63ab20ecc84","Type":"ContainerDied","Data":"06371c7688ceb37690e98fe1570b44ca112e385397678e5b4c692b3be7e9cff8"} Jun 03 19:36:09.940800 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:09.940779 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:36:10.089060 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089034 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwq5r\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089070 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089118 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089149 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089198 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089256 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089298 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089331 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token\") pod \"fe624a77-1259-4b39-946e-a63ab20ecc84\" (UID: \"fe624a77-1259-4b39-946e-a63ab20ecc84\") " Jun 03 19:36:10.089788 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089741 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:10.089788 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.089754 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:10.091775 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.091742 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:10.091873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.091776 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:10.091873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.091848 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:10.091965 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.091872 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r" (OuterVolumeSpecName: "kube-api-access-pwq5r") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "kube-api-access-pwq5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:10.091965 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.091891 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:10.098528 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.098502 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fe624a77-1259-4b39-946e-a63ab20ecc84" (UID: "fe624a77-1259-4b39-946e-a63ab20ecc84"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:10.190182 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190151 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-image-registry-private-configuration\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190182 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190177 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-trusted-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190191 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-certificates\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190203 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-registry-tls\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190214 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe624a77-1259-4b39-946e-a63ab20ecc84-ca-trust-extracted\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190226 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-bound-sa-token\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190261 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwq5r\" (UniqueName: \"kubernetes.io/projected/fe624a77-1259-4b39-946e-a63ab20ecc84-kube-api-access-pwq5r\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.190356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.190274 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe624a77-1259-4b39-946e-a63ab20ecc84-installation-pull-secrets\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:10.893580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.893550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" event={"ID":"fe624a77-1259-4b39-946e-a63ab20ecc84","Type":"ContainerDied","Data":"e30c6f8c64049569ccaadab27309a78bebf2a561c3240e7404d47bb9a0ac57f8"} Jun 03 19:36:10.894011 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.893606 2573 scope.go:117] "RemoveContainer" containerID="06371c7688ceb37690e98fe1570b44ca112e385397678e5b4c692b3be7e9cff8" Jun 03 19:36:10.894011 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.893565 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58654f7dd9-jgc47" Jun 03 19:36:10.914604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.914582 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:36:10.921624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:10.921599 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58654f7dd9-jgc47"] Jun 03 19:36:11.800827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:11.800794 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" path="/var/lib/kubelet/pods/fe624a77-1259-4b39-946e-a63ab20ecc84/volumes" Jun 03 19:36:12.966153 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:12.966121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:13.022456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:13.022426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:13.856778 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:13.856734 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bcfff7dfc-678n4" podUID="19f11e84-8839-45b7-b853-b29372f171d3" containerName="console" containerID="cri-o://4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf" gracePeriod=15 Jun 03 19:36:14.131651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.131589 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:36:14.225971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.225940 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch2qd\" (UniqueName: \"kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.225971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.225978 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226014 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226047 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226077 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226125 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226225 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226173 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca\") pod \"19f11e84-8839-45b7-b853-b29372f171d3\" (UID: \"19f11e84-8839-45b7-b853-b29372f171d3\") " Jun 03 19:36:14.226569 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226435 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config" (OuterVolumeSpecName: "console-config") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:14.226659 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226634 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:14.226751 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226724 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:14.226909 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.226886 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:14.228192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.228158 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd" (OuterVolumeSpecName: "kube-api-access-ch2qd") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "kube-api-access-ch2qd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:14.228366 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.228341 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:14.228733 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.228710 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19f11e84-8839-45b7-b853-b29372f171d3" (UID: "19f11e84-8839-45b7-b853-b29372f171d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:14.327367 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327335 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327367 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327363 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-console-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327367 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327373 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f11e84-8839-45b7-b853-b29372f171d3-console-oauth-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327382 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-trusted-ca-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327390 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-service-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327398 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch2qd\" (UniqueName: \"kubernetes.io/projected/19f11e84-8839-45b7-b853-b29372f171d3-kube-api-access-ch2qd\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.327576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.327407 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f11e84-8839-45b7-b853-b29372f171d3-oauth-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:14.921908 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.921862 2573 generic.go:356] "Generic (PLEG): container finished" podID="19f11e84-8839-45b7-b853-b29372f171d3" containerID="4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf" exitCode=0 Jun 03 19:36:14.922110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.922027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfff7dfc-678n4" event={"ID":"19f11e84-8839-45b7-b853-b29372f171d3","Type":"ContainerDied","Data":"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf"} Jun 03 19:36:14.922110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.922075 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfff7dfc-678n4" event={"ID":"19f11e84-8839-45b7-b853-b29372f171d3","Type":"ContainerDied","Data":"9a5094cde06d22447cbc3b767875dc1a04a81ce49781d10789d773212c617e9a"} Jun 03 19:36:14.922110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.922102 2573 scope.go:117] "RemoveContainer" containerID="4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf" Jun 03 19:36:14.922305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.922281 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfff7dfc-678n4" Jun 03 19:36:14.940800 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.940777 2573 scope.go:117] "RemoveContainer" containerID="4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf" Jun 03 19:36:14.941044 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:14.941025 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf\": container with ID starting with 4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf not found: ID does not exist" containerID="4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf" Jun 03 19:36:14.941098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.941053 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf"} err="failed to get container status \"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf\": rpc error: code = NotFound desc = could not find container \"4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf\": container with ID starting with 4520d7bea7051e9ddc5553fd12bc846cbbbad54ed7f45a549710300bcfa8b6bf not found: ID does not exist" Jun 03 19:36:14.948163 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.948142 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:36:14.952449 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:14.952426 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcfff7dfc-678n4"] Jun 03 19:36:15.806216 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:15.806185 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f11e84-8839-45b7-b853-b29372f171d3" path="/var/lib/kubelet/pods/19f11e84-8839-45b7-b853-b29372f171d3/volumes" Jun 03 19:36:49.601855 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:49.601805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:36:49.604118 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:49.604094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d5e97-8471-4b51-8ea7-2bc33f6674c7-metrics-certs\") pod \"network-metrics-daemon-77lpm\" (UID: \"b91d5e97-8471-4b51-8ea7-2bc33f6674c7\") " pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:36:49.899768 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:49.899693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\"" Jun 03 19:36:49.907855 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:49.907840 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77lpm" Jun 03 19:36:50.046702 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:50.046650 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77lpm"] Jun 03 19:36:50.049139 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:36:50.049114 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d5e97_8471_4b51_8ea7_2bc33f6674c7.slice/crio-5913b9f2d4d247c32e2a021d545fac5bc97bb9cbe7aed71deac5c44bb3fc1205 WatchSource:0}: Error finding container 5913b9f2d4d247c32e2a021d545fac5bc97bb9cbe7aed71deac5c44bb3fc1205: Status 404 returned error can't find the container with id 5913b9f2d4d247c32e2a021d545fac5bc97bb9cbe7aed71deac5c44bb3fc1205 Jun 03 19:36:50.062511 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:50.062482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77lpm" event={"ID":"b91d5e97-8471-4b51-8ea7-2bc33f6674c7","Type":"ContainerStarted","Data":"5913b9f2d4d247c32e2a021d545fac5bc97bb9cbe7aed71deac5c44bb3fc1205"} Jun 03 19:36:51.069620 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.069593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77lpm" event={"ID":"b91d5e97-8471-4b51-8ea7-2bc33f6674c7","Type":"ContainerStarted","Data":"aa71dccc405b2a5c7d173d3b5e9f33ccc09c50df75d5874161d6d9cf966e7320"} Jun 03 19:36:51.069939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.069644 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77lpm" event={"ID":"b91d5e97-8471-4b51-8ea7-2bc33f6674c7","Type":"ContainerStarted","Data":"5d60119fc520234179bba01b9e382b92a53dcddd6d870fa15caa74b33cad405c"} Jun 03 19:36:51.087030 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.086983 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-77lpm" podStartSLOduration=375.247544474 podStartE2EDuration="6m16.086968448s" totalImagesPullingTime="839.423974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:51.085130385 +0000 UTC m=+375.780986136" watchObservedRunningTime="2026-06-03 19:36:51.086968448 +0000 UTC m=+375.782824184" Jun 03 19:36:51.215422 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.215342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:51.316810 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.316782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:51.369864 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:51.369845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:52.227458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:52.227421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:52.325219 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:52.325182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:36:53.287151 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287119 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:53.287553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287439 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="alertmanager" containerID="cri-o://3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" gracePeriod=120 Jun 03 19:36:53.287553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287510 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-metric" containerID="cri-o://9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" gracePeriod=120 Jun 03 19:36:53.287553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287530 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="prom-label-proxy" containerID="cri-o://71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" gracePeriod=120 Jun 03 19:36:53.287703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287562 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-web" containerID="cri-o://410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" gracePeriod=120 Jun 03 19:36:53.287703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287612 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy" containerID="cri-o://434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" gracePeriod=120 Jun 03 19:36:53.287703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:53.287590 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="config-reloader" containerID="cri-o://81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" gracePeriod=120 Jun 03 19:36:54.084299 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084266 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3"} Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084262 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" exitCode=0 Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084339 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" exitCode=0 Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084349 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" exitCode=0 Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084359 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" exitCode=0 Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117"} Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579"} Jun 03 19:36:54.084458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.084450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6"} Jun 03 19:36:54.528589 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.528566 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:54.641790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641717 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wbwm\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.641790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641751 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.641790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641774 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641798 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641924 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.641986 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642028 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642056 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642092 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642126 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642162 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642197 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642301 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642226 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web\") pod \"55a5ecd6-cc23-4727-8042-5911bf001652\" (UID: \"55a5ecd6-cc23-4727-8042-5911bf001652\") " Jun 03 19:36:54.642606 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642460 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:54.642875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.642844 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:36:54.643733 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.643706 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:54.644465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.644434 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm" (OuterVolumeSpecName: "kube-api-access-4wbwm") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "kube-api-access-4wbwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:54.644705 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.644659 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.644895 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.644856 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.645353 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.645320 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.645530 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.645441 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.645530 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.645503 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume" (OuterVolumeSpecName: "config-volume") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.645670 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.645527 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out" (OuterVolumeSpecName: "config-out") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:54.646411 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.646383 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:54.649747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.649710 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.655910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.655892 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config" (OuterVolumeSpecName: "web-config") pod "55a5ecd6-cc23-4727-8042-5911bf001652" (UID: "55a5ecd6-cc23-4727-8042-5911bf001652"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:36:54.743680 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743658 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-tls-assets\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743680 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743680 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-main-db\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743692 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743702 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wbwm\" (UniqueName: \"kubernetes.io/projected/55a5ecd6-cc23-4727-8042-5911bf001652-kube-api-access-4wbwm\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743710 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55a5ecd6-cc23-4727-8042-5911bf001652-config-out\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743718 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-web-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743725 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743734 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-main-tls\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743742 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743751 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743759 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-config-volume\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743768 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55a5ecd6-cc23-4727-8042-5911bf001652-cluster-tls-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:54.743793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:54.743775 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a5ecd6-cc23-4727-8042-5911bf001652-metrics-client-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:36:55.092267 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092223 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" exitCode=0 Jun 03 19:36:55.092267 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092263 2573 generic.go:356] "Generic (PLEG): container finished" podID="55a5ecd6-cc23-4727-8042-5911bf001652" containerID="410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" exitCode=0 Jun 03 19:36:55.092444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308"} Jun 03 19:36:55.092444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092328 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.092444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968"} Jun 03 19:36:55.092444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55a5ecd6-cc23-4727-8042-5911bf001652","Type":"ContainerDied","Data":"36fa0d8097f8c0ed53097f98e23e339e9e03f4ed6b37a15facb62e100dfa0008"} Jun 03 19:36:55.092570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.092458 2573 scope.go:117] "RemoveContainer" containerID="71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" Jun 03 19:36:55.100803 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.100787 2573 scope.go:117] "RemoveContainer" containerID="9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" Jun 03 19:36:55.107424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.107407 2573 scope.go:117] "RemoveContainer" containerID="434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" Jun 03 19:36:55.114186 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.114157 2573 scope.go:117] "RemoveContainer" containerID="410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" Jun 03 19:36:55.116444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.116422 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:55.120636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.120615 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:55.121173 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.121153 2573 scope.go:117] "RemoveContainer" containerID="81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" Jun 03 19:36:55.127719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.127702 2573 scope.go:117] "RemoveContainer" containerID="3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" Jun 03 19:36:55.134117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.134099 2573 scope.go:117] "RemoveContainer" containerID="ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863" Jun 03 19:36:55.140613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.140598 2573 scope.go:117] "RemoveContainer" containerID="71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" Jun 03 19:36:55.140854 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.140839 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3\": container with ID starting with 71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3 not found: ID does not exist" containerID="71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" Jun 03 19:36:55.140902 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.140864 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3"} err="failed to get container status \"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3\": rpc error: code = NotFound desc = could not find container \"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3\": container with ID starting with 71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3 not found: ID does not exist" Jun 03 19:36:55.140902 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.140883 2573 scope.go:117] "RemoveContainer" containerID="9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" Jun 03 19:36:55.141089 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.141074 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308\": container with ID starting with 9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308 not found: ID does not exist" containerID="9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" Jun 03 19:36:55.141126 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141092 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308"} err="failed to get container status \"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308\": rpc error: code = NotFound desc = could not find container \"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308\": container with ID starting with 9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308 not found: ID does not exist" Jun 03 19:36:55.141126 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141104 2573 scope.go:117] "RemoveContainer" containerID="434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" Jun 03 19:36:55.141367 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.141347 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117\": container with ID starting with 434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117 not found: ID does not exist" containerID="434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" Jun 03 19:36:55.141413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141380 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117"} err="failed to get container status \"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117\": rpc error: code = NotFound desc = could not find container \"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117\": container with ID starting with 434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117 not found: ID does not exist" Jun 03 19:36:55.141413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141395 2573 scope.go:117] "RemoveContainer" containerID="410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" Jun 03 19:36:55.141598 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.141584 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968\": container with ID starting with 410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968 not found: ID does not exist" containerID="410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" Jun 03 19:36:55.141633 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141601 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968"} err="failed to get container status \"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968\": rpc error: code = NotFound desc = could not find container \"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968\": container with ID starting with 410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968 not found: ID does not exist" Jun 03 19:36:55.141633 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141612 2573 scope.go:117] "RemoveContainer" containerID="81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" Jun 03 19:36:55.141820 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.141804 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579\": container with ID starting with 81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579 not found: ID does not exist" containerID="81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" Jun 03 19:36:55.141865 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141823 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579"} err="failed to get container status \"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579\": rpc error: code = NotFound desc = could not find container \"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579\": container with ID starting with 81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579 not found: ID does not exist" Jun 03 19:36:55.141865 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.141835 2573 scope.go:117] "RemoveContainer" containerID="3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" Jun 03 19:36:55.142027 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.142013 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6\": container with ID starting with 3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6 not found: ID does not exist" containerID="3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" Jun 03 19:36:55.142070 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142030 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6"} err="failed to get container status \"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6\": rpc error: code = NotFound desc = could not find container \"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6\": container with ID starting with 3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6 not found: ID does not exist" Jun 03 19:36:55.142070 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142042 2573 scope.go:117] "RemoveContainer" containerID="ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863" Jun 03 19:36:55.142312 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:36:55.142297 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863\": container with ID starting with ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863 not found: ID does not exist" containerID="ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863" Jun 03 19:36:55.142362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142314 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863"} err="failed to get container status \"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863\": rpc error: code = NotFound desc = could not find container \"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863\": container with ID starting with ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863 not found: ID does not exist" Jun 03 19:36:55.142362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142334 2573 scope.go:117] "RemoveContainer" containerID="71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3" Jun 03 19:36:55.142572 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142544 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3"} err="failed to get container status \"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3\": rpc error: code = NotFound desc = could not find container \"71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3\": container with ID starting with 71d67ca060a5e101a9ec1a04d0a6b1c2f16d001e40b546f29e4b9aba73f396d3 not found: ID does not exist" Jun 03 19:36:55.142620 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142574 2573 scope.go:117] "RemoveContainer" containerID="9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308" Jun 03 19:36:55.142789 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142772 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308"} err="failed to get container status \"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308\": rpc error: code = NotFound desc = could not find container \"9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308\": container with ID starting with 9d2d9abd56a8c9487a79e45cd737b47545405f54e2b4884e912e9e60d3d69308 not found: ID does not exist" Jun 03 19:36:55.142789 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142789 2573 scope.go:117] "RemoveContainer" containerID="434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117" Jun 03 19:36:55.143010 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.142990 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117"} err="failed to get container status \"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117\": rpc error: code = NotFound desc = could not find container \"434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117\": container with ID starting with 434c676f72378b45ce8a1575602f491325d4a2828145cde2d71c18b3c22b5117 not found: ID does not exist" Jun 03 19:36:55.143050 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143011 2573 scope.go:117] "RemoveContainer" containerID="410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968" Jun 03 19:36:55.143209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143193 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968"} err="failed to get container status \"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968\": rpc error: code = NotFound desc = could not find container \"410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968\": container with ID starting with 410aac1ac0678e4482bc94747927b7f13694389d42acf15b5c66e80c7bfc3968 not found: ID does not exist" Jun 03 19:36:55.143347 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143209 2573 scope.go:117] "RemoveContainer" containerID="81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579" Jun 03 19:36:55.143457 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143441 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579"} err="failed to get container status \"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579\": rpc error: code = NotFound desc = could not find container \"81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579\": container with ID starting with 81beefd94b405a899db2ea77f627b9231d5f23cfade2fc0f673dfd04c6a19579 not found: ID does not exist" Jun 03 19:36:55.143494 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143458 2573 scope.go:117] "RemoveContainer" containerID="3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6" Jun 03 19:36:55.143685 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143648 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6"} err="failed to get container status \"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6\": rpc error: code = NotFound desc = could not find container \"3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6\": container with ID starting with 3b5d97ea9e396f471dcc37274450c95552183467d0eadabe87a55fdc0520c8f6 not found: ID does not exist" Jun 03 19:36:55.143820 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.143798 2573 scope.go:117] "RemoveContainer" containerID="ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863" Jun 03 19:36:55.144218 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.144191 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863"} err="failed to get container status \"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863\": rpc error: code = NotFound desc = could not find container \"ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863\": container with ID starting with ae46af7a0242e3476ef8eab0b3a5199d97acbaf39c6bdac0dd7c87edd3efa863 not found: ID does not exist" Jun 03 19:36:55.145309 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145292 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:55.145557 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145546 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f11e84-8839-45b7-b853-b29372f171d3" containerName="console" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145558 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f11e84-8839-45b7-b853-b29372f171d3" containerName="console" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145566 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="config-reloader" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145573 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="config-reloader" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145581 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145586 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="prom-label-proxy" Jun 03 19:36:55.145599 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145600 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="prom-label-proxy" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145607 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-metric" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145612 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-metric" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145620 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="init-config-reloader" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145625 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="init-config-reloader" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145631 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc56020-e277-4c85-82cf-3bc755120522" containerName="console" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145637 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc56020-e277-4c85-82cf-3bc755120522" containerName="console" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145642 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerName="registry" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145648 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerName="registry" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145654 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-web" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145659 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-web" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145668 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="alertmanager" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145673 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="alertmanager" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145723 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe624a77-1259-4b39-946e-a63ab20ecc84" containerName="registry" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145731 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-metric" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145737 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="config-reloader" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145743 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy-web" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145750 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="prom-label-proxy" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145755 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc56020-e277-4c85-82cf-3bc755120522" containerName="console" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145761 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="alertmanager" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145767 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f11e84-8839-45b7-b853-b29372f171d3" containerName="console" Jun 03 19:36:55.145821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.145773 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" containerName="kube-rbac-proxy" Jun 03 19:36:55.150478 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.150464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.152997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.152976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 19:36:55.153090 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.152976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 19:36:55.153090 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153023 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 19:36:55.153090 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153059 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 19:36:55.153462 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153429 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 19:36:55.153551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153465 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7hf5\"" Jun 03 19:36:55.153551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153443 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 19:36:55.153551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153501 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 19:36:55.153551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.153507 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 19:36:55.158392 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.158374 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 19:36:55.162709 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.162687 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:55.247006 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.246982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w978\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-kube-api-access-8w978\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-config-out\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-web-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247271 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.247379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.247313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348414 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348354 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-config-out\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348414 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-web-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.348563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.348985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.349015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.349048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349334 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.349092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w978\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-kube-api-access-8w978\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349334 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.349118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.349441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.349415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.351284 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.351258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d3e49a9-211d-427d-9e90-e2b07350709f-config-out\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.351426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.351407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.351646 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.351625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352180 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.351878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352180 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.351913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352180 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.352060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3e49a9-211d-427d-9e90-e2b07350709f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352180 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.352141 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-web-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352376 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.352195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.352550 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.352530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.353529 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.353509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e49a9-211d-427d-9e90-e2b07350709f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.359507 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.359490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w978\" (UniqueName: \"kubernetes.io/projected/6d3e49a9-211d-427d-9e90-e2b07350709f-kube-api-access-8w978\") pod \"alertmanager-main-0\" (UID: \"6d3e49a9-211d-427d-9e90-e2b07350709f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.460749 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.460715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 19:36:55.597683 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.595888 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 19:36:55.600835 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:36:55.600800 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3e49a9_211d_427d_9e90_e2b07350709f.slice/crio-f2c04a701f76b2aff450418dc92cbdf9752118985f954cdbace4baf4f63f41bf WatchSource:0}: Error finding container f2c04a701f76b2aff450418dc92cbdf9752118985f954cdbace4baf4f63f41bf: Status 404 returned error can't find the container with id f2c04a701f76b2aff450418dc92cbdf9752118985f954cdbace4baf4f63f41bf Jun 03 19:36:55.801150 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:55.801109 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a5ecd6-cc23-4727-8042-5911bf001652" path="/var/lib/kubelet/pods/55a5ecd6-cc23-4727-8042-5911bf001652/volumes" Jun 03 19:36:56.097873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:56.097841 2573 generic.go:356] "Generic (PLEG): container finished" podID="6d3e49a9-211d-427d-9e90-e2b07350709f" containerID="3996ea0584d4e7b37da15b53e3a50d445e674b7bc70ee980e9bb85b323e5232a" exitCode=0 Jun 03 19:36:56.098025 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:56.097910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerDied","Data":"3996ea0584d4e7b37da15b53e3a50d445e674b7bc70ee980e9bb85b323e5232a"} Jun 03 19:36:56.098025 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:56.097980 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"f2c04a701f76b2aff450418dc92cbdf9752118985f954cdbace4baf4f63f41bf"} Jun 03 19:36:57.105725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"29e0e9d30507d35482800b941ca9f7bdbefef2add46d4d5f7737d1d6502e9f42"} Jun 03 19:36:57.106137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105757 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"ace2fa46879bd14197eea9b4c27f77c111a1b3a7e4307ac379a3e39d474e3302"} Jun 03 19:36:57.106137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105790 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"2126362e9caa865d359bf653519617704442394eacc49fa4da62c436199424ff"} Jun 03 19:36:57.106137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"28e12e078c1f4393a5bed218f5d3d8e2b35c44e3520d540e08e54823f6da5934"} Jun 03 19:36:57.106137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"fefd90b3dafc8215464b8493be07171d9f372e5f4e57c56bd55838c3cc018ec0"} Jun 03 19:36:57.106137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.105862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d3e49a9-211d-427d-9e90-e2b07350709f","Type":"ContainerStarted","Data":"187b401580ef14677c1be6189882518a1396fdddecbc4d3daf5549f8eeb8a030"} Jun 03 19:36:57.131299 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.131226 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.115720581 podStartE2EDuration="2.131208094s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.487513ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:57.129228221 +0000 UTC m=+381.825083941" watchObservedRunningTime="2026-06-03 19:36:57.131208094 +0000 UTC m=+381.827063815" Jun 03 19:36:57.305346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.305317 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7468bc9964-xjb4q"] Jun 03 19:36:57.308896 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.308879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.311291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311261 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 19:36:57.311420 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311372 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 19:36:57.311489 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311457 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 19:36:57.311719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311694 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 19:36:57.311857 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kfwmf\"" Jun 03 19:36:57.311857 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.311802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 19:36:57.316179 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.316053 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 19:36:57.321705 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.321679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7468bc9964-xjb4q"] Jun 03 19:36:57.365990 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.365929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-serving-certs-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.365990 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.365965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.365998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.366026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-metrics-client-ca\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.366085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sp4l\" (UniqueName: \"kubernetes.io/projected/35cbb23e-aa3f-47e5-a747-00c2c39c905e-kube-api-access-5sp4l\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.366147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.366194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.366375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.366218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-federate-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467275 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-metrics-client-ca\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sp4l\" (UniqueName: \"kubernetes.io/projected/35cbb23e-aa3f-47e5-a747-00c2c39c905e-kube-api-access-5sp4l\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-federate-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.467636 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.467457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-serving-certs-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.468117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.468085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-metrics-client-ca\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.468253 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.468155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-serving-certs-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.468253 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.468176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.469899 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.469878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.470065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.470045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-telemeter-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.470345 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.470328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-secret-telemeter-client\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.470416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.470399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cbb23e-aa3f-47e5-a747-00c2c39c905e-federate-client-tls\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.475055 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.475035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sp4l\" (UniqueName: \"kubernetes.io/projected/35cbb23e-aa3f-47e5-a747-00c2c39c905e-kube-api-access-5sp4l\") pod \"telemeter-client-7468bc9964-xjb4q\" (UID: \"35cbb23e-aa3f-47e5-a747-00c2c39c905e\") " pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.619286 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.619204 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" Jun 03 19:36:57.754056 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:57.754035 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7468bc9964-xjb4q"] Jun 03 19:36:57.755972 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:36:57.755944 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cbb23e_aa3f_47e5_a747_00c2c39c905e.slice/crio-9f5d361ba295cd5e062fd37d055525f43f1477e18e2ffd282ecf69619fe67fc7 WatchSource:0}: Error finding container 9f5d361ba295cd5e062fd37d055525f43f1477e18e2ffd282ecf69619fe67fc7: Status 404 returned error can't find the container with id 9f5d361ba295cd5e062fd37d055525f43f1477e18e2ffd282ecf69619fe67fc7 Jun 03 19:36:58.110327 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:36:58.110300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" event={"ID":"35cbb23e-aa3f-47e5-a747-00c2c39c905e","Type":"ContainerStarted","Data":"9f5d361ba295cd5e062fd37d055525f43f1477e18e2ffd282ecf69619fe67fc7"} Jun 03 19:37:00.122213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.122177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" event={"ID":"35cbb23e-aa3f-47e5-a747-00c2c39c905e","Type":"ContainerStarted","Data":"6cdc8f710977e7be3803a25b007e0dbf13dd263e58413ceba902a03afefb69f0"} Jun 03 19:37:00.122586 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.122269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" event={"ID":"35cbb23e-aa3f-47e5-a747-00c2c39c905e","Type":"ContainerStarted","Data":"e8c548fe49f31faf7e56b4fd4918627270287dcf5aa959f1a345caded99ac9ad"} Jun 03 19:37:00.122586 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.122299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" event={"ID":"35cbb23e-aa3f-47e5-a747-00c2c39c905e","Type":"ContainerStarted","Data":"c545f362a309d689cb0c8baff124189564d42da74cf43cd02673ec98b9da5d19"} Jun 03 19:37:00.143954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.143831 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7468bc9964-xjb4q" podStartSLOduration=1.016429607 podStartE2EDuration="3.143811387s" totalImagesPullingTime="2.12738178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:00.143121785 +0000 UTC m=+384.838977504" watchObservedRunningTime="2026-06-03 19:37:00.143811387 +0000 UTC m=+384.839667110" Jun 03 19:37:00.943341 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.943314 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:37:00.946531 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.946508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.955809 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.955783 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:37:00.996039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5sn\" (UniqueName: \"kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:00.996388 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:00.996263 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.012932 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.012911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.097131 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097131 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5sn\" (UniqueName: \"kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097305 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097283 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097902 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.097993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.097956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.098145 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.098127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.099641 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.099621 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.099743 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.099722 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.107375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.107354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5sn\" (UniqueName: \"kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn\") pod \"console-6648568876-lnptl\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.139956 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.139929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.188224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.188195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.256571 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.256512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:01.334496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.334468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.388613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.388587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:37:01.390696 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.390669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.391000 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:37:01.390977 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8ffba6_e533_44ee_aa92_7318f5bd02f5.slice/crio-1a5dfe227d0ce4e4845373f93839e03e1ddc5069d1f23e7a4bf69813abe6499c WatchSource:0}: Error finding container 1a5dfe227d0ce4e4845373f93839e03e1ddc5069d1f23e7a4bf69813abe6499c: Status 404 returned error can't find the container with id 1a5dfe227d0ce4e4845373f93839e03e1ddc5069d1f23e7a4bf69813abe6499c Jun 03 19:37:01.741502 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.741473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:01.842754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:01.842723 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:02.132278 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:02.132233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:02.134320 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:02.134295 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6648568876-lnptl" event={"ID":"0c8ffba6-e533-44ee-aa92-7318f5bd02f5","Type":"ContainerStarted","Data":"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e"} Jun 03 19:37:02.134444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:02.134343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6648568876-lnptl" event={"ID":"0c8ffba6-e533-44ee-aa92-7318f5bd02f5","Type":"ContainerStarted","Data":"1a5dfe227d0ce4e4845373f93839e03e1ddc5069d1f23e7a4bf69813abe6499c"} Jun 03 19:37:02.155791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:02.155631 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6648568876-lnptl" podStartSLOduration=2.155616436 podStartE2EDuration="2.155616436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:02.15443087 +0000 UTC m=+386.850286589" watchObservedRunningTime="2026-06-03 19:37:02.155616436 +0000 UTC m=+386.851472152" Jun 03 19:37:02.233131 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:02.233100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:11.256925 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:11.256898 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:11.257317 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:11.256949 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:11.261413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:11.261392 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:12.177886 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:12.177859 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:37:12.224776 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:12.224747 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:37:12.309049 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:12.309014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:12.361596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:12.361571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:12.408954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:12.408932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:32.901579 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:32.901548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:36.035752 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:36.035669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:36.084839 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:36.084813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:37:37.250536 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.250475 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b78545c67-jr9mr" podUID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" containerName="console" containerID="cri-o://1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b" gracePeriod=15 Jun 03 19:37:37.494622 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.494600 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:37:37.595544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595520 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595555 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595584 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sq5v\" (UniqueName: \"kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595607 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595642 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595664 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.595703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.595690 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert\") pod \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\" (UID: \"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778\") " Jun 03 19:37:37.596033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.596003 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config" (OuterVolumeSpecName: "console-config") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:37.596200 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.596171 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:37.596309 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.596284 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:37.596383 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.596361 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:37.597717 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.597686 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:37:37.597826 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.597723 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:37:37.597826 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.597786 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v" (OuterVolumeSpecName: "kube-api-access-2sq5v") pod "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" (UID: "e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778"). InnerVolumeSpecName "kube-api-access-2sq5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:37:37.696224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696196 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-trusted-ca-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696218 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-oauth-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696227 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696246 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-oauth-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696256 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-console-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696264 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-service-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:37.696465 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:37.696272 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sq5v\" (UniqueName: \"kubernetes.io/projected/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778-kube-api-access-2sq5v\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:37:38.276251 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.276214 2573 generic.go:356] "Generic (PLEG): container finished" podID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" containerID="1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b" exitCode=0 Jun 03 19:37:38.276651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.276276 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b78545c67-jr9mr" Jun 03 19:37:38.276651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.276290 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b78545c67-jr9mr" event={"ID":"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778","Type":"ContainerDied","Data":"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b"} Jun 03 19:37:38.276651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.276328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b78545c67-jr9mr" event={"ID":"e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778","Type":"ContainerDied","Data":"99d04e6e27ae269169e049ae35bcef5836506de044c468e24df39e542881aa79"} Jun 03 19:37:38.276651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.276347 2573 scope.go:117] "RemoveContainer" containerID="1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b" Jun 03 19:37:38.284596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.284581 2573 scope.go:117] "RemoveContainer" containerID="1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b" Jun 03 19:37:38.284843 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:37:38.284820 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b\": container with ID starting with 1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b not found: ID does not exist" containerID="1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b" Jun 03 19:37:38.284936 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.284848 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b"} err="failed to get container status \"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b\": rpc error: code = NotFound desc = could not find container \"1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b\": container with ID starting with 1ad19a760a0405897a773708c8e9077526b64ee81c43f8790ce6ddf33275fd9b not found: ID does not exist" Jun 03 19:37:38.293209 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.293189 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:37:38.296889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:38.296870 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b78545c67-jr9mr"] Jun 03 19:37:39.801093 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:39.801058 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" path="/var/lib/kubelet/pods/e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778/volumes" Jun 03 19:37:53.031890 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:37:53.031805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:07.451166 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:07.451130 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:07.498699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:07.498670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:10.048639 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.048607 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:38:10.049008 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.048920 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" containerName="console" Jun 03 19:38:10.049008 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.048930 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" containerName="console" Jun 03 19:38:10.049008 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.048987 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9899ca7-cc49-40e1-b0c1-9ac0b9b5a778" containerName="console" Jun 03 19:38:10.053068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.053049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.063771 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.063749 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:38:10.099646 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.099620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:10.144792 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144911 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144911 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2z5\" (UniqueName: \"kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.144997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.144992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.158323 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.158301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:10.246260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246260 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.246482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.246368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2z5\" (UniqueName: \"kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.247161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.247140 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.247161 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.247148 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.247349 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.247171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.247349 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.247225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.248824 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.248797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.248916 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.248894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.254293 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.254268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2z5\" (UniqueName: \"kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5\") pod \"console-66548b758-jwmzr\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.365289 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.365269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:10.514775 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:10.514752 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:38:10.517431 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:38:10.517405 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636df8d1_a501_4485_8092_df1db873243f.slice/crio-e71ea92f2d68c3a6d9c45ed263c68707f32aab40e98b986daf4658805d869f26 WatchSource:0}: Error finding container e71ea92f2d68c3a6d9c45ed263c68707f32aab40e98b986daf4658805d869f26: Status 404 returned error can't find the container with id e71ea92f2d68c3a6d9c45ed263c68707f32aab40e98b986daf4658805d869f26 Jun 03 19:38:11.406444 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:11.406411 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66548b758-jwmzr" event={"ID":"636df8d1-a501-4485-8092-df1db873243f","Type":"ContainerStarted","Data":"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac"} Jun 03 19:38:11.406815 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:11.406461 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66548b758-jwmzr" event={"ID":"636df8d1-a501-4485-8092-df1db873243f","Type":"ContainerStarted","Data":"e71ea92f2d68c3a6d9c45ed263c68707f32aab40e98b986daf4658805d869f26"} Jun 03 19:38:11.423787 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:11.423747 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66548b758-jwmzr" podStartSLOduration=1.423732972 podStartE2EDuration="1.423732972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:38:11.422313019 +0000 UTC m=+456.118168738" watchObservedRunningTime="2026-06-03 19:38:11.423732972 +0000 UTC m=+456.119588692" Jun 03 19:38:19.351572 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:19.351536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:19.401290 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:19.401264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:20.366203 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.366168 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:20.366581 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.366270 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:20.371424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.371395 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:20.445779 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.445755 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:38:20.490361 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.490335 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:38:20.585922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.585884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:20.634623 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.634556 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:20.686997 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.686975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:20.738493 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:20.738464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:27.983089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:27.983056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:28.081845 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:28.081815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:40.336166 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:40.336125 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:45.516921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.516858 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6648568876-lnptl" podUID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" containerName="console" containerID="cri-o://1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e" gracePeriod=15 Jun 03 19:38:45.755916 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.755887 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:38:45.820748 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820692 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820748 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820733 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820754 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820769 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820815 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820835 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.820947 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.820874 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td5sn\" (UniqueName: \"kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn\") pod \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\" (UID: \"0c8ffba6-e533-44ee-aa92-7318f5bd02f5\") " Jun 03 19:38:45.821232 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.821109 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:38:45.821362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.821335 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:38:45.821427 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.821331 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:38:45.821482 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.821430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config" (OuterVolumeSpecName: "console-config") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:38:45.822892 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.822866 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:38:45.822980 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.822888 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:38:45.823093 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.823068 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn" (OuterVolumeSpecName: "kube-api-access-td5sn") pod "0c8ffba6-e533-44ee-aa92-7318f5bd02f5" (UID: "0c8ffba6-e533-44ee-aa92-7318f5bd02f5"). InnerVolumeSpecName "kube-api-access-td5sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:38:45.922013 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.921987 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-service-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922013 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922008 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922018 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td5sn\" (UniqueName: \"kubernetes.io/projected/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-kube-api-access-td5sn\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922028 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-trusted-ca-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922036 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-oauth-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922044 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-oauth-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:45.922165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:45.922052 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8ffba6-e533-44ee-aa92-7318f5bd02f5-console-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:38:46.546082 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.546048 2573 generic.go:356] "Generic (PLEG): container finished" podID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" containerID="1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e" exitCode=0 Jun 03 19:38:46.546501 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.546091 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6648568876-lnptl" Jun 03 19:38:46.546501 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.546130 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6648568876-lnptl" event={"ID":"0c8ffba6-e533-44ee-aa92-7318f5bd02f5","Type":"ContainerDied","Data":"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e"} Jun 03 19:38:46.546501 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.546174 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6648568876-lnptl" event={"ID":"0c8ffba6-e533-44ee-aa92-7318f5bd02f5","Type":"ContainerDied","Data":"1a5dfe227d0ce4e4845373f93839e03e1ddc5069d1f23e7a4bf69813abe6499c"} Jun 03 19:38:46.546501 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.546194 2573 scope.go:117] "RemoveContainer" containerID="1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e" Jun 03 19:38:46.554469 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.554455 2573 scope.go:117] "RemoveContainer" containerID="1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e" Jun 03 19:38:46.554712 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:38:46.554696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e\": container with ID starting with 1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e not found: ID does not exist" containerID="1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e" Jun 03 19:38:46.554761 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.554719 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e"} err="failed to get container status \"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e\": rpc error: code = NotFound desc = could not find container \"1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e\": container with ID starting with 1900533d60e63b52e6f23c1ac662ecc2abc806c935ddd05af4b529a054fa736e not found: ID does not exist" Jun 03 19:38:46.566233 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.566213 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:38:46.569252 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:46.569217 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6648568876-lnptl"] Jun 03 19:38:47.800424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:47.800392 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" path="/var/lib/kubelet/pods/0c8ffba6-e533-44ee-aa92-7318f5bd02f5/volumes" Jun 03 19:38:59.795885 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:59.795852 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:38:59.893932 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:38:59.893902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:00.342343 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.342308 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8"] Jun 03 19:39:00.342631 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.342619 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" containerName="console" Jun 03 19:39:00.342631 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.342631 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" containerName="console" Jun 03 19:39:00.342712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.342692 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c8ffba6-e533-44ee-aa92-7318f5bd02f5" containerName="console" Jun 03 19:39:00.345656 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.345641 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.348092 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.348062 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:39:00.348207 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.348094 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:39:00.349013 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.348999 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:39:00.353595 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.353575 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8"] Jun 03 19:39:00.437952 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.437924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh9th\" (UniqueName: \"kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.438115 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.437989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.438115 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.438071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.538584 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.538557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.538755 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.538590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh9th\" (UniqueName: \"kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.538755 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.538643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.538957 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.538936 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.539012 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.538945 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.546291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.546266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh9th\" (UniqueName: \"kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.655780 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.655710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:00.783096 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:00.783068 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8"] Jun 03 19:39:00.786890 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:00.786861 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f09b6e_1073_44d1_b6e6_229acd83bd1d.slice/crio-5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c WatchSource:0}: Error finding container 5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c: Status 404 returned error can't find the container with id 5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c Jun 03 19:39:01.614712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:01.614642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerStarted","Data":"5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c"} Jun 03 19:39:09.649001 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:09.648965 2573 generic.go:356] "Generic (PLEG): container finished" podID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerID="31bef4ad5fa39a70e0b287bf9b14f57125e9bf5a34d49a292cac4c50268709e4" exitCode=0 Jun 03 19:39:09.649388 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:09.649049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerDied","Data":"31bef4ad5fa39a70e0b287bf9b14f57125e9bf5a34d49a292cac4c50268709e4"} Jun 03 19:39:11.659624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:11.659584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerStarted","Data":"df4b359b70c4bce07b062c164cc0b7c8d205c2d42c8f32fb1159de7274dde841"} Jun 03 19:39:12.665308 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:12.665278 2573 generic.go:356] "Generic (PLEG): container finished" podID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerID="df4b359b70c4bce07b062c164cc0b7c8d205c2d42c8f32fb1159de7274dde841" exitCode=0 Jun 03 19:39:12.665681 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:12.665341 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerDied","Data":"df4b359b70c4bce07b062c164cc0b7c8d205c2d42c8f32fb1159de7274dde841"} Jun 03 19:39:20.702462 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:20.702427 2573 generic.go:356] "Generic (PLEG): container finished" podID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerID="f52d9fe17c3c662c826bc2271c0e809bfeda5b1341ff343330b5ed144d1b4013" exitCode=0 Jun 03 19:39:20.702804 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:20.702518 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerDied","Data":"f52d9fe17c3c662c826bc2271c0e809bfeda5b1341ff343330b5ed144d1b4013"} Jun 03 19:39:21.831351 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.831328 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:21.927625 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.927598 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle\") pod \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " Jun 03 19:39:21.927747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.927655 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh9th\" (UniqueName: \"kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th\") pod \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " Jun 03 19:39:21.927747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.927699 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util\") pod \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\" (UID: \"b9f09b6e-1073-44d1-b6e6-229acd83bd1d\") " Jun 03 19:39:21.928529 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.928503 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle" (OuterVolumeSpecName: "bundle") pod "b9f09b6e-1073-44d1-b6e6-229acd83bd1d" (UID: "b9f09b6e-1073-44d1-b6e6-229acd83bd1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:21.929862 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.929832 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th" (OuterVolumeSpecName: "kube-api-access-hh9th") pod "b9f09b6e-1073-44d1-b6e6-229acd83bd1d" (UID: "b9f09b6e-1073-44d1-b6e6-229acd83bd1d"). InnerVolumeSpecName "kube-api-access-hh9th". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:39:21.933805 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:21.933781 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util" (OuterVolumeSpecName: "util") pod "b9f09b6e-1073-44d1-b6e6-229acd83bd1d" (UID: "b9f09b6e-1073-44d1-b6e6-229acd83bd1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:22.029027 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.028955 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:22.029027 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.028980 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh9th\" (UniqueName: \"kubernetes.io/projected/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-kube-api-access-hh9th\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:22.029027 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.028989 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9f09b6e-1073-44d1-b6e6-229acd83bd1d-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:22.712067 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.712029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" event={"ID":"b9f09b6e-1073-44d1-b6e6-229acd83bd1d","Type":"ContainerDied","Data":"5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c"} Jun 03 19:39:22.712067 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.712062 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx47h8" Jun 03 19:39:22.712360 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:22.712077 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bd98d81179dc14059b306c6216ee167c1cdbaf5be4a5fff6eccd743f641c91c" Jun 03 19:39:26.308796 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:26.308763 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:27.067204 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:27.067138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:28.313545 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.313506 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg"] Jun 03 19:39:28.314003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.313972 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="util" Jun 03 19:39:28.314003 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.313990 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="util" Jun 03 19:39:28.314120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.314010 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="pull" Jun 03 19:39:28.314120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.314018 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="pull" Jun 03 19:39:28.314120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.314030 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="extract" Jun 03 19:39:28.314120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.314039 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="extract" Jun 03 19:39:28.314349 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.314122 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f09b6e-1073-44d1-b6e6-229acd83bd1d" containerName="extract" Jun 03 19:39:28.319794 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.319773 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.323495 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.323476 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2kr8d\"" Jun 03 19:39:28.323614 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.323572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:39:28.323787 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.323771 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 19:39:28.340198 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.340164 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg"] Jun 03 19:39:28.481822 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.481779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.481953 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.481871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fxfv\" (UniqueName: \"kubernetes.io/projected/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-kube-api-access-2fxfv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.582737 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.582712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.582862 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.582761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fxfv\" (UniqueName: \"kubernetes.io/projected/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-kube-api-access-2fxfv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.583092 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.583072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.590369 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.590340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fxfv\" (UniqueName: \"kubernetes.io/projected/de7ca734-721b-412b-b8c8-e7ef6c0da6a6-kube-api-access-2fxfv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9b2cg\" (UID: \"de7ca734-721b-412b-b8c8-e7ef6c0da6a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.631208 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.631186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" Jun 03 19:39:28.760783 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:28.760750 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg"] Jun 03 19:39:28.765179 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:28.765148 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7ca734_721b_412b_b8c8_e7ef6c0da6a6.slice/crio-7ed2fff90e4ea0beea3c2a0fce1fb216b4913bc320e2f7a091a28d7fbcc3e20c WatchSource:0}: Error finding container 7ed2fff90e4ea0beea3c2a0fce1fb216b4913bc320e2f7a091a28d7fbcc3e20c: Status 404 returned error can't find the container with id 7ed2fff90e4ea0beea3c2a0fce1fb216b4913bc320e2f7a091a28d7fbcc3e20c Jun 03 19:39:29.743852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:29.743816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" event={"ID":"de7ca734-721b-412b-b8c8-e7ef6c0da6a6","Type":"ContainerStarted","Data":"7ed2fff90e4ea0beea3c2a0fce1fb216b4913bc320e2f7a091a28d7fbcc3e20c"} Jun 03 19:39:29.916512 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:29.916483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:29.968181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:29.968148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:31.756560 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:31.756467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" event={"ID":"de7ca734-721b-412b-b8c8-e7ef6c0da6a6","Type":"ContainerStarted","Data":"4a1cc84a8d752ec5c60311d3ee2c261f2cf786068432971eae0af9f48b9e16b1"} Jun 03 19:39:31.777089 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:31.777049 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9b2cg" podStartSLOduration=1.171237935 podStartE2EDuration="3.777035365s" totalImagesPullingTime="2.60579743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:31.775478088 +0000 UTC m=+536.471333808" watchObservedRunningTime="2026-06-03 19:39:31.777035365 +0000 UTC m=+536.472891083" Jun 03 19:39:32.002838 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.002803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:32.116626 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.116588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:32.255186 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.255154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:32.573717 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.573645 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc"] Jun 03 19:39:32.577288 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.577273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.579706 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.579687 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:39:32.580712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.580693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:39:32.580793 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.580739 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:39:32.586398 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.586376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc"] Jun 03 19:39:32.720027 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.719999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.720177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.720034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnnp\" (UniqueName: \"kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.720177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.720059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.821248 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.821216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.821604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.821269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnnp\" (UniqueName: \"kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.821604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.821295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.821684 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.821661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.821720 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.821672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.836872 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.836849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnnp\" (UniqueName: \"kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:32.888635 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:32.888596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:33.017344 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:33.017216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc"] Jun 03 19:39:33.019984 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:33.019955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda60c177_aafa_400e_98dc_e678bd869544.slice/crio-569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4 WatchSource:0}: Error finding container 569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4: Status 404 returned error can't find the container with id 569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4 Jun 03 19:39:33.767850 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:33.767820 2573 generic.go:356] "Generic (PLEG): container finished" podID="da60c177-aafa-400e-98dc-e678bd869544" containerID="dbb2031d2bd711d7c0ce5f21e6c019ff8bef06779418e8fc4dddb4d35fe25aad" exitCode=0 Jun 03 19:39:33.768034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:33.767911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" event={"ID":"da60c177-aafa-400e-98dc-e678bd869544","Type":"ContainerDied","Data":"dbb2031d2bd711d7c0ce5f21e6c019ff8bef06779418e8fc4dddb4d35fe25aad"} Jun 03 19:39:33.768034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:33.767970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" event={"ID":"da60c177-aafa-400e-98dc-e678bd869544","Type":"ContainerStarted","Data":"569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4"} Jun 03 19:39:34.647629 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.647596 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq"] Jun 03 19:39:34.650854 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.650838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.653102 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.653083 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 19:39:34.653102 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.653091 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xcn42\"" Jun 03 19:39:34.653977 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.653964 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 19:39:34.658132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.658113 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq"] Jun 03 19:39:34.737591 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.737559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzgdp\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-kube-api-access-wzgdp\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.737735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.737596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.838940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.838907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzgdp\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-kube-api-access-wzgdp\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.838940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.838945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.851906 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.851881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.852108 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.852087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzgdp\" (UniqueName: \"kubernetes.io/projected/0a9ddca5-1400-4796-ab11-e692e9023114-kube-api-access-wzgdp\") pod \"cert-manager-webhook-7dc76cbb94-wg7wq\" (UID: \"0a9ddca5-1400-4796-ab11-e692e9023114\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:34.968675 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:34.968597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:35.116955 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:35.116892 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq"] Jun 03 19:39:35.119566 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:35.119532 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a9ddca5_1400_4796_ab11_e692e9023114.slice/crio-ef1c674b07a2d492b0cf45f8f48c29c66d6293596f7ae81557fa6404b276ad23 WatchSource:0}: Error finding container ef1c674b07a2d492b0cf45f8f48c29c66d6293596f7ae81557fa6404b276ad23: Status 404 returned error can't find the container with id ef1c674b07a2d492b0cf45f8f48c29c66d6293596f7ae81557fa6404b276ad23 Jun 03 19:39:35.299095 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:35.298993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:35.778803 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:35.778777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" event={"ID":"0a9ddca5-1400-4796-ab11-e692e9023114","Type":"ContainerStarted","Data":"ef1c674b07a2d492b0cf45f8f48c29c66d6293596f7ae81557fa6404b276ad23"} Jun 03 19:39:35.888531 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:35.888496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:36.712458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:36.712423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:36.764297 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:36.764260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:36.785083 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:36.785057 2573 generic.go:356] "Generic (PLEG): container finished" podID="da60c177-aafa-400e-98dc-e678bd869544" containerID="d7c7a8ce109694ba1d5bcb348e919baeae9d6017a7990a4fb9f1daa52db7f8b0" exitCode=0 Jun 03 19:39:36.785378 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:36.785121 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" event={"ID":"da60c177-aafa-400e-98dc-e678bd869544","Type":"ContainerDied","Data":"d7c7a8ce109694ba1d5bcb348e919baeae9d6017a7990a4fb9f1daa52db7f8b0"} Jun 03 19:39:37.463748 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.463716 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc"] Jun 03 19:39:37.466986 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.466970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.469987 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.469968 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dpmp2\"" Jun 03 19:39:37.479229 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.479208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc"] Jun 03 19:39:37.562541 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.562509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqq44\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-kube-api-access-pqq44\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.562670 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.562553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.663272 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.663229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqq44\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-kube-api-access-pqq44\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.663403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.663290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.671287 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.671265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.671367 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.671352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqq44\" (UniqueName: \"kubernetes.io/projected/687dcc2a-1633-43a8-99ff-6b1cc2302c2a-kube-api-access-pqq44\") pod \"cert-manager-cainjector-5d99449ffd-8xrcc\" (UID: \"687dcc2a-1633-43a8-99ff-6b1cc2302c2a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.776202 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.776131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" Jun 03 19:39:37.793375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.793342 2573 generic.go:356] "Generic (PLEG): container finished" podID="da60c177-aafa-400e-98dc-e678bd869544" containerID="4fa10345b178f2c63f1f2423b46364a1b759a7a2cbba55a1deca82a2028b684b" exitCode=0 Jun 03 19:39:37.793719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.793427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" event={"ID":"da60c177-aafa-400e-98dc-e678bd869544","Type":"ContainerDied","Data":"4fa10345b178f2c63f1f2423b46364a1b759a7a2cbba55a1deca82a2028b684b"} Jun 03 19:39:37.906897 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:37.906872 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc"] Jun 03 19:39:37.908791 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:37.908762 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687dcc2a_1633_43a8_99ff_6b1cc2302c2a.slice/crio-3aabfb1a1df42a97beca1312507579d98f658a5084aa8a701e590af9d1d26a7b WatchSource:0}: Error finding container 3aabfb1a1df42a97beca1312507579d98f658a5084aa8a701e590af9d1d26a7b: Status 404 returned error can't find the container with id 3aabfb1a1df42a97beca1312507579d98f658a5084aa8a701e590af9d1d26a7b Jun 03 19:39:38.799857 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:38.799816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" event={"ID":"687dcc2a-1633-43a8-99ff-6b1cc2302c2a","Type":"ContainerStarted","Data":"3aabfb1a1df42a97beca1312507579d98f658a5084aa8a701e590af9d1d26a7b"} Jun 03 19:39:39.692431 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.692409 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:39.780990 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.780969 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util\") pod \"da60c177-aafa-400e-98dc-e678bd869544\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " Jun 03 19:39:39.781094 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.781061 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle\") pod \"da60c177-aafa-400e-98dc-e678bd869544\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " Jun 03 19:39:39.781156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.781134 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnnnp\" (UniqueName: \"kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp\") pod \"da60c177-aafa-400e-98dc-e678bd869544\" (UID: \"da60c177-aafa-400e-98dc-e678bd869544\") " Jun 03 19:39:39.781410 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.781386 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle" (OuterVolumeSpecName: "bundle") pod "da60c177-aafa-400e-98dc-e678bd869544" (UID: "da60c177-aafa-400e-98dc-e678bd869544"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:39.783014 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.782993 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp" (OuterVolumeSpecName: "kube-api-access-gnnnp") pod "da60c177-aafa-400e-98dc-e678bd869544" (UID: "da60c177-aafa-400e-98dc-e678bd869544"). InnerVolumeSpecName "kube-api-access-gnnnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:39:39.785487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.785464 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util" (OuterVolumeSpecName: "util") pod "da60c177-aafa-400e-98dc-e678bd869544" (UID: "da60c177-aafa-400e-98dc-e678bd869544"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:39.805967 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.805947 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" Jun 03 19:39:39.806353 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.805983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnx8fc" event={"ID":"da60c177-aafa-400e-98dc-e678bd869544","Type":"ContainerDied","Data":"569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4"} Jun 03 19:39:39.806353 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.806028 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="569fff0a065bb5f517bf81f547a33c3da3a20b9a0e37066eb9d1d14f11f7f2c4" Jun 03 19:39:39.808108 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.808083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" event={"ID":"0a9ddca5-1400-4796-ab11-e692e9023114","Type":"ContainerStarted","Data":"6bce1eb9310a3ffe3ff3ac32ca70c13effc9ecd0af0a010fb63b3e6344aee87c"} Jun 03 19:39:39.808264 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.808213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:39.824756 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.824711 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" podStartSLOduration=1.209550626 podStartE2EDuration="5.824693161s" totalImagesPullingTime="4.615142535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:39.822711939 +0000 UTC m=+544.518567662" watchObservedRunningTime="2026-06-03 19:39:39.824693161 +0000 UTC m=+544.520548881" Jun 03 19:39:39.881922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.881903 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:39.882004 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.881922 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da60c177-aafa-400e-98dc-e678bd869544-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:39.882004 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:39.881946 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnnnp\" (UniqueName: \"kubernetes.io/projected/da60c177-aafa-400e-98dc-e678bd869544-kube-api-access-gnnnp\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:39:41.819120 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:41.819080 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" event={"ID":"687dcc2a-1633-43a8-99ff-6b1cc2302c2a","Type":"ContainerStarted","Data":"afb58ba9e9b2b293c92af34ae3a7bdc9c7ebd8ebde56967ea33aa8199d3076fb"} Jun 03 19:39:41.835062 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:41.835019 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8xrcc" podStartSLOduration=1.1005244809999999 podStartE2EDuration="4.835006299s" totalImagesPullingTime="3.734481818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:41.832950986 +0000 UTC m=+546.528806687" watchObservedRunningTime="2026-06-03 19:39:41.835006299 +0000 UTC m=+546.530862017" Jun 03 19:39:42.232426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:42.232391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:42.332992 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:42.332951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:43.899718 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:43.899689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:45.815818 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:45.815791 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wg7wq" Jun 03 19:39:48.319400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:48.319368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:48.419510 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:48.419453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:55.256206 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:55.256163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:55.358457 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:55.358427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:57.412647 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.412615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:57.980138 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980102 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl"] Jun 03 19:39:57.980538 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980519 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="util" Jun 03 19:39:57.980628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980539 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="util" Jun 03 19:39:57.980628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980573 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="pull" Jun 03 19:39:57.980628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980582 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="pull" Jun 03 19:39:57.980628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980601 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="extract" Jun 03 19:39:57.980628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980611 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="extract" Jun 03 19:39:57.980884 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.980702 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da60c177-aafa-400e-98dc-e678bd869544" containerName="extract" Jun 03 19:39:57.983490 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.983471 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:57.986131 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.986105 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:39:57.986227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.986188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:39:57.986922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.986907 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:39:57.990574 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:57.990382 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl"] Jun 03 19:39:58.033202 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.033175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.033341 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.033229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6v7t\" (UniqueName: \"kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.033341 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.033278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.133881 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.133846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6v7t\" (UniqueName: \"kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.134077 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.133895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.134077 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.133965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.134384 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.134363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.134452 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.134391 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.143253 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.143222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6v7t\" (UniqueName: \"kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.293427 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.293346 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:39:58.418594 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.418571 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl"] Jun 03 19:39:58.420681 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:39:58.420649 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3963ce48_f6b3_4787_b369_ef697d823f09.slice/crio-fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3 WatchSource:0}: Error finding container fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3: Status 404 returned error can't find the container with id fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3 Jun 03 19:39:58.894596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.894564 2573 generic.go:356] "Generic (PLEG): container finished" podID="3963ce48-f6b3-4787-b369-ef697d823f09" containerID="d1aee56e64422a27be6875c8eda2ff19673178ec7f8a3b53167499e42d0b603b" exitCode=0 Jun 03 19:39:58.894778 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.894652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" event={"ID":"3963ce48-f6b3-4787-b369-ef697d823f09","Type":"ContainerDied","Data":"d1aee56e64422a27be6875c8eda2ff19673178ec7f8a3b53167499e42d0b603b"} Jun 03 19:39:58.894778 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:58.894706 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" event={"ID":"3963ce48-f6b3-4787-b369-ef697d823f09","Type":"ContainerStarted","Data":"fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3"} Jun 03 19:39:59.209561 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:59.209530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:39:59.901278 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:59.901219 2573 generic.go:356] "Generic (PLEG): container finished" podID="3963ce48-f6b3-4787-b369-ef697d823f09" containerID="f3f24667efce895682554ecc299b7f203ff1dbf13a51a2d909649a5e4dbf6ad6" exitCode=0 Jun 03 19:39:59.901278 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:39:59.901289 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" event={"ID":"3963ce48-f6b3-4787-b369-ef697d823f09","Type":"ContainerDied","Data":"f3f24667efce895682554ecc299b7f203ff1dbf13a51a2d909649a5e4dbf6ad6"} Jun 03 19:40:00.419336 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:00.419307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:00.520253 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:00.520215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:00.908603 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:00.908573 2573 generic.go:356] "Generic (PLEG): container finished" podID="3963ce48-f6b3-4787-b369-ef697d823f09" containerID="47764e28ba33215e6732031a77c3a7b5c894d20d0ad30e236f80dfa1d7441704" exitCode=0 Jun 03 19:40:00.908975 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:00.908644 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" event={"ID":"3963ce48-f6b3-4787-b369-ef697d823f09","Type":"ContainerDied","Data":"47764e28ba33215e6732031a77c3a7b5c894d20d0ad30e236f80dfa1d7441704"} Jun 03 19:40:01.654500 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.654466 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:01.703010 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.702980 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc"] Jun 03 19:40:01.706386 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.706367 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.712976 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.712951 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 19:40:01.713544 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.713522 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:40:01.713817 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.713798 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 19:40:01.713939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.713918 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 19:40:01.714004 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.713833 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gjrvf\"" Jun 03 19:40:01.714098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.713780 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:40:01.717142 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.717119 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc"] Jun 03 19:40:01.736918 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.736895 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:01.765565 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.765544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/038f3d95-6a91-4e8f-8768-881536442926-kube-api-access-h8w8x\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.765664 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.765576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.765664 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.765608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/038f3d95-6a91-4e8f-8768-881536442926-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.765754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.765674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.866938 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.866890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.867097 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.867062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/038f3d95-6a91-4e8f-8768-881536442926-kube-api-access-h8w8x\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.867165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.867102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.867165 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.867151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/038f3d95-6a91-4e8f-8768-881536442926-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.867869 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.867845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/038f3d95-6a91-4e8f-8768-881536442926-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.869416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.869394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.869513 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.869434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/038f3d95-6a91-4e8f-8768-881536442926-cert\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:01.876390 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:01.876343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/038f3d95-6a91-4e8f-8768-881536442926-kube-api-access-h8w8x\") pod \"lws-controller-manager-cc8ff6b7b-559cc\" (UID: \"038f3d95-6a91-4e8f-8768-881536442926\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:02.022363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.022337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:02.042768 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.042746 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:40:02.163157 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.163132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc"] Jun 03 19:40:02.165580 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:40:02.165511 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038f3d95_6a91_4e8f_8768_881536442926.slice/crio-a1cecd57dd3d6078347b3cc9ec6cd20a9013c89fdef411553ff9fbd715fe653d WatchSource:0}: Error finding container a1cecd57dd3d6078347b3cc9ec6cd20a9013c89fdef411553ff9fbd715fe653d: Status 404 returned error can't find the container with id a1cecd57dd3d6078347b3cc9ec6cd20a9013c89fdef411553ff9fbd715fe653d Jun 03 19:40:02.169091 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.169070 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util\") pod \"3963ce48-f6b3-4787-b369-ef697d823f09\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " Jun 03 19:40:02.169174 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.169119 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6v7t\" (UniqueName: \"kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t\") pod \"3963ce48-f6b3-4787-b369-ef697d823f09\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " Jun 03 19:40:02.169174 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.169157 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle\") pod \"3963ce48-f6b3-4787-b369-ef697d823f09\" (UID: \"3963ce48-f6b3-4787-b369-ef697d823f09\") " Jun 03 19:40:02.170010 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.169984 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle" (OuterVolumeSpecName: "bundle") pod "3963ce48-f6b3-4787-b369-ef697d823f09" (UID: "3963ce48-f6b3-4787-b369-ef697d823f09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:02.171298 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.171278 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t" (OuterVolumeSpecName: "kube-api-access-l6v7t") pod "3963ce48-f6b3-4787-b369-ef697d823f09" (UID: "3963ce48-f6b3-4787-b369-ef697d823f09"). InnerVolumeSpecName "kube-api-access-l6v7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:02.174999 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.174979 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util" (OuterVolumeSpecName: "util") pod "3963ce48-f6b3-4787-b369-ef697d823f09" (UID: "3963ce48-f6b3-4787-b369-ef697d823f09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:02.270617 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.270591 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:02.270617 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.270613 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6v7t\" (UniqueName: \"kubernetes.io/projected/3963ce48-f6b3-4787-b369-ef697d823f09-kube-api-access-l6v7t\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:02.270796 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.270624 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3963ce48-f6b3-4787-b369-ef697d823f09-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:02.919720 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.919694 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" Jun 03 19:40:02.919889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.919722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55bcl" event={"ID":"3963ce48-f6b3-4787-b369-ef697d823f09","Type":"ContainerDied","Data":"fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3"} Jun 03 19:40:02.919889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.919764 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc04b3b61c0a8e1db91c4d8e06276417f469af6fc3e0fae4408d9efc29e196b3" Jun 03 19:40:02.920887 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:02.920864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" event={"ID":"038f3d95-6a91-4e8f-8768-881536442926","Type":"ContainerStarted","Data":"a1cecd57dd3d6078347b3cc9ec6cd20a9013c89fdef411553ff9fbd715fe653d"} Jun 03 19:40:06.941363 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:06.941327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" event={"ID":"038f3d95-6a91-4e8f-8768-881536442926","Type":"ContainerStarted","Data":"8c44bc4cab21a03d797ed56f79fb341dbb7b61737a0db6018844363381473023"} Jun 03 19:40:06.941828 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:06.941447 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:06.960010 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:06.959968 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" podStartSLOduration=1.721969474 podStartE2EDuration="5.959950116s" totalImagesPullingTime="4.237980642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:06.958656473 +0000 UTC m=+571.654512193" watchObservedRunningTime="2026-06-03 19:40:06.959950116 +0000 UTC m=+571.655805836" Jun 03 19:40:09.527416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:09.527388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:09.634840 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:09.634810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.138509 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.138473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.341017 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.340982 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.444029 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.443939 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.495044 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495007 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s"] Jun 03 19:40:10.495356 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495342 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="util" Jun 03 19:40:10.495400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495357 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="util" Jun 03 19:40:10.495400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495371 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="pull" Jun 03 19:40:10.495400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495378 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="pull" Jun 03 19:40:10.495400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495394 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="extract" Jun 03 19:40:10.495400 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495400 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="extract" Jun 03 19:40:10.495719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.495451 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3963ce48-f6b3-4787-b369-ef697d823f09" containerName="extract" Jun 03 19:40:10.497378 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.497362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.503552 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.503529 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:40:10.503815 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.503798 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tmlx9\"" Jun 03 19:40:10.503933 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.503910 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:40:10.504001 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.503978 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:40:10.504116 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.504029 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:40:10.531424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.531400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s"] Jun 03 19:40:10.645048 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.645017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.645048 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.645048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.645308 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.645068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.645308 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.645087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.645308 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.645206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnjt\" (UniqueName: \"kubernetes.io/projected/234d27d0-175b-41bc-8308-9c04a0fda579-kube-api-access-2dnjt\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.665042 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.665017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.746542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnjt\" (UniqueName: \"kubernetes.io/projected/234d27d0-175b-41bc-8308-9c04a0fda579-kube-api-access-2dnjt\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.746642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.746642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.746642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.746642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.746976 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.746945 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.748875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.748857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/234d27d0-175b-41bc-8308-9c04a0fda579-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.749014 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.748995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.749192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.749173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/234d27d0-175b-41bc-8308-9c04a0fda579-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.756162 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.756137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnjt\" (UniqueName: \"kubernetes.io/projected/234d27d0-175b-41bc-8308-9c04a0fda579-kube-api-access-2dnjt\") pod \"opendatahub-operator-controller-manager-548746c444-dgd6s\" (UID: \"234d27d0-175b-41bc-8308-9c04a0fda579\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.767194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.767174 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.808349 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.808328 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:10.874605 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.874577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.940041 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.940018 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s"] Jun 03 19:40:10.943457 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:40:10.943433 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234d27d0_175b_41bc_8308_9c04a0fda579.slice/crio-4c413633401349e157a4ca01f8e6f7079df0a0857ad2d0ac331d6bdccb214c69 WatchSource:0}: Error finding container 4c413633401349e157a4ca01f8e6f7079df0a0857ad2d0ac331d6bdccb214c69: Status 404 returned error can't find the container with id 4c413633401349e157a4ca01f8e6f7079df0a0857ad2d0ac331d6bdccb214c69 Jun 03 19:40:10.944973 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.944948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:10.960453 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:10.960427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" event={"ID":"234d27d0-175b-41bc-8308-9c04a0fda579","Type":"ContainerStarted","Data":"4c413633401349e157a4ca01f8e6f7079df0a0857ad2d0ac331d6bdccb214c69"} Jun 03 19:40:11.012923 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:11.012854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:11.110956 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:11.110918 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:11.211448 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:11.211415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:11.313234 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:11.313156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:13.982257 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:13.982207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" event={"ID":"234d27d0-175b-41bc-8308-9c04a0fda579","Type":"ContainerStarted","Data":"0def5040006648a1ada4e46ae350bffad9146fedc27bba58d54515c949b6b307"} Jun 03 19:40:14.988480 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:14.988447 2573 generic.go:356] "Generic (PLEG): container finished" podID="234d27d0-175b-41bc-8308-9c04a0fda579" containerID="0def5040006648a1ada4e46ae350bffad9146fedc27bba58d54515c949b6b307" exitCode=0 Jun 03 19:40:14.988851 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:14.988529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" event={"ID":"234d27d0-175b-41bc-8308-9c04a0fda579","Type":"ContainerDied","Data":"0def5040006648a1ada4e46ae350bffad9146fedc27bba58d54515c949b6b307"} Jun 03 19:40:15.994087 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:15.994053 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" event={"ID":"234d27d0-175b-41bc-8308-9c04a0fda579","Type":"ContainerStarted","Data":"20aa19ce66c5274eef737ddff292965f8af6422f7680b948f1dae4a285a5f217"} Jun 03 19:40:15.994476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:15.994167 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:16.015021 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:16.014978 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" podStartSLOduration=1.892146419 podStartE2EDuration="6.0149644s" totalImagesPullingTime="3.128731437s" totalInitContainerRuntime="994.086544ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:16.012223464 +0000 UTC m=+580.708079184" watchObservedRunningTime="2026-06-03 19:40:16.0149644 +0000 UTC m=+580.710820119" Jun 03 19:40:17.947205 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:17.947174 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-559cc" Jun 03 19:40:20.234751 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:20.234722 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:21.109422 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:21.109391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:21.204348 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:21.204318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:27.001263 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:27.001223 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-dgd6s" Jun 03 19:40:28.834374 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:28.834330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:28.956053 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:28.956020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.110343 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.110229 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.204040 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.204014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.343188 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.343155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.475119 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.475047 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.582589 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.582558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.680892 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.680861 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:29.952494 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:29.952460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:30.141938 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:30.141909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:30.292571 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:30.292496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:31.259756 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.259722 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2"] Jun 03 19:40:31.263364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.263348 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.265725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.265703 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:40:31.266614 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.266599 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:40:31.266701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.266613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:40:31.271631 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.271610 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2"] Jun 03 19:40:31.331553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.331526 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.331704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.331585 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.331704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.331632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpwnc\" (UniqueName: \"kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.432613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.432589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.432731 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.432621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpwnc\" (UniqueName: \"kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.432731 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.432687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.432971 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.432949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.433039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.432992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.440815 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.440788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpwnc\" (UniqueName: \"kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.572881 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.572814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:31.707534 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:31.707513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2"] Jun 03 19:40:31.709795 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:40:31.709768 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50f59cd_4826_4df3_9a3e_7717ef733b90.slice/crio-407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc WatchSource:0}: Error finding container 407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc: Status 404 returned error can't find the container with id 407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc Jun 03 19:40:32.078940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:32.078908 2573 generic.go:356] "Generic (PLEG): container finished" podID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerID="f3616f70d36e096846296778df21ecb2e2ae4993c2581edce71c72826694b751" exitCode=0 Jun 03 19:40:32.079104 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:32.078996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" event={"ID":"c50f59cd-4826-4df3-9a3e-7717ef733b90","Type":"ContainerDied","Data":"f3616f70d36e096846296778df21ecb2e2ae4993c2581edce71c72826694b751"} Jun 03 19:40:32.079104 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:32.079047 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" event={"ID":"c50f59cd-4826-4df3-9a3e-7717ef733b90","Type":"ContainerStarted","Data":"407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc"} Jun 03 19:40:34.089854 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:34.089821 2573 generic.go:356] "Generic (PLEG): container finished" podID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerID="acbf8855d0272f99f50b1188e58f589332025fa86bf4b3ee44dc738d7c22a801" exitCode=0 Jun 03 19:40:34.090259 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:34.089890 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" event={"ID":"c50f59cd-4826-4df3-9a3e-7717ef733b90","Type":"ContainerDied","Data":"acbf8855d0272f99f50b1188e58f589332025fa86bf4b3ee44dc738d7c22a801"} Jun 03 19:40:35.097039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:35.097005 2573 generic.go:356] "Generic (PLEG): container finished" podID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerID="03534256f6fd722e2d42899019267a616603ed856fa483950b4ff8cd0942e984" exitCode=0 Jun 03 19:40:35.097427 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:35.097085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" event={"ID":"c50f59cd-4826-4df3-9a3e-7717ef733b90","Type":"ContainerDied","Data":"03534256f6fd722e2d42899019267a616603ed856fa483950b4ff8cd0942e984"} Jun 03 19:40:35.781157 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:35.781128 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:40:35.787591 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:35.787570 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:40:36.227533 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.227512 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:36.272760 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.272732 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle\") pod \"c50f59cd-4826-4df3-9a3e-7717ef733b90\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " Jun 03 19:40:36.272906 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.272814 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util\") pod \"c50f59cd-4826-4df3-9a3e-7717ef733b90\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " Jun 03 19:40:36.272906 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.272845 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpwnc\" (UniqueName: \"kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc\") pod \"c50f59cd-4826-4df3-9a3e-7717ef733b90\" (UID: \"c50f59cd-4826-4df3-9a3e-7717ef733b90\") " Jun 03 19:40:36.273621 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.273585 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle" (OuterVolumeSpecName: "bundle") pod "c50f59cd-4826-4df3-9a3e-7717ef733b90" (UID: "c50f59cd-4826-4df3-9a3e-7717ef733b90"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:36.274909 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.274887 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc" (OuterVolumeSpecName: "kube-api-access-rpwnc") pod "c50f59cd-4826-4df3-9a3e-7717ef733b90" (UID: "c50f59cd-4826-4df3-9a3e-7717ef733b90"). InnerVolumeSpecName "kube-api-access-rpwnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:36.277814 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.277782 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util" (OuterVolumeSpecName: "util") pod "c50f59cd-4826-4df3-9a3e-7717ef733b90" (UID: "c50f59cd-4826-4df3-9a3e-7717ef733b90"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:36.373995 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.373927 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:36.373995 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.373952 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpwnc\" (UniqueName: \"kubernetes.io/projected/c50f59cd-4826-4df3-9a3e-7717ef733b90-kube-api-access-rpwnc\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:36.373995 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:36.373963 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c50f59cd-4826-4df3-9a3e-7717ef733b90-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:37.108916 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:37.108876 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" Jun 03 19:40:37.108916 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:37.108901 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fkjs2" event={"ID":"c50f59cd-4826-4df3-9a3e-7717ef733b90","Type":"ContainerDied","Data":"407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc"} Jun 03 19:40:37.109121 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:37.108950 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="407725024e28c7b609701e3c2db5f4463ac1a3f3de6f6f760cf1d473efc655cc" Jun 03 19:40:40.083345 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:40.083316 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:41.150057 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:41.150025 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:41.368215 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:41.368188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:41.465446 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:41.465362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:43.935340 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:43.935302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:44.036339 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:44.036301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:44.508637 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:44.508602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:45.262117 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.262085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:45.994268 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994224 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g"] Jun 03 19:40:45.994580 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994566 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="util" Jun 03 19:40:45.994630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994581 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="util" Jun 03 19:40:45.994630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="pull" Jun 03 19:40:45.994630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994601 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="pull" Jun 03 19:40:45.994630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994608 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="extract" Jun 03 19:40:45.994630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994614 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="extract" Jun 03 19:40:45.994784 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:45.994678 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c50f59cd-4826-4df3-9a3e-7717ef733b90" containerName="extract" Jun 03 19:40:46.000541 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.000520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.003251 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.003215 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:40:46.003385 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.003214 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:40:46.003607 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.003585 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:40:46.007147 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.007126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g"] Jun 03 19:40:46.059819 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.059795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:46.153954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.153926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:46.163543 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.163518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.163685 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.163591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhsm\" (UniqueName: \"kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.163685 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.163621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.264457 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.264390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.264833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.264489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhsm\" (UniqueName: \"kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.264833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.264519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.264833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.264728 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.264833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.264794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.272556 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.272530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhsm\" (UniqueName: \"kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.313032 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.313011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:46.449787 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:46.449757 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g"] Jun 03 19:40:46.451180 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:40:46.451153 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfb062c_a41c_4368_8c99_7c7edcd767f4.slice/crio-d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785 WatchSource:0}: Error finding container d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785: Status 404 returned error can't find the container with id d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785 Jun 03 19:40:47.168223 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:47.168192 2573 generic.go:356] "Generic (PLEG): container finished" podID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerID="c9e5162d9f3f0acb3191c8774d95d7c3ab4d5694cb3a5aa9dd10fe736b7b6545" exitCode=0 Jun 03 19:40:47.168223 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:47.168231 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" event={"ID":"3cfb062c-a41c-4368-8c99-7c7edcd767f4","Type":"ContainerDied","Data":"c9e5162d9f3f0acb3191c8774d95d7c3ab4d5694cb3a5aa9dd10fe736b7b6545"} Jun 03 19:40:47.168453 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:47.168281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" event={"ID":"3cfb062c-a41c-4368-8c99-7c7edcd767f4","Type":"ContainerStarted","Data":"d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785"} Jun 03 19:40:47.169375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:47.169358 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:40:48.075199 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:48.075169 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:49.183380 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:49.183350 2573 generic.go:356] "Generic (PLEG): container finished" podID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerID="ba9b693789885e38a6d8cc51c6eda1f799fb19b2110c21d5f1e98411473c9cec" exitCode=0 Jun 03 19:40:49.183763 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:49.183423 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" event={"ID":"3cfb062c-a41c-4368-8c99-7c7edcd767f4","Type":"ContainerDied","Data":"ba9b693789885e38a6d8cc51c6eda1f799fb19b2110c21d5f1e98411473c9cec"} Jun 03 19:40:50.190159 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:50.190127 2573 generic.go:356] "Generic (PLEG): container finished" podID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerID="802c2bede726b905cc31b7e8c03e800d6b8aa0487d379849d182caf573e9e92f" exitCode=0 Jun 03 19:40:50.190542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:50.190213 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" event={"ID":"3cfb062c-a41c-4368-8c99-7c7edcd767f4","Type":"ContainerDied","Data":"802c2bede726b905cc31b7e8c03e800d6b8aa0487d379849d182caf573e9e92f"} Jun 03 19:40:51.319831 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.319808 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:51.406725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.406695 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util\") pod \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " Jun 03 19:40:51.406849 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.406766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqhsm\" (UniqueName: \"kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm\") pod \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " Jun 03 19:40:51.406849 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.406801 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle\") pod \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\" (UID: \"3cfb062c-a41c-4368-8c99-7c7edcd767f4\") " Jun 03 19:40:51.407687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.407661 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle" (OuterVolumeSpecName: "bundle") pod "3cfb062c-a41c-4368-8c99-7c7edcd767f4" (UID: "3cfb062c-a41c-4368-8c99-7c7edcd767f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:51.408821 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.408792 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm" (OuterVolumeSpecName: "kube-api-access-lqhsm") pod "3cfb062c-a41c-4368-8c99-7c7edcd767f4" (UID: "3cfb062c-a41c-4368-8c99-7c7edcd767f4"). InnerVolumeSpecName "kube-api-access-lqhsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:40:51.412055 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.412034 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util" (OuterVolumeSpecName: "util") pod "3cfb062c-a41c-4368-8c99-7c7edcd767f4" (UID: "3cfb062c-a41c-4368-8c99-7c7edcd767f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:40:51.508188 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.508131 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:51.508188 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.508152 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqhsm\" (UniqueName: \"kubernetes.io/projected/3cfb062c-a41c-4368-8c99-7c7edcd767f4-kube-api-access-lqhsm\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:51.508188 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:51.508162 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cfb062c-a41c-4368-8c99-7c7edcd767f4-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:40:52.200792 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:52.200754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" event={"ID":"3cfb062c-a41c-4368-8c99-7c7edcd767f4","Type":"ContainerDied","Data":"d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785"} Jun 03 19:40:52.200792 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:52.200781 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ab9l9g" Jun 03 19:40:52.201034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:52.200808 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6bec4498676bb4d0bdc4bc0c1d6794446a260dc3ffd69fb67be5b4e7dd83785" Jun 03 19:40:58.653254 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:58.653209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:58.705373 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:58.705345 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:59.707692 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.707657 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-cznmg"] Jun 03 19:40:59.708294 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708275 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="pull" Jun 03 19:40:59.708350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708298 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="pull" Jun 03 19:40:59.708350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708318 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="extract" Jun 03 19:40:59.708350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708326 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="extract" Jun 03 19:40:59.708462 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708363 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="util" Jun 03 19:40:59.708462 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708371 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="util" Jun 03 19:40:59.708542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.708465 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cfb062c-a41c-4368-8c99-7c7edcd767f4" containerName="extract" Jun 03 19:40:59.710741 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.710721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.713350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.713323 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:40:59.713628 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.713464 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d7qfw\"" Jun 03 19:40:59.717794 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.717769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-cznmg"] Jun 03 19:40:59.721021 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.721002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:40:59.878107 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.878076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndfmd\" (UniqueName: \"kubernetes.io/projected/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-kube-api-access-ndfmd\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.878278 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.878141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.979194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.979116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndfmd\" (UniqueName: \"kubernetes.io/projected/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-kube-api-access-ndfmd\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.979194 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.979181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.979871 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.979851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-redirect-config\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:40:59.988358 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:40:59.988320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndfmd\" (UniqueName: \"kubernetes.io/projected/f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1-kube-api-access-ndfmd\") pod \"dashboard-redirect-fbff5bcdc-cznmg\" (UID: \"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1\") " pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:41:00.022695 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:00.022665 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" Jun 03 19:41:00.151332 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:00.151306 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbff5bcdc-cznmg"] Jun 03 19:41:00.153412 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:00.153385 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8124adc_cf5c_4eae_a6c4_3fd4b9e3e4c1.slice/crio-5084c06541295486fd2a7d4e706ca7baf3a8fcc11a431b3c49543abb4dc97a16 WatchSource:0}: Error finding container 5084c06541295486fd2a7d4e706ca7baf3a8fcc11a431b3c49543abb4dc97a16: Status 404 returned error can't find the container with id 5084c06541295486fd2a7d4e706ca7baf3a8fcc11a431b3c49543abb4dc97a16 Jun 03 19:41:00.242148 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:00.242069 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" event={"ID":"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1","Type":"ContainerStarted","Data":"5084c06541295486fd2a7d4e706ca7baf3a8fcc11a431b3c49543abb4dc97a16"} Jun 03 19:41:05.274295 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:05.274192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" event={"ID":"f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1","Type":"ContainerStarted","Data":"bca5b49fa21e5b678fa7da38c2574af01d68328735ab48971a7f43105982f85c"} Jun 03 19:41:05.291324 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:05.291284 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-fbff5bcdc-cznmg" podStartSLOduration=1.561124124 podStartE2EDuration="6.291270879s" totalImagesPullingTime="4.730146755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:05.290160878 +0000 UTC m=+629.986016598" watchObservedRunningTime="2026-06-03 19:41:05.291270879 +0000 UTC m=+629.987126598" Jun 03 19:41:14.392476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:14.392441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:14.459587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:14.459558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:14.933023 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:14.932992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.404031 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.403992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.461829 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.461801 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.664157 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.664059 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj"] Jun 03 19:41:19.670227 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.670196 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.672875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.672849 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qw8pv\"" Jun 03 19:41:19.672993 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.672851 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:41:19.703945 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.693524 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj"] Jun 03 19:41:19.705343 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.705310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.733474 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw9ng\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-kube-api-access-cw9ng\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733571 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733571 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733540 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733652 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21a8203d-062f-4e13-9c41-5bb1518ee88b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733688 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733752 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733796 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.733836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.733808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.793939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.793900 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.834820 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.834790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.834923 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.834820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.834923 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.834858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835008 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.834968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835047 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw9ng\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-kube-api-access-cw9ng\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835047 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835123 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21a8203d-062f-4e13-9c41-5bb1518ee88b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835391 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.835910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.835889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21a8203d-062f-4e13-9c41-5bb1518ee88b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.837274 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.837228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.837364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.837350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.843487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.843464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.843639 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.843623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw9ng\" (UniqueName: \"kubernetes.io/projected/21a8203d-062f-4e13-9c41-5bb1518ee88b-kube-api-access-cw9ng\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcct8hj\" (UID: \"21a8203d-062f-4e13-9c41-5bb1518ee88b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:19.893875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.893855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:19.986463 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:19.986396 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:20.123511 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:20.123486 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj"] Jun 03 19:41:20.125333 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:20.125297 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a8203d_062f_4e13_9c41_5bb1518ee88b.slice/crio-a4f97b163ea23e33b9575f070c8a324852a38875288d0276cf90412bec5df737 WatchSource:0}: Error finding container a4f97b163ea23e33b9575f070c8a324852a38875288d0276cf90412bec5df737: Status 404 returned error can't find the container with id a4f97b163ea23e33b9575f070c8a324852a38875288d0276cf90412bec5df737 Jun 03 19:41:20.271442 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:20.271368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:20.348289 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:20.348256 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" event={"ID":"21a8203d-062f-4e13-9c41-5bb1518ee88b","Type":"ContainerStarted","Data":"a4f97b163ea23e33b9575f070c8a324852a38875288d0276cf90412bec5df737"} Jun 03 19:41:23.792137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:23.792084 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:41:23.792381 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:23.792183 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:41:23.792381 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:23.792215 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:41:24.370987 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:24.370956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" event={"ID":"21a8203d-062f-4e13-9c41-5bb1518ee88b","Type":"ContainerStarted","Data":"fd4387cc8cce1f982f4ff58cc41315a0efbf6be9163aedec65a0c7fda0669790"} Jun 03 19:41:24.394368 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:24.394316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" podStartSLOduration=1.7299716059999999 podStartE2EDuration="5.394302333s" totalImagesPullingTime="3.664330727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:24.392432027 +0000 UTC m=+649.088287746" watchObservedRunningTime="2026-06-03 19:41:24.394302333 +0000 UTC m=+649.090158051" Jun 03 19:41:24.987387 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:24.987357 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:24.991748 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:24.991720 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:25.376291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:25.376259 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:25.377326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:25.377308 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcct8hj" Jun 03 19:41:30.325197 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.325162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:30.431876 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.431850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:30.458898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.458874 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:30.462364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.462344 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:30.464767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.464744 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:41:30.465754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.465736 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:41:30.465854 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.465750 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2d2zq\"" Jun 03 19:41:30.471813 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.471792 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:30.526506 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.526475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltdkl\" (UniqueName: \"kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl\") pod \"kuadrant-operator-catalog-kcnwj\" (UID: \"ff2c3d11-301f-4121-94fd-75cae24e664e\") " pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:30.527098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.527076 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:30.627085 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.627060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltdkl\" (UniqueName: \"kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl\") pod \"kuadrant-operator-catalog-kcnwj\" (UID: \"ff2c3d11-301f-4121-94fd-75cae24e664e\") " pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:30.634746 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.634726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltdkl\" (UniqueName: \"kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl\") pod \"kuadrant-operator-catalog-kcnwj\" (UID: \"ff2c3d11-301f-4121-94fd-75cae24e664e\") " pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:30.774203 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.774174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:30.902009 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:30.901984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:30.904173 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:30.904146 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2c3d11_301f_4121_94fd_75cae24e664e.slice/crio-586d08e357dde474c0cd17a80c3f36bc0c5534712b6aced53824f8cc9d06e2c8 WatchSource:0}: Error finding container 586d08e357dde474c0cd17a80c3f36bc0c5534712b6aced53824f8cc9d06e2c8: Status 404 returned error can't find the container with id 586d08e357dde474c0cd17a80c3f36bc0c5534712b6aced53824f8cc9d06e2c8 Jun 03 19:41:31.206894 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.206811 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:31.227873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.227843 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gk8nl"] Jun 03 19:41:31.233264 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.233022 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:31.239630 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.239606 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gk8nl"] Jun 03 19:41:31.261564 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.261536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:31.333736 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.333712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9tcs\" (UniqueName: \"kubernetes.io/projected/1bd2800c-a61f-4a46-ac21-0227b9011032-kube-api-access-t9tcs\") pod \"kuadrant-operator-catalog-gk8nl\" (UID: \"1bd2800c-a61f-4a46-ac21-0227b9011032\") " pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:31.407178 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.407151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" event={"ID":"ff2c3d11-301f-4121-94fd-75cae24e664e","Type":"ContainerStarted","Data":"586d08e357dde474c0cd17a80c3f36bc0c5534712b6aced53824f8cc9d06e2c8"} Jun 03 19:41:31.434676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.434649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9tcs\" (UniqueName: \"kubernetes.io/projected/1bd2800c-a61f-4a46-ac21-0227b9011032-kube-api-access-t9tcs\") pod \"kuadrant-operator-catalog-gk8nl\" (UID: \"1bd2800c-a61f-4a46-ac21-0227b9011032\") " pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:31.443665 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.443640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9tcs\" (UniqueName: \"kubernetes.io/projected/1bd2800c-a61f-4a46-ac21-0227b9011032-kube-api-access-t9tcs\") pod \"kuadrant-operator-catalog-gk8nl\" (UID: \"1bd2800c-a61f-4a46-ac21-0227b9011032\") " pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:31.456583 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.456546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:41:31.546307 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.546225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:31.878832 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:31.878810 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gk8nl"] Jun 03 19:41:31.884645 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:31.884619 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2800c_a61f_4a46_ac21_0227b9011032.slice/crio-1cc360c9a5c0ddd2a016f50d3759ec80ad142e644c1384dd05b3c8f33acaf086 WatchSource:0}: Error finding container 1cc360c9a5c0ddd2a016f50d3759ec80ad142e644c1384dd05b3c8f33acaf086: Status 404 returned error can't find the container with id 1cc360c9a5c0ddd2a016f50d3759ec80ad142e644c1384dd05b3c8f33acaf086 Jun 03 19:41:32.415212 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:32.415112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" event={"ID":"1bd2800c-a61f-4a46-ac21-0227b9011032","Type":"ContainerStarted","Data":"1cc360c9a5c0ddd2a016f50d3759ec80ad142e644c1384dd05b3c8f33acaf086"} Jun 03 19:41:33.421456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.421421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" event={"ID":"ff2c3d11-301f-4121-94fd-75cae24e664e","Type":"ContainerStarted","Data":"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498"} Jun 03 19:41:33.421873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.421465 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" podUID="ff2c3d11-301f-4121-94fd-75cae24e664e" containerName="registry-server" containerID="cri-o://6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498" gracePeriod=2 Jun 03 19:41:33.423130 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.423110 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" event={"ID":"1bd2800c-a61f-4a46-ac21-0227b9011032","Type":"ContainerStarted","Data":"a7b03a768553797f0449d25854c079c351b0e78cd13898d774751e7d583e645c"} Jun 03 19:41:33.435549 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.435511 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" podStartSLOduration=1.121362696 podStartE2EDuration="3.43549785s" totalImagesPullingTime="2.314135154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:33.43483917 +0000 UTC m=+658.130694878" watchObservedRunningTime="2026-06-03 19:41:33.43549785 +0000 UTC m=+658.131353569" Jun 03 19:41:33.448464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.448425 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" podStartSLOduration=1.111230229 podStartE2EDuration="2.448412703s" totalImagesPullingTime="1.337182474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:33.448060851 +0000 UTC m=+658.143916570" watchObservedRunningTime="2026-06-03 19:41:33.448412703 +0000 UTC m=+658.144268423" Jun 03 19:41:33.665615 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.665591 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:33.756657 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.756627 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltdkl\" (UniqueName: \"kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl\") pod \"ff2c3d11-301f-4121-94fd-75cae24e664e\" (UID: \"ff2c3d11-301f-4121-94fd-75cae24e664e\") " Jun 03 19:41:33.758730 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.758705 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl" (OuterVolumeSpecName: "kube-api-access-ltdkl") pod "ff2c3d11-301f-4121-94fd-75cae24e664e" (UID: "ff2c3d11-301f-4121-94fd-75cae24e664e"). InnerVolumeSpecName "kube-api-access-ltdkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:33.857299 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:33.857271 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltdkl\" (UniqueName: \"kubernetes.io/projected/ff2c3d11-301f-4121-94fd-75cae24e664e-kube-api-access-ltdkl\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:34.429332 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.429293 2573 generic.go:356] "Generic (PLEG): container finished" podID="ff2c3d11-301f-4121-94fd-75cae24e664e" containerID="6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498" exitCode=0 Jun 03 19:41:34.429700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.429366 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" Jun 03 19:41:34.429700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.429371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" event={"ID":"ff2c3d11-301f-4121-94fd-75cae24e664e","Type":"ContainerDied","Data":"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498"} Jun 03 19:41:34.429700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.429449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kcnwj" event={"ID":"ff2c3d11-301f-4121-94fd-75cae24e664e","Type":"ContainerDied","Data":"586d08e357dde474c0cd17a80c3f36bc0c5534712b6aced53824f8cc9d06e2c8"} Jun 03 19:41:34.429700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.429474 2573 scope.go:117] "RemoveContainer" containerID="6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498" Jun 03 19:41:34.438676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.438660 2573 scope.go:117] "RemoveContainer" containerID="6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498" Jun 03 19:41:34.438886 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:41:34.438866 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498\": container with ID starting with 6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498 not found: ID does not exist" containerID="6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498" Jun 03 19:41:34.438930 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.438898 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498"} err="failed to get container status \"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498\": rpc error: code = NotFound desc = could not find container \"6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498\": container with ID starting with 6944b38f20abec80aacca028018cfe04a020c30e2d3e3107485ab49c7afbb498 not found: ID does not exist" Jun 03 19:41:34.444137 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.444117 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:34.447973 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:34.447953 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kcnwj"] Jun 03 19:41:35.801453 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:35.801430 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2c3d11-301f-4121-94fd-75cae24e664e" path="/var/lib/kubelet/pods/ff2c3d11-301f-4121-94fd-75cae24e664e/volumes" Jun 03 19:41:41.547127 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:41.547077 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:41.547568 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:41.547165 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:41.569610 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:41.569585 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:42.490321 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:42.490292 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gk8nl" Jun 03 19:41:46.899438 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.899406 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7"] Jun 03 19:41:46.899819 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.899763 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2c3d11-301f-4121-94fd-75cae24e664e" containerName="registry-server" Jun 03 19:41:46.899819 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.899772 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2c3d11-301f-4121-94fd-75cae24e664e" containerName="registry-server" Jun 03 19:41:46.899908 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.899848 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2c3d11-301f-4121-94fd-75cae24e664e" containerName="registry-server" Jun 03 19:41:46.913938 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.913912 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7"] Jun 03 19:41:46.914058 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.914000 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:46.916358 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:46.916338 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgwg5\"" Jun 03 19:41:47.066729 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.066695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxthf\" (UniqueName: \"kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.066882 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.066812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.066882 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.066843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.091684 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.091656 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx"] Jun 03 19:41:47.094046 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.094032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.103889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.103867 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx"] Jun 03 19:41:47.167868 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zm65\" (UniqueName: \"kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.167868 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.168037 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.168037 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.168037 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxthf\" (UniqueName: \"kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.168037 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.167968 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.168342 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.168321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.168392 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.168354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.175771 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.175742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxthf\" (UniqueName: \"kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.223053 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.223017 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:47.269846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.269257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.269846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.269375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.269846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.269432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zm65\" (UniqueName: \"kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.269846 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.269814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.270179 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.270137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.278493 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.278466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zm65\" (UniqueName: \"kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.352336 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.352308 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7"] Jun 03 19:41:47.354021 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:47.353994 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c917e40_35e0_4d9d_b8af_a26bdec374d3.slice/crio-8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb WatchSource:0}: Error finding container 8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb: Status 404 returned error can't find the container with id 8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb Jun 03 19:41:47.403434 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.403414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:47.497652 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.497619 2573 generic.go:356] "Generic (PLEG): container finished" podID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerID="f26e56699164ab41eaa9c73090c94b444a3a61c61883538c6e1eb2121265c0b8" exitCode=0 Jun 03 19:41:47.497791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.497650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" event={"ID":"5c917e40-35e0-4d9d-b8af-a26bdec374d3","Type":"ContainerDied","Data":"f26e56699164ab41eaa9c73090c94b444a3a61c61883538c6e1eb2121265c0b8"} Jun 03 19:41:47.497791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.497705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" event={"ID":"5c917e40-35e0-4d9d-b8af-a26bdec374d3","Type":"ContainerStarted","Data":"8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb"} Jun 03 19:41:47.537952 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.537926 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx"] Jun 03 19:41:47.539562 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:47.539533 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bc20de_875f_4e88_af5d_3c390e5dfeb6.slice/crio-f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f WatchSource:0}: Error finding container f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f: Status 404 returned error can't find the container with id f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f Jun 03 19:41:47.688591 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.688555 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q"] Jun 03 19:41:47.691149 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.691133 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.698998 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.698941 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q"] Jun 03 19:41:47.774570 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.774542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4nkl\" (UniqueName: \"kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.774718 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.774578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.774718 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.774607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.875875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.875847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4nkl\" (UniqueName: \"kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.876001 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.875884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.876001 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.875910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.876252 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.876218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.876291 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.876229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:47.884634 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:47.884610 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4nkl\" (UniqueName: \"kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:48.031933 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.031845 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:48.161884 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.161856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q"] Jun 03 19:41:48.165483 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:48.165444 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b08de0_f09b_44df_b3de_7b9f6775df6a.slice/crio-e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7 WatchSource:0}: Error finding container e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7: Status 404 returned error can't find the container with id e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7 Jun 03 19:41:48.295406 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.295345 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk"] Jun 03 19:41:48.297764 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.297749 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.306127 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.306103 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk"] Jun 03 19:41:48.379344 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.379319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.379454 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.379361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.379454 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.379399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xg45\" (UniqueName: \"kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.480624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.480590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.480789 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.480651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xg45\" (UniqueName: \"kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.480789 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.480730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.481043 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.481020 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.481084 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.481038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.488839 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.488810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xg45\" (UniqueName: \"kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.504611 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.504585 2573 generic.go:356] "Generic (PLEG): container finished" podID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerID="91f8e6c548ac122b264deafe9a401365da06b71b98d112cd08d697faac6e1f4e" exitCode=0 Jun 03 19:41:48.504708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.504652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" event={"ID":"94b08de0-f09b-44df-b3de-7b9f6775df6a","Type":"ContainerDied","Data":"91f8e6c548ac122b264deafe9a401365da06b71b98d112cd08d697faac6e1f4e"} Jun 03 19:41:48.504708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.504686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" event={"ID":"94b08de0-f09b-44df-b3de-7b9f6775df6a","Type":"ContainerStarted","Data":"e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7"} Jun 03 19:41:48.506219 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.506196 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerID="00ca314387ca97cdb5e78a665fd30cefc43aa612ed5f29ece370d63237fa2771" exitCode=0 Jun 03 19:41:48.506326 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.506281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" event={"ID":"d8bc20de-875f-4e88-af5d-3c390e5dfeb6","Type":"ContainerDied","Data":"00ca314387ca97cdb5e78a665fd30cefc43aa612ed5f29ece370d63237fa2771"} Jun 03 19:41:48.506377 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.506329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" event={"ID":"d8bc20de-875f-4e88-af5d-3c390e5dfeb6","Type":"ContainerStarted","Data":"f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f"} Jun 03 19:41:48.508455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.508381 2573 generic.go:356] "Generic (PLEG): container finished" podID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerID="4c926cdcf57eceb697d875786e680889bcea91c24401769691f9aad8815feb50" exitCode=0 Jun 03 19:41:48.508455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.508419 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" event={"ID":"5c917e40-35e0-4d9d-b8af-a26bdec374d3","Type":"ContainerDied","Data":"4c926cdcf57eceb697d875786e680889bcea91c24401769691f9aad8815feb50"} Jun 03 19:41:48.677140 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.677110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:48.807516 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:48.807490 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk"] Jun 03 19:41:48.809491 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:41:48.809456 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8962b3c4_0262_4c4f_8904_8fbb2f7e250d.slice/crio-fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937 WatchSource:0}: Error finding container fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937: Status 404 returned error can't find the container with id fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937 Jun 03 19:41:49.515551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.515520 2573 generic.go:356] "Generic (PLEG): container finished" podID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerID="4b6790d52e777eac4df907b2b2978247606226ced1c6c57e5c1d7a730b05affe" exitCode=0 Jun 03 19:41:49.515896 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.515596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" event={"ID":"5c917e40-35e0-4d9d-b8af-a26bdec374d3","Type":"ContainerDied","Data":"4b6790d52e777eac4df907b2b2978247606226ced1c6c57e5c1d7a730b05affe"} Jun 03 19:41:49.517031 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.517008 2573 generic.go:356] "Generic (PLEG): container finished" podID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerID="c319349e4fa80a09a090c549f99350c8bd92e0aab04fa97413aca4baf014c0e4" exitCode=0 Jun 03 19:41:49.517143 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.517095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" event={"ID":"8962b3c4-0262-4c4f-8904-8fbb2f7e250d","Type":"ContainerDied","Data":"c319349e4fa80a09a090c549f99350c8bd92e0aab04fa97413aca4baf014c0e4"} Jun 03 19:41:49.517143 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.517141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" event={"ID":"8962b3c4-0262-4c4f-8904-8fbb2f7e250d","Type":"ContainerStarted","Data":"fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937"} Jun 03 19:41:49.519065 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.519045 2573 generic.go:356] "Generic (PLEG): container finished" podID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerID="62ca2d1277d23542ea4d5b64df95c86662e515ae09b58f2c643cff41f6fd1d03" exitCode=0 Jun 03 19:41:49.519148 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.519111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" event={"ID":"94b08de0-f09b-44df-b3de-7b9f6775df6a","Type":"ContainerDied","Data":"62ca2d1277d23542ea4d5b64df95c86662e515ae09b58f2c643cff41f6fd1d03"} Jun 03 19:41:49.521169 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.521142 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerID="8f177de3066654a65b46c90445d879efa005def8809e6dc7b3ca6edd1e967d45" exitCode=0 Jun 03 19:41:49.521265 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:49.521168 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" event={"ID":"d8bc20de-875f-4e88-af5d-3c390e5dfeb6","Type":"ContainerDied","Data":"8f177de3066654a65b46c90445d879efa005def8809e6dc7b3ca6edd1e967d45"} Jun 03 19:41:50.529172 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.529143 2573 generic.go:356] "Generic (PLEG): container finished" podID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerID="c44abb57fc9630a9ba30b958486ddc7d882eaa4d57974736d948d308ab3f89bf" exitCode=0 Jun 03 19:41:50.529640 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.529229 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" event={"ID":"8962b3c4-0262-4c4f-8904-8fbb2f7e250d","Type":"ContainerDied","Data":"c44abb57fc9630a9ba30b958486ddc7d882eaa4d57974736d948d308ab3f89bf"} Jun 03 19:41:50.531451 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.531430 2573 generic.go:356] "Generic (PLEG): container finished" podID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerID="3c4f5a178fed68461c319072817bec254c3f5dbff40aacb00ce7299a6375db55" exitCode=0 Jun 03 19:41:50.531568 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.531501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" event={"ID":"94b08de0-f09b-44df-b3de-7b9f6775df6a","Type":"ContainerDied","Data":"3c4f5a178fed68461c319072817bec254c3f5dbff40aacb00ce7299a6375db55"} Jun 03 19:41:50.533712 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.533693 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerID="382cccc0728d08337bf269397aab215c51b9a7db9bfb5947155626380a1b6072" exitCode=0 Jun 03 19:41:50.533819 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.533778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" event={"ID":"d8bc20de-875f-4e88-af5d-3c390e5dfeb6","Type":"ContainerDied","Data":"382cccc0728d08337bf269397aab215c51b9a7db9bfb5947155626380a1b6072"} Jun 03 19:41:50.662057 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.662032 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:50.801752 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.801728 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxthf\" (UniqueName: \"kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf\") pod \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " Jun 03 19:41:50.801907 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.801861 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util\") pod \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " Jun 03 19:41:50.801907 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.801882 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle\") pod \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\" (UID: \"5c917e40-35e0-4d9d-b8af-a26bdec374d3\") " Jun 03 19:41:50.802416 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.802374 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle" (OuterVolumeSpecName: "bundle") pod "5c917e40-35e0-4d9d-b8af-a26bdec374d3" (UID: "5c917e40-35e0-4d9d-b8af-a26bdec374d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:50.803657 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.803638 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf" (OuterVolumeSpecName: "kube-api-access-bxthf") pod "5c917e40-35e0-4d9d-b8af-a26bdec374d3" (UID: "5c917e40-35e0-4d9d-b8af-a26bdec374d3"). InnerVolumeSpecName "kube-api-access-bxthf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:50.807132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.807113 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util" (OuterVolumeSpecName: "util") pod "5c917e40-35e0-4d9d-b8af-a26bdec374d3" (UID: "5c917e40-35e0-4d9d-b8af-a26bdec374d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:50.903193 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.903162 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:50.903401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.903204 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c917e40-35e0-4d9d-b8af-a26bdec374d3-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:50.903401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:50.903230 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxthf\" (UniqueName: \"kubernetes.io/projected/5c917e40-35e0-4d9d-b8af-a26bdec374d3-kube-api-access-bxthf\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.541192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.541103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" event={"ID":"5c917e40-35e0-4d9d-b8af-a26bdec374d3","Type":"ContainerDied","Data":"8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb"} Jun 03 19:41:51.541192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.541152 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eb8e48e51cd82e7ce969e0e608c8eb094e28d037cb355ffe3ec25286fbb2ceb" Jun 03 19:41:51.541192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.541111 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7" Jun 03 19:41:51.543250 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.543213 2573 generic.go:356] "Generic (PLEG): container finished" podID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerID="d15b1e1e73f3b9f2677245dfeca1b6474d270f59f2df9a1f9aa74d2e5ab635a9" exitCode=0 Jun 03 19:41:51.543383 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.543294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" event={"ID":"8962b3c4-0262-4c4f-8904-8fbb2f7e250d","Type":"ContainerDied","Data":"d15b1e1e73f3b9f2677245dfeca1b6474d270f59f2df9a1f9aa74d2e5ab635a9"} Jun 03 19:41:51.674984 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.674961 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:51.715157 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.715135 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:51.808845 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.808774 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zm65\" (UniqueName: \"kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65\") pod \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " Jun 03 19:41:51.808845 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.808837 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle\") pod \"94b08de0-f09b-44df-b3de-7b9f6775df6a\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " Jun 03 19:41:51.809052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.808873 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle\") pod \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " Jun 03 19:41:51.809052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.808899 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4nkl\" (UniqueName: \"kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl\") pod \"94b08de0-f09b-44df-b3de-7b9f6775df6a\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " Jun 03 19:41:51.809052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.809009 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util\") pod \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\" (UID: \"d8bc20de-875f-4e88-af5d-3c390e5dfeb6\") " Jun 03 19:41:51.809218 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.809053 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util\") pod \"94b08de0-f09b-44df-b3de-7b9f6775df6a\" (UID: \"94b08de0-f09b-44df-b3de-7b9f6775df6a\") " Jun 03 19:41:51.809491 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.809459 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle" (OuterVolumeSpecName: "bundle") pod "d8bc20de-875f-4e88-af5d-3c390e5dfeb6" (UID: "d8bc20de-875f-4e88-af5d-3c390e5dfeb6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:51.809937 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.809909 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle" (OuterVolumeSpecName: "bundle") pod "94b08de0-f09b-44df-b3de-7b9f6775df6a" (UID: "94b08de0-f09b-44df-b3de-7b9f6775df6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:51.811013 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.810983 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65" (OuterVolumeSpecName: "kube-api-access-8zm65") pod "d8bc20de-875f-4e88-af5d-3c390e5dfeb6" (UID: "d8bc20de-875f-4e88-af5d-3c390e5dfeb6"). InnerVolumeSpecName "kube-api-access-8zm65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:51.811013 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.810990 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl" (OuterVolumeSpecName: "kube-api-access-h4nkl") pod "94b08de0-f09b-44df-b3de-7b9f6775df6a" (UID: "94b08de0-f09b-44df-b3de-7b9f6775df6a"). InnerVolumeSpecName "kube-api-access-h4nkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:51.814449 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.814428 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util" (OuterVolumeSpecName: "util") pod "d8bc20de-875f-4e88-af5d-3c390e5dfeb6" (UID: "d8bc20de-875f-4e88-af5d-3c390e5dfeb6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:51.815052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.815032 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util" (OuterVolumeSpecName: "util") pod "94b08de0-f09b-44df-b3de-7b9f6775df6a" (UID: "94b08de0-f09b-44df-b3de-7b9f6775df6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:51.910262 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910215 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.910381 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910356 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.910456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910393 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zm65\" (UniqueName: \"kubernetes.io/projected/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-kube-api-access-8zm65\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.910456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910413 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94b08de0-f09b-44df-b3de-7b9f6775df6a-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.910456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910426 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8bc20de-875f-4e88-af5d-3c390e5dfeb6-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:51.910456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:51.910438 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4nkl\" (UniqueName: \"kubernetes.io/projected/94b08de0-f09b-44df-b3de-7b9f6775df6a-kube-api-access-h4nkl\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:52.553119 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.553040 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" Jun 03 19:41:52.553543 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.553028 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q" event={"ID":"94b08de0-f09b-44df-b3de-7b9f6775df6a","Type":"ContainerDied","Data":"e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7"} Jun 03 19:41:52.553543 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.553155 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9aa08f6523620145280133bce12f35b48ded2ff88fa725c1e125f35268bf5e7" Jun 03 19:41:52.554885 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.554863 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" Jun 03 19:41:52.555007 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.554886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx" event={"ID":"d8bc20de-875f-4e88-af5d-3c390e5dfeb6","Type":"ContainerDied","Data":"f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f"} Jun 03 19:41:52.555007 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.554931 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f632865b9b4f66695c6557b767fd50d0bd52c9238f107d4b97ef15414c38717f" Jun 03 19:41:52.689390 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.689367 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:52.817419 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.817338 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle\") pod \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " Jun 03 19:41:52.817419 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.817406 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xg45\" (UniqueName: \"kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45\") pod \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " Jun 03 19:41:52.817604 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.817458 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util\") pod \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\" (UID: \"8962b3c4-0262-4c4f-8904-8fbb2f7e250d\") " Jun 03 19:41:52.818011 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.817985 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle" (OuterVolumeSpecName: "bundle") pod "8962b3c4-0262-4c4f-8904-8fbb2f7e250d" (UID: "8962b3c4-0262-4c4f-8904-8fbb2f7e250d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:52.819453 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.819432 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45" (OuterVolumeSpecName: "kube-api-access-7xg45") pod "8962b3c4-0262-4c4f-8904-8fbb2f7e250d" (UID: "8962b3c4-0262-4c4f-8904-8fbb2f7e250d"). InnerVolumeSpecName "kube-api-access-7xg45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:52.823258 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.823215 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util" (OuterVolumeSpecName: "util") pod "8962b3c4-0262-4c4f-8904-8fbb2f7e250d" (UID: "8962b3c4-0262-4c4f-8904-8fbb2f7e250d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:41:52.918852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.918820 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:52.918852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.918846 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xg45\" (UniqueName: \"kubernetes.io/projected/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-kube-api-access-7xg45\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:52.918852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:52.918857 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8962b3c4-0262-4c4f-8904-8fbb2f7e250d-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:41:53.562138 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:53.562114 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" Jun 03 19:41:53.562542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:53.562106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk" event={"ID":"8962b3c4-0262-4c4f-8904-8fbb2f7e250d","Type":"ContainerDied","Data":"fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937"} Jun 03 19:41:53.562542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:53.562234 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa8fa30fe07b6930695b46da1541e1b21e0a6275a21792ab177bf59b7ddb8937" Jun 03 19:41:59.445132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:41:59.445103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:02.671144 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671109 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw"] Jun 03 19:42:02.671676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671657 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="util" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671679 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="util" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671694 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="extract" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671702 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="extract" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671713 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="extract" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671722 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="extract" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671738 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="pull" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671746 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="pull" Jun 03 19:42:02.671754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671754 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671762 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671779 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671788 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671797 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671804 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671822 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671829 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671849 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671859 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671868 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671876 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="pull" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671887 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671898 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671909 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.671917 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="util" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.672005 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b08de0-f09b-44df-b3de-7b9f6775df6a" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.672019 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8962b3c4-0262-4c4f-8904-8fbb2f7e250d" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.672029 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bc20de-875f-4e88-af5d-3c390e5dfeb6" containerName="extract" Jun 03 19:42:02.672167 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.672039 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c917e40-35e0-4d9d-b8af-a26bdec374d3" containerName="extract" Jun 03 19:42:02.677221 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.677201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:02.680427 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.680404 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6g9x9\"" Jun 03 19:42:02.682340 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.682317 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw"] Jun 03 19:42:02.803153 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.803118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjt6w\" (UniqueName: \"kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w\") pod \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" (UID: \"6bdd353d-b392-4433-af43-ad3a263560ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:02.904650 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.904610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjt6w\" (UniqueName: \"kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w\") pod \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" (UID: \"6bdd353d-b392-4433-af43-ad3a263560ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:02.913388 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.913364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjt6w\" (UniqueName: \"kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w\") pod \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" (UID: \"6bdd353d-b392-4433-af43-ad3a263560ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:02.988450 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:02.988368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:03.128456 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:03.128425 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw"] Jun 03 19:42:03.129570 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:42:03.129544 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdd353d_b392_4433_af43_ad3a263560ae.slice/crio-68bc9cbfc44889c306f687b2845bd0f3b258ea05bdc56b251776d7342663c8e3 WatchSource:0}: Error finding container 68bc9cbfc44889c306f687b2845bd0f3b258ea05bdc56b251776d7342663c8e3: Status 404 returned error can't find the container with id 68bc9cbfc44889c306f687b2845bd0f3b258ea05bdc56b251776d7342663c8e3 Jun 03 19:42:03.618695 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:03.618663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" event={"ID":"6bdd353d-b392-4433-af43-ad3a263560ae","Type":"ContainerStarted","Data":"68bc9cbfc44889c306f687b2845bd0f3b258ea05bdc56b251776d7342663c8e3"} Jun 03 19:42:03.648638 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:03.648564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:05.631949 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:05.631916 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" event={"ID":"6bdd353d-b392-4433-af43-ad3a263560ae","Type":"ContainerStarted","Data":"ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32"} Jun 03 19:42:05.632409 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:05.631998 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:05.647609 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:05.647567 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" podStartSLOduration=1.948760456 podStartE2EDuration="3.64754973s" totalImagesPullingTime="1.698789274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:05.64582594 +0000 UTC m=+690.341681660" watchObservedRunningTime="2026-06-03 19:42:05.64754973 +0000 UTC m=+690.343405448" Jun 03 19:42:08.478587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.478547 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq"] Jun 03 19:42:08.482464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.482441 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.490387 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.489595 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjhn\"" Jun 03 19:42:08.495716 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.495680 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq"] Jun 03 19:42:08.552207 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.552170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvxf\" (UniqueName: \"kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.552335 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.552276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.652961 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.652936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.653064 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.653007 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvxf\" (UniqueName: \"kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.653329 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.653312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.662953 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.662935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvxf\" (UniqueName: \"kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.796979 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.796911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:08.955721 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:08.955691 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq"] Jun 03 19:42:08.958155 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:42:08.958125 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90027d3_44ff_4dbb_8554_aa4e33be0df8.slice/crio-4ded0930937f48dd57b375fa2762c62600ddabd169ccd50f17d0c9c0715a99e7 WatchSource:0}: Error finding container 4ded0930937f48dd57b375fa2762c62600ddabd169ccd50f17d0c9c0715a99e7: Status 404 returned error can't find the container with id 4ded0930937f48dd57b375fa2762c62600ddabd169ccd50f17d0c9c0715a99e7 Jun 03 19:42:09.238018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:09.237978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:09.654132 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:09.654104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" event={"ID":"a90027d3-44ff-4dbb-8554-aa4e33be0df8","Type":"ContainerStarted","Data":"4ded0930937f48dd57b375fa2762c62600ddabd169ccd50f17d0c9c0715a99e7"} Jun 03 19:42:09.927701 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:09.927618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:10.108752 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.108725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:10.698691 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.698659 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57458c6fc4-2c72m"] Jun 03 19:42:10.702723 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.702700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.713232 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.713206 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57458c6fc4-2c72m"] Jun 03 19:42:10.758474 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.758429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:10.770145 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770258 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-oauth-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770258 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcmmd\" (UniqueName: \"kubernetes.io/projected/78f17d34-0dc1-42eb-b01c-c99eec289e5a-kube-api-access-hcmmd\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770258 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-service-ca\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770430 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770430 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-oauth-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.770528 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.770457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-trusted-ca-bundle\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871002 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.870977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-trusted-ca-bundle\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-oauth-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcmmd\" (UniqueName: \"kubernetes.io/projected/78f17d34-0dc1-42eb-b01c-c99eec289e5a-kube-api-access-hcmmd\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-service-ca\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871168 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-oauth-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871852 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-oauth-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871961 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.871961 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-service-ca\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.872039 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.871984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f17d34-0dc1-42eb-b01c-c99eec289e5a-trusted-ca-bundle\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.873725 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.873693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-oauth-config\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.873813 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.873771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f17d34-0dc1-42eb-b01c-c99eec289e5a-console-serving-cert\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:10.881713 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:10.881692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcmmd\" (UniqueName: \"kubernetes.io/projected/78f17d34-0dc1-42eb-b01c-c99eec289e5a-kube-api-access-hcmmd\") pod \"console-57458c6fc4-2c72m\" (UID: \"78f17d34-0dc1-42eb-b01c-c99eec289e5a\") " pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:11.012750 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.012648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:11.161869 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.161839 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57458c6fc4-2c72m"] Jun 03 19:42:11.164967 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:42:11.164935 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f17d34_0dc1_42eb_b01c_c99eec289e5a.slice/crio-cbab7c568caa22d78432cf87129583e8d3fa121831388760142d25b31dbbeea3 WatchSource:0}: Error finding container cbab7c568caa22d78432cf87129583e8d3fa121831388760142d25b31dbbeea3: Status 404 returned error can't find the container with id cbab7c568caa22d78432cf87129583e8d3fa121831388760142d25b31dbbeea3 Jun 03 19:42:11.668173 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.668137 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57458c6fc4-2c72m" event={"ID":"78f17d34-0dc1-42eb-b01c-c99eec289e5a","Type":"ContainerStarted","Data":"10ca3d1fa81902035d67a718c5e558e0461a4ebe02daa81b925a35d00cb6c502"} Jun 03 19:42:11.668362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.668184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57458c6fc4-2c72m" event={"ID":"78f17d34-0dc1-42eb-b01c-c99eec289e5a","Type":"ContainerStarted","Data":"cbab7c568caa22d78432cf87129583e8d3fa121831388760142d25b31dbbeea3"} Jun 03 19:42:11.687646 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.687597 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57458c6fc4-2c72m" podStartSLOduration=1.6875840979999999 podStartE2EDuration="1.687584098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:11.684747981 +0000 UTC m=+696.380603701" watchObservedRunningTime="2026-06-03 19:42:11.687584098 +0000 UTC m=+696.383439816" Jun 03 19:42:11.880984 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:11.880951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:13.682221 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:13.682189 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" event={"ID":"a90027d3-44ff-4dbb-8554-aa4e33be0df8","Type":"ContainerStarted","Data":"008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a"} Jun 03 19:42:13.682536 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:13.682314 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:13.704362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:13.704316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" podStartSLOduration=1.066367887 podStartE2EDuration="5.704302659s" totalImagesPullingTime="4.637934772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:13.702647261 +0000 UTC m=+698.398502980" watchObservedRunningTime="2026-06-03 19:42:13.704302659 +0000 UTC m=+698.400158377" Jun 03 19:42:14.678927 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:14.678889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:15.102195 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:15.102163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:15.206891 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:15.206860 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:16.365070 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:16.365042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:16.639445 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:16.639356 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:16.661184 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:16.661157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:17.695122 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:17.695091 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:20.246555 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:20.246520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:20.347730 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:20.347655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:21.012856 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.012826 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:21.013030 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.012889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:21.017354 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.017333 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:21.731744 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.731713 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57458c6fc4-2c72m" Jun 03 19:42:21.779052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.779016 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:42:21.880537 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.880497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:21.980933 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:21.980906 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:24.662598 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:24.662564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:24.689616 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:24.689591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:24.780458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:24.780421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:26.342613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.342579 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq"] Jun 03 19:42:26.343006 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.342773 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" containerName="manager" containerID="cri-o://008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a" gracePeriod=2 Jun 03 19:42:26.351873 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.351852 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq"] Jun 03 19:42:26.367666 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.367640 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw"] Jun 03 19:42:26.367930 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.367882 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" containerName="manager" containerID="cri-o://ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32" gracePeriod=2 Jun 03 19:42:26.370579 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.370539 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.370921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.370893 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:26.371594 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.371569 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" containerName="manager" Jun 03 19:42:26.371683 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.371597 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" containerName="manager" Jun 03 19:42:26.371749 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.371736 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" containerName="manager" Jun 03 19:42:26.375776 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.375757 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.378581 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.378558 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw"] Jun 03 19:42:26.383710 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.383676 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6bdd353d-b392-4433-af43-ad3a263560ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-cdqtw\": pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.385719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.385652 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:26.385719 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.385700 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.395193 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.395172 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8"] Jun 03 19:42:26.395554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.395529 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" containerName="manager" Jun 03 19:42:26.395554 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.395545 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" containerName="manager" Jun 03 19:42:26.395692 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.395632 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" containerName="manager" Jun 03 19:42:26.398887 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.398871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:26.409558 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.409525 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.411006 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.410981 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8"] Jun 03 19:42:26.411982 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.411944 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.433513 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.433480 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.509817 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.509786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.509983 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.509832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtl5j\" (UniqueName: \"kubernetes.io/projected/0871187c-5904-4744-9122-0fd88f0261f0-kube-api-access-wtl5j\") pod \"limitador-operator-controller-manager-859d7b78bd-6m7f8\" (UID: \"0871187c-5904-4744-9122-0fd88f0261f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:26.509983 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.509907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzhb\" (UniqueName: \"kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.610563 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.610531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzhb\" (UniqueName: \"kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.610718 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.610654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.610718 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.610712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtl5j\" (UniqueName: \"kubernetes.io/projected/0871187c-5904-4744-9122-0fd88f0261f0-kube-api-access-wtl5j\") pod \"limitador-operator-controller-manager-859d7b78bd-6m7f8\" (UID: \"0871187c-5904-4744-9122-0fd88f0261f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:26.611074 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.611038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.611380 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.611363 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.613562 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.613539 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.614328 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.614313 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.615433 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.615409 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.617281 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.617258 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.618681 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.618665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtl5j\" (UniqueName: \"kubernetes.io/projected/0871187c-5904-4744-9122-0fd88f0261f0-kube-api-access-wtl5j\") pod \"limitador-operator-controller-manager-859d7b78bd-6m7f8\" (UID: \"0871187c-5904-4744-9122-0fd88f0261f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:26.618794 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.618773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzhb\" (UniqueName: \"kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bwpfs\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.619148 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.619131 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.711029 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.711006 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume\") pod \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " Jun 03 19:42:26.711156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.711067 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsvxf\" (UniqueName: \"kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf\") pod \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\" (UID: \"a90027d3-44ff-4dbb-8554-aa4e33be0df8\") " Jun 03 19:42:26.711156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.711115 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjt6w\" (UniqueName: \"kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w\") pod \"6bdd353d-b392-4433-af43-ad3a263560ae\" (UID: \"6bdd353d-b392-4433-af43-ad3a263560ae\") " Jun 03 19:42:26.711575 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.711552 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a90027d3-44ff-4dbb-8554-aa4e33be0df8" (UID: "a90027d3-44ff-4dbb-8554-aa4e33be0df8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:42:26.713099 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.713079 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w" (OuterVolumeSpecName: "kube-api-access-jjt6w") pod "6bdd353d-b392-4433-af43-ad3a263560ae" (UID: "6bdd353d-b392-4433-af43-ad3a263560ae"). InnerVolumeSpecName "kube-api-access-jjt6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:26.713160 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.713096 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf" (OuterVolumeSpecName: "kube-api-access-rsvxf") pod "a90027d3-44ff-4dbb-8554-aa4e33be0df8" (UID: "a90027d3-44ff-4dbb-8554-aa4e33be0df8"). InnerVolumeSpecName "kube-api-access-rsvxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:26.766588 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.766549 2573 generic.go:356] "Generic (PLEG): container finished" podID="6bdd353d-b392-4433-af43-ad3a263560ae" containerID="ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32" exitCode=0 Jun 03 19:42:26.766698 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.766595 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.767587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.766640 2573 scope.go:117] "RemoveContainer" containerID="ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32" Jun 03 19:42:26.768177 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.768149 2573 generic.go:356] "Generic (PLEG): container finished" podID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" containerID="008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a" exitCode=0 Jun 03 19:42:26.768307 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.768194 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.768923 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.768895 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.770804 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.770773 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.773611 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.773584 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.775814 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.775788 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.777769 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.777754 2573 scope.go:117] "RemoveContainer" containerID="ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32" Jun 03 19:42:26.778062 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.778038 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32\": container with ID starting with ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32 not found: ID does not exist" containerID="ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32" Jun 03 19:42:26.778187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.778069 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32"} err="failed to get container status \"ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32\": rpc error: code = NotFound desc = could not find container \"ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32\": container with ID starting with ddb05746f395ee32bbf2816f506624e75588cb1ce19b2bea68cad76b6f5a3f32 not found: ID does not exist" Jun 03 19:42:26.778187 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.778086 2573 scope.go:117] "RemoveContainer" containerID="008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a" Jun 03 19:42:26.781887 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.781858 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.783866 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.783843 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.785802 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.785775 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:26.786594 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.786573 2573 scope.go:117] "RemoveContainer" containerID="008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a" Jun 03 19:42:26.786831 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.786813 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a\": container with ID starting with 008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a not found: ID does not exist" containerID="008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a" Jun 03 19:42:26.786897 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.786837 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a"} err="failed to get container status \"008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a\": rpc error: code = NotFound desc = could not find container \"008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a\": container with ID starting with 008fd926c1a1c02c2d558b50a4c4f4e76a73ab721cca746cdaf887de7522d38a not found: ID does not exist" Jun 03 19:42:26.787533 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:26.787512 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:26.788637 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.788624 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:26.794057 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.794037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:26.812594 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.812566 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsvxf\" (UniqueName: \"kubernetes.io/projected/a90027d3-44ff-4dbb-8554-aa4e33be0df8-kube-api-access-rsvxf\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:26.812708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.812600 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjt6w\" (UniqueName: \"kubernetes.io/projected/6bdd353d-b392-4433-af43-ad3a263560ae-kube-api-access-jjt6w\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:26.812708 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.812616 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a90027d3-44ff-4dbb-8554-aa4e33be0df8-extensions-socket-volume\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:26.934480 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.934456 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:26.937328 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:42:26.937304 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3978e3_2e50_4428_bda2_6bbc19e443bb.slice/crio-dee617ba508dc0c5b9de41e9a9442a0e7afe80a9c32565d7a50452ebbdf770f5 WatchSource:0}: Error finding container dee617ba508dc0c5b9de41e9a9442a0e7afe80a9c32565d7a50452ebbdf770f5: Status 404 returned error can't find the container with id dee617ba508dc0c5b9de41e9a9442a0e7afe80a9c32565d7a50452ebbdf770f5 Jun 03 19:42:26.952878 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:26.952856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8"] Jun 03 19:42:26.955691 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:42:26.955670 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0871187c_5904_4744_9122_0fd88f0261f0.slice/crio-e7b150a9c13c0870b56a6d17b7414dae92a5eee767ac7ee0c0aba881fef71274 WatchSource:0}: Error finding container e7b150a9c13c0870b56a6d17b7414dae92a5eee767ac7ee0c0aba881fef71274: Status 404 returned error can't find the container with id e7b150a9c13c0870b56a6d17b7414dae92a5eee767ac7ee0c0aba881fef71274 Jun 03 19:42:27.777939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.777845 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" event={"ID":"0871187c-5904-4744-9122-0fd88f0261f0","Type":"ContainerStarted","Data":"3b1c0a8d24ca2a9bf8470c1bccfffd90cc52bc9096b298b552e2552ffb019179"} Jun 03 19:42:27.777939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.777902 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" event={"ID":"0871187c-5904-4744-9122-0fd88f0261f0","Type":"ContainerStarted","Data":"e7b150a9c13c0870b56a6d17b7414dae92a5eee767ac7ee0c0aba881fef71274"} Jun 03 19:42:27.778440 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.778044 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:27.779523 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.779502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" event={"ID":"9a3978e3-2e50-4428-bda2-6bbc19e443bb","Type":"ContainerStarted","Data":"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc"} Jun 03 19:42:27.779627 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.779542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" event={"ID":"9a3978e3-2e50-4428-bda2-6bbc19e443bb","Type":"ContainerStarted","Data":"dee617ba508dc0c5b9de41e9a9442a0e7afe80a9c32565d7a50452ebbdf770f5"} Jun 03 19:42:27.779668 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.779628 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:27.780114 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:27.780094 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8v2nq\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8v2nq" Jun 03 19:42:27.801000 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.800978 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" path="/var/lib/kubelet/pods/6bdd353d-b392-4433-af43-ad3a263560ae/volumes" Jun 03 19:42:27.801352 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.801339 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90027d3-44ff-4dbb-8554-aa4e33be0df8" path="/var/lib/kubelet/pods/a90027d3-44ff-4dbb-8554-aa4e33be0df8/volumes" Jun 03 19:42:27.804611 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:27.804588 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cdqtw\" is forbidden: User \"system:node:ip-10-0-133-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-145.ec2.internal' and this object" podUID="6bdd353d-b392-4433-af43-ad3a263560ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdqtw" Jun 03 19:42:27.805553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.805516 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" podStartSLOduration=1.805503563 podStartE2EDuration="1.805503563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:27.802265262 +0000 UTC m=+712.498120972" watchObservedRunningTime="2026-06-03 19:42:27.805503563 +0000 UTC m=+712.501359282" Jun 03 19:42:27.827679 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:27.827641 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" podStartSLOduration=1.827628773 podStartE2EDuration="1.827628773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:27.825657973 +0000 UTC m=+712.521513704" watchObservedRunningTime="2026-06-03 19:42:27.827628773 +0000 UTC m=+712.523484492" Jun 03 19:42:34.644054 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:34.644024 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:34.708053 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:34.708027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:35.042573 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:35.042496 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:35.096047 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:35.096010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:37.853011 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:37.852935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:37.952020 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:37.951981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:38.787274 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:38.787229 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m7f8" Jun 03 19:42:38.787453 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:38.787356 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:43.443637 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:43.443602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:43.545823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:43.545793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:44.476505 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.476473 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:44.476962 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.476712 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" podUID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" containerName="manager" containerID="cri-o://34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc" gracePeriod=10 Jun 03 19:42:44.720514 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.720492 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:44.872869 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.872839 2573 generic.go:356] "Generic (PLEG): container finished" podID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" containerID="34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc" exitCode=0 Jun 03 19:42:44.873033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.872880 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" Jun 03 19:42:44.873033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.872889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" event={"ID":"9a3978e3-2e50-4428-bda2-6bbc19e443bb","Type":"ContainerDied","Data":"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc"} Jun 03 19:42:44.873033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.872927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs" event={"ID":"9a3978e3-2e50-4428-bda2-6bbc19e443bb","Type":"ContainerDied","Data":"dee617ba508dc0c5b9de41e9a9442a0e7afe80a9c32565d7a50452ebbdf770f5"} Jun 03 19:42:44.873033 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.872949 2573 scope.go:117] "RemoveContainer" containerID="34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc" Jun 03 19:42:44.878498 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.878474 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume\") pod \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " Jun 03 19:42:44.878597 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.878538 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlzhb\" (UniqueName: \"kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb\") pod \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\" (UID: \"9a3978e3-2e50-4428-bda2-6bbc19e443bb\") " Jun 03 19:42:44.878802 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.878782 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a3978e3-2e50-4428-bda2-6bbc19e443bb" (UID: "9a3978e3-2e50-4428-bda2-6bbc19e443bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:42:44.880381 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.880355 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb" (OuterVolumeSpecName: "kube-api-access-jlzhb") pod "9a3978e3-2e50-4428-bda2-6bbc19e443bb" (UID: "9a3978e3-2e50-4428-bda2-6bbc19e443bb"). InnerVolumeSpecName "kube-api-access-jlzhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:44.882897 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.882882 2573 scope.go:117] "RemoveContainer" containerID="34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc" Jun 03 19:42:44.883165 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:44.883139 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc\": container with ID starting with 34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc not found: ID does not exist" containerID="34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc" Jun 03 19:42:44.883229 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.883178 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc"} err="failed to get container status \"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc\": rpc error: code = NotFound desc = could not find container \"34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc\": container with ID starting with 34e08bd0048189e2d3de08f2f98f9f33c0d8a47005ffbb628fffe108d862b8bc not found: ID does not exist" Jun 03 19:42:44.979833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.979803 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3978e3-2e50-4428-bda2-6bbc19e443bb-extensions-socket-volume\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:44.979833 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:44.979831 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlzhb\" (UniqueName: \"kubernetes.io/projected/9a3978e3-2e50-4428-bda2-6bbc19e443bb-kube-api-access-jlzhb\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:45.195992 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:45.195962 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:45.201823 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:45.201790 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bwpfs"] Jun 03 19:42:45.801397 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:45.801370 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" path="/var/lib/kubelet/pods/9a3978e3-2e50-4428-bda2-6bbc19e443bb/volumes" Jun 03 19:42:46.802364 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:46.802329 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66548b758-jwmzr" podUID="636df8d1-a501-4485-8092-df1db873243f" containerName="console" containerID="cri-o://f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac" gracePeriod=15 Jun 03 19:42:47.084697 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.084678 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:42:47.198753 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.198722 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.198940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.198763 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.198940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.198807 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl2z5\" (UniqueName: \"kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.198940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.198823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.199108 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.198941 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.199108 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199008 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.199108 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199039 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca\") pod \"636df8d1-a501-4485-8092-df1db873243f\" (UID: \"636df8d1-a501-4485-8092-df1db873243f\") " Jun 03 19:42:47.199464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199213 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:47.199464 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199260 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:47.199585 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199533 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-trusted-ca-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.199585 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199553 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-oauth-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.199679 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199581 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca" (OuterVolumeSpecName: "service-ca") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:47.199679 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.199652 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config" (OuterVolumeSpecName: "console-config") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:42:47.201114 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.201089 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5" (OuterVolumeSpecName: "kube-api-access-gl2z5") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "kube-api-access-gl2z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:47.201376 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.201341 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:42:47.201442 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.201389 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "636df8d1-a501-4485-8092-df1db873243f" (UID: "636df8d1-a501-4485-8092-df1db873243f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:42:47.300455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.300420 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-oauth-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.300455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.300448 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-service-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.300455 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.300458 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl2z5\" (UniqueName: \"kubernetes.io/projected/636df8d1-a501-4485-8092-df1db873243f-kube-api-access-gl2z5\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.300687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.300476 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/636df8d1-a501-4485-8092-df1db873243f-console-config\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.300687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.300484 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/636df8d1-a501-4485-8092-df1db873243f-console-serving-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:42:47.889960 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.889927 2573 generic.go:356] "Generic (PLEG): container finished" podID="636df8d1-a501-4485-8092-df1db873243f" containerID="f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac" exitCode=0 Jun 03 19:42:47.890421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.889982 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66548b758-jwmzr" Jun 03 19:42:47.890421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.890018 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66548b758-jwmzr" event={"ID":"636df8d1-a501-4485-8092-df1db873243f","Type":"ContainerDied","Data":"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac"} Jun 03 19:42:47.890421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.890082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66548b758-jwmzr" event={"ID":"636df8d1-a501-4485-8092-df1db873243f","Type":"ContainerDied","Data":"e71ea92f2d68c3a6d9c45ed263c68707f32aab40e98b986daf4658805d869f26"} Jun 03 19:42:47.890421 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.890114 2573 scope.go:117] "RemoveContainer" containerID="f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac" Jun 03 19:42:47.898985 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.898965 2573 scope.go:117] "RemoveContainer" containerID="f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac" Jun 03 19:42:47.899255 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:42:47.899225 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac\": container with ID starting with f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac not found: ID does not exist" containerID="f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac" Jun 03 19:42:47.899310 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.899264 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac"} err="failed to get container status \"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac\": rpc error: code = NotFound desc = could not find container \"f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac\": container with ID starting with f82d9bb271ec34ec72745437f7720a0639f4c8f5515a874657de70a1c1d398ac not found: ID does not exist" Jun 03 19:42:47.907034 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.907012 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:42:47.912157 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:47.912136 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66548b758-jwmzr"] Jun 03 19:42:48.046446 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:48.046412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:48.106710 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:48.106678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:49.801672 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:49.801644 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636df8d1-a501-4485-8092-df1db873243f" path="/var/lib/kubelet/pods/636df8d1-a501-4485-8092-df1db873243f/volumes" Jun 03 19:42:58.646463 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:58.646421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:58.746316 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:58.746287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:59.838365 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:59.838332 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:42:59.939644 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:42:59.939612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:00.713475 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713441 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk"] Jun 03 19:43:00.713830 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713817 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" containerName="manager" Jun 03 19:43:00.713830 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713830 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" containerName="manager" Jun 03 19:43:00.713922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713852 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636df8d1-a501-4485-8092-df1db873243f" containerName="console" Jun 03 19:43:00.713922 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713857 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="636df8d1-a501-4485-8092-df1db873243f" containerName="console" Jun 03 19:43:00.713994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713931 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="636df8d1-a501-4485-8092-df1db873243f" containerName="console" Jun 03 19:43:00.713994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.713947 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3978e3-2e50-4428-bda2-6bbc19e443bb" containerName="manager" Jun 03 19:43:00.718383 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.718356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.721432 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.721410 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2x8g2\"" Jun 03 19:43:00.733334 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.732769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk"] Jun 03 19:43:00.761777 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.761750 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:00.820358 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820472 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820643 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820643 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820643 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.820643 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.820556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9c5\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-kube-api-access-nb9c5\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.861519 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.861494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:00.921348 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921438 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921438 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921438 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9c5\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-kube-api-access-nb9c5\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921649 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.921911 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.922019 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.921998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.922072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.922040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.922118 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.922103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.922159 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.922110 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.924118 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.924103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.924304 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.924285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.929025 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.929006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:00.929384 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:00.929365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9c5\" (UniqueName: \"kubernetes.io/projected/7b59a5f1-49dd-4bc7-9a16-f5a5749545ad-kube-api-access-nb9c5\") pod \"maas-default-gateway-openshift-default-8559cd5744-kwvqk\" (UID: \"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:01.031684 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.031619 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:01.164295 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.164270 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk"] Jun 03 19:43:01.165481 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:01.165457 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b59a5f1_49dd_4bc7_9a16_f5a5749545ad.slice/crio-b89d949e6c5068dbb4f9848ec3d75e4aae6823f5ae0fd4cb19a953d31081363f WatchSource:0}: Error finding container b89d949e6c5068dbb4f9848ec3d75e4aae6823f5ae0fd4cb19a953d31081363f: Status 404 returned error can't find the container with id b89d949e6c5068dbb4f9848ec3d75e4aae6823f5ae0fd4cb19a953d31081363f Jun 03 19:43:01.167589 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.167546 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:43:01.167670 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.167623 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:43:01.167670 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.167652 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:43:01.968110 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.968079 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" event={"ID":"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad","Type":"ContainerStarted","Data":"3679bfa04c6609e06cf5d36a2492bd427fb6ec189718b7ff61bf8ebcbd2ae279"} Jun 03 19:43:01.968590 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.968128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" event={"ID":"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad","Type":"ContainerStarted","Data":"b89d949e6c5068dbb4f9848ec3d75e4aae6823f5ae0fd4cb19a953d31081363f"} Jun 03 19:43:01.990798 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:01.990755 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podStartSLOduration=1.9907400119999998 podStartE2EDuration="1.990740012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:01.988577063 +0000 UTC m=+746.684432781" watchObservedRunningTime="2026-06-03 19:43:01.990740012 +0000 UTC m=+746.686595730" Jun 03 19:43:02.032193 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.032163 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:02.036677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.036656 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:02.449677 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.449648 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:02.547259 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.547186 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:02.973548 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.973523 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:02.974476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:02.974453 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:43:04.531790 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.531762 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:04.917107 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.917068 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:04.920540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.920524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:04.922925 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.922899 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:43:04.923057 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.922954 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgwg5\"" Jun 03 19:43:04.927879 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.927850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:04.929789 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.929764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:04.960413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.960381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7557\" (UniqueName: \"kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:04.960413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:04.960418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.010806 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.010745 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:05.011903 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.011875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:05.060740 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.060699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:05.060974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.060954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7557\" (UniqueName: \"kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.061035 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.060990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.061683 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.061660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.067968 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.067947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7557\" (UniqueName: \"kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557\") pod \"limitador-limitador-64c94fd64f-p2g55\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.233384 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.233294 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:05.364589 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.364566 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:05.365621 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:05.365600 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03dc18c6_c3e8_41cb_a6ec_445bca9029ee.slice/crio-47d9a17ef3045c20128adfee12ce7d685695d50428c7449edbd9a1e01eb6d909 WatchSource:0}: Error finding container 47d9a17ef3045c20128adfee12ce7d685695d50428c7449edbd9a1e01eb6d909: Status 404 returned error can't find the container with id 47d9a17ef3045c20128adfee12ce7d685695d50428c7449edbd9a1e01eb6d909 Jun 03 19:43:05.694346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.694315 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:05.699118 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.699095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:05.701575 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.701558 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mrjgz\"" Jun 03 19:43:05.706657 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.706637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:05.723795 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.723776 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:05.767847 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.767826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9dfr\" (UniqueName: \"kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr\") pod \"authorino-58cd955675-hjpkq\" (UID: \"b6217496-338d-49cf-b778-e38a156bd6ff\") " pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:05.780415 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.780392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:05.869136 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.869114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9dfr\" (UniqueName: \"kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr\") pod \"authorino-58cd955675-hjpkq\" (UID: \"b6217496-338d-49cf-b778-e38a156bd6ff\") " pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:05.877256 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.877216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9dfr\" (UniqueName: \"kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr\") pod \"authorino-58cd955675-hjpkq\" (UID: \"b6217496-338d-49cf-b778-e38a156bd6ff\") " pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:05.993156 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:05.993081 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" event={"ID":"03dc18c6-c3e8-41cb-a6ec-445bca9029ee","Type":"ContainerStarted","Data":"47d9a17ef3045c20128adfee12ce7d685695d50428c7449edbd9a1e01eb6d909"} Jun 03 19:43:06.010334 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:06.010307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:06.176761 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:06.176715 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:06.179708 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:06.179669 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6217496_338d_49cf_b778_e38a156bd6ff.slice/crio-56d71bc80e7e2486d996d8946fb4fa2ee042627f2f272c5a677db38de811689c WatchSource:0}: Error finding container 56d71bc80e7e2486d996d8946fb4fa2ee042627f2f272c5a677db38de811689c: Status 404 returned error can't find the container with id 56d71bc80e7e2486d996d8946fb4fa2ee042627f2f272c5a677db38de811689c Jun 03 19:43:07.006834 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:07.006793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hjpkq" event={"ID":"b6217496-338d-49cf-b778-e38a156bd6ff","Type":"ContainerStarted","Data":"56d71bc80e7e2486d996d8946fb4fa2ee042627f2f272c5a677db38de811689c"} Jun 03 19:43:11.032926 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.032891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" event={"ID":"03dc18c6-c3e8-41cb-a6ec-445bca9029ee","Type":"ContainerStarted","Data":"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc"} Jun 03 19:43:11.033341 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.033055 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:11.034427 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.034402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hjpkq" event={"ID":"b6217496-338d-49cf-b778-e38a156bd6ff","Type":"ContainerStarted","Data":"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d"} Jun 03 19:43:11.048533 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.048487 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" podStartSLOduration=2.462460083 podStartE2EDuration="7.048474766s" totalImagesPullingTime="4.586014683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.047620749 +0000 UTC m=+755.743476469" watchObservedRunningTime="2026-06-03 19:43:11.048474766 +0000 UTC m=+755.744330512" Jun 03 19:43:11.063587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.063547 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hjpkq" podStartSLOduration=2.285359289 podStartE2EDuration="6.063535247s" totalImagesPullingTime="3.778175958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.061150973 +0000 UTC m=+755.757006692" watchObservedRunningTime="2026-06-03 19:43:11.063535247 +0000 UTC m=+755.759390965" Jun 03 19:43:11.699967 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:11.699934 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:13.044926 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:13.044889 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hjpkq" podUID="b6217496-338d-49cf-b778-e38a156bd6ff" containerName="authorino" containerID="cri-o://052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d" gracePeriod=30 Jun 03 19:43:13.289441 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:13.289413 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:13.342424 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:13.342398 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9dfr\" (UniqueName: \"kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr\") pod \"b6217496-338d-49cf-b778-e38a156bd6ff\" (UID: \"b6217496-338d-49cf-b778-e38a156bd6ff\") " Jun 03 19:43:13.344371 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:13.344340 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr" (OuterVolumeSpecName: "kube-api-access-l9dfr") pod "b6217496-338d-49cf-b778-e38a156bd6ff" (UID: "b6217496-338d-49cf-b778-e38a156bd6ff"). InnerVolumeSpecName "kube-api-access-l9dfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:43:13.443139 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:13.443119 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9dfr\" (UniqueName: \"kubernetes.io/projected/b6217496-338d-49cf-b778-e38a156bd6ff-kube-api-access-l9dfr\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:14.052038 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.051999 2573 generic.go:356] "Generic (PLEG): container finished" podID="b6217496-338d-49cf-b778-e38a156bd6ff" containerID="052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d" exitCode=0 Jun 03 19:43:14.052038 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.052040 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hjpkq" event={"ID":"b6217496-338d-49cf-b778-e38a156bd6ff","Type":"ContainerDied","Data":"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d"} Jun 03 19:43:14.052576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.052050 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hjpkq" Jun 03 19:43:14.052576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.052076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hjpkq" event={"ID":"b6217496-338d-49cf-b778-e38a156bd6ff","Type":"ContainerDied","Data":"56d71bc80e7e2486d996d8946fb4fa2ee042627f2f272c5a677db38de811689c"} Jun 03 19:43:14.052576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.052097 2573 scope.go:117] "RemoveContainer" containerID="052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d" Jun 03 19:43:14.061079 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.061062 2573 scope.go:117] "RemoveContainer" containerID="052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d" Jun 03 19:43:14.061338 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:43:14.061319 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d\": container with ID starting with 052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d not found: ID does not exist" containerID="052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d" Jun 03 19:43:14.061384 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.061345 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d"} err="failed to get container status \"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d\": rpc error: code = NotFound desc = could not find container \"052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d\": container with ID starting with 052594a50a5cc3023fec4e10a991d2bb0778ecb469dfb407a54ed19b087b728d not found: ID does not exist" Jun 03 19:43:14.067887 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.067866 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:14.071401 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:14.071383 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hjpkq"] Jun 03 19:43:15.800942 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:15.800903 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6217496-338d-49cf-b778-e38a156bd6ff" path="/var/lib/kubelet/pods/b6217496-338d-49cf-b778-e38a156bd6ff/volumes" Jun 03 19:43:22.041018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:22.040993 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:22.694362 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:22.694324 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:22.694577 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:22.694536 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" podUID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" containerName="limitador" containerID="cri-o://eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc" gracePeriod=30 Jun 03 19:43:23.233558 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.233533 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:23.329100 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.329030 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7557\" (UniqueName: \"kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557\") pod \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " Jun 03 19:43:23.329100 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.329083 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file\") pod \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\" (UID: \"03dc18c6-c3e8-41cb-a6ec-445bca9029ee\") " Jun 03 19:43:23.329462 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.329440 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file" (OuterVolumeSpecName: "config-file") pod "03dc18c6-c3e8-41cb-a6ec-445bca9029ee" (UID: "03dc18c6-c3e8-41cb-a6ec-445bca9029ee"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:43:23.330976 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.330956 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557" (OuterVolumeSpecName: "kube-api-access-d7557") pod "03dc18c6-c3e8-41cb-a6ec-445bca9029ee" (UID: "03dc18c6-c3e8-41cb-a6ec-445bca9029ee"). InnerVolumeSpecName "kube-api-access-d7557". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:43:23.430205 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.430161 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-config-file\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:23.430205 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:23.430201 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7557\" (UniqueName: \"kubernetes.io/projected/03dc18c6-c3e8-41cb-a6ec-445bca9029ee-kube-api-access-d7557\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:24.107460 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.107427 2573 generic.go:356] "Generic (PLEG): container finished" podID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" containerID="eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc" exitCode=0 Jun 03 19:43:24.107619 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.107465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" event={"ID":"03dc18c6-c3e8-41cb-a6ec-445bca9029ee","Type":"ContainerDied","Data":"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc"} Jun 03 19:43:24.107619 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.107483 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" Jun 03 19:43:24.107619 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.107535 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p2g55" event={"ID":"03dc18c6-c3e8-41cb-a6ec-445bca9029ee","Type":"ContainerDied","Data":"47d9a17ef3045c20128adfee12ce7d685695d50428c7449edbd9a1e01eb6d909"} Jun 03 19:43:24.107619 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.107555 2573 scope.go:117] "RemoveContainer" containerID="eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc" Jun 03 19:43:24.116700 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.116673 2573 scope.go:117] "RemoveContainer" containerID="eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc" Jun 03 19:43:24.116952 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:43:24.116933 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc\": container with ID starting with eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc not found: ID does not exist" containerID="eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc" Jun 03 19:43:24.117001 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.116958 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc"} err="failed to get container status \"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc\": rpc error: code = NotFound desc = could not find container \"eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc\": container with ID starting with eff78628250968fc3f7683ddb59404ceba41c3e74c8d519823aae3136e4cf9bc not found: ID does not exist" Jun 03 19:43:24.124582 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.124559 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:24.128118 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:24.128094 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p2g55"] Jun 03 19:43:25.801587 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:25.801556 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" path="/var/lib/kubelet/pods/03dc18c6-c3e8-41cb-a6ec-445bca9029ee/volumes" Jun 03 19:43:26.053598 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.053521 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wvpn2"] Jun 03 19:43:26.053980 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.053962 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6217496-338d-49cf-b778-e38a156bd6ff" containerName="authorino" Jun 03 19:43:26.054068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.053983 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6217496-338d-49cf-b778-e38a156bd6ff" containerName="authorino" Jun 03 19:43:26.054068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.054002 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" containerName="limitador" Jun 03 19:43:26.054068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.054011 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" containerName="limitador" Jun 03 19:43:26.054224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.054141 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="03dc18c6-c3e8-41cb-a6ec-445bca9029ee" containerName="limitador" Jun 03 19:43:26.054224 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.054152 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6217496-338d-49cf-b778-e38a156bd6ff" containerName="authorino" Jun 03 19:43:26.060723 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.060333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.062940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.062922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 19:43:26.063791 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.063770 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wvpn2"] Jun 03 19:43:26.083009 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.082986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:26.153939 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.153906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-data\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.154078 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.153946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5gm\" (UniqueName: \"kubernetes.io/projected/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-kube-api-access-5p5gm\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.254365 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.254328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-data\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.254365 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.254360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5gm\" (UniqueName: \"kubernetes.io/projected/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-kube-api-access-5p5gm\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.254733 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.254712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-data\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.262906 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.262878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5gm\" (UniqueName: \"kubernetes.io/projected/ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9-kube-api-access-5p5gm\") pod \"postgres-69fb4594cf-wvpn2\" (UID: \"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9\") " pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.384211 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.384188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:26.516388 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:26.516344 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wvpn2"] Jun 03 19:43:26.516388 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:26.516373 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4d7ffb_2b9b_4295_8efd_94cd88c6daa9.slice/crio-17b87cb0f4c52e21e92141c408ab9d2ce8900890a74fc28d3beaf57862aa7800 WatchSource:0}: Error finding container 17b87cb0f4c52e21e92141c408ab9d2ce8900890a74fc28d3beaf57862aa7800: Status 404 returned error can't find the container with id 17b87cb0f4c52e21e92141c408ab9d2ce8900890a74fc28d3beaf57862aa7800 Jun 03 19:43:27.126432 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:27.126398 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wvpn2" event={"ID":"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9","Type":"ContainerStarted","Data":"17b87cb0f4c52e21e92141c408ab9d2ce8900890a74fc28d3beaf57862aa7800"} Jun 03 19:43:31.152575 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:31.152543 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wvpn2" event={"ID":"ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9","Type":"ContainerStarted","Data":"716975b098aa3ebbfb81c41cd4be2d74bf27ac1ccab7c04afa0170ed4314ee8b"} Jun 03 19:43:31.152940 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:31.152675 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:31.168487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:31.168445 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wvpn2" podStartSLOduration=0.996095446 podStartE2EDuration="5.168431456s" totalImagesPullingTime="4.17233601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:31.166884644 +0000 UTC m=+775.862740364" watchObservedRunningTime="2026-06-03 19:43:31.168431456 +0000 UTC m=+775.864287175" Jun 03 19:43:37.187537 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:37.187504 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wvpn2" Jun 03 19:43:37.492023 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:37.491943 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:37.587375 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:37.587344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:37.714608 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:37.714569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:43:38.537018 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.536978 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx"] Jun 03 19:43:38.541921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.541900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.544728 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.544703 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:43:38.544834 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.544771 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7x256\"" Jun 03 19:43:38.545977 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.545955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:43:38.550052 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.550023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx"] Jun 03 19:43:38.561704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.561678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26bjs\" (UniqueName: \"kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.561806 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.561712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.561806 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.561739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.662377 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.662348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26bjs\" (UniqueName: \"kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.662496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.662387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.662496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.662408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.662806 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.662788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.662806 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.662797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.671893 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.671876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26bjs\" (UniqueName: \"kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.853337 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.853312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:38.987652 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:38.987621 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx"] Jun 03 19:43:38.988545 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:38.988521 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda907eaf5_d944_4d23_a74d_42f19e987803.slice/crio-6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb WatchSource:0}: Error finding container 6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb: Status 404 returned error can't find the container with id 6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb Jun 03 19:43:39.203618 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:39.203536 2573 generic.go:356] "Generic (PLEG): container finished" podID="a907eaf5-d944-4d23-a74d-42f19e987803" containerID="eda8c3d7ccaa1f677b575bd82dcadce7611b2d7135bb88f5101943d85f95db82" exitCode=0 Jun 03 19:43:39.203747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:39.203624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" event={"ID":"a907eaf5-d944-4d23-a74d-42f19e987803","Type":"ContainerDied","Data":"eda8c3d7ccaa1f677b575bd82dcadce7611b2d7135bb88f5101943d85f95db82"} Jun 03 19:43:39.203747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:39.203697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" event={"ID":"a907eaf5-d944-4d23-a74d-42f19e987803","Type":"ContainerStarted","Data":"6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb"} Jun 03 19:43:40.211066 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:40.210983 2573 generic.go:356] "Generic (PLEG): container finished" podID="a907eaf5-d944-4d23-a74d-42f19e987803" containerID="a0d980f0e609800618ceb587e1e42a57dfd2598abeca0dc62a644ce81cc10ee7" exitCode=0 Jun 03 19:43:40.211431 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:40.211066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" event={"ID":"a907eaf5-d944-4d23-a74d-42f19e987803","Type":"ContainerDied","Data":"a0d980f0e609800618ceb587e1e42a57dfd2598abeca0dc62a644ce81cc10ee7"} Jun 03 19:43:41.219051 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:41.219016 2573 generic.go:356] "Generic (PLEG): container finished" podID="a907eaf5-d944-4d23-a74d-42f19e987803" containerID="360a389417f25d781eca7466fd33742501c5f783309f7a94170623fa0398b7a6" exitCode=0 Jun 03 19:43:41.219443 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:41.219101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" event={"ID":"a907eaf5-d944-4d23-a74d-42f19e987803","Type":"ContainerDied","Data":"360a389417f25d781eca7466fd33742501c5f783309f7a94170623fa0398b7a6"} Jun 03 19:43:42.358129 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.358103 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:42.394068 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.394040 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util\") pod \"a907eaf5-d944-4d23-a74d-42f19e987803\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " Jun 03 19:43:42.394203 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.394184 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle\") pod \"a907eaf5-d944-4d23-a74d-42f19e987803\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " Jun 03 19:43:42.394282 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.394219 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26bjs\" (UniqueName: \"kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs\") pod \"a907eaf5-d944-4d23-a74d-42f19e987803\" (UID: \"a907eaf5-d944-4d23-a74d-42f19e987803\") " Jun 03 19:43:42.394786 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.394751 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle" (OuterVolumeSpecName: "bundle") pod "a907eaf5-d944-4d23-a74d-42f19e987803" (UID: "a907eaf5-d944-4d23-a74d-42f19e987803"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:43:42.396196 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.396175 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs" (OuterVolumeSpecName: "kube-api-access-26bjs") pod "a907eaf5-d944-4d23-a74d-42f19e987803" (UID: "a907eaf5-d944-4d23-a74d-42f19e987803"). InnerVolumeSpecName "kube-api-access-26bjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:43:42.399719 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.399684 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util" (OuterVolumeSpecName: "util") pod "a907eaf5-d944-4d23-a74d-42f19e987803" (UID: "a907eaf5-d944-4d23-a74d-42f19e987803"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:43:42.495687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.495623 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-util\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:42.495687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.495644 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a907eaf5-d944-4d23-a74d-42f19e987803-bundle\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:42.495687 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:42.495653 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26bjs\" (UniqueName: \"kubernetes.io/projected/a907eaf5-d944-4d23-a74d-42f19e987803-kube-api-access-26bjs\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:43:43.231346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:43.231318 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" Jun 03 19:43:43.231346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:43.231340 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dsljx" event={"ID":"a907eaf5-d944-4d23-a74d-42f19e987803","Type":"ContainerDied","Data":"6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb"} Jun 03 19:43:43.231551 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:43.231382 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fff0a05e120e1aa9a335653e05de83ab0962136d5f512e26732f3968577d3fb" Jun 03 19:43:46.053448 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053411 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-dvnzj"] Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053790 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="util" Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053799 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="util" Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053807 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="pull" Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053813 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="pull" Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053820 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="extract" Jun 03 19:43:46.053827 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053825 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="extract" Jun 03 19:43:46.054016 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.053890 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a907eaf5-d944-4d23-a74d-42f19e987803" containerName="extract" Jun 03 19:43:46.056970 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.056955 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" Jun 03 19:43:46.059986 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.059965 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:43:46.059986 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.059975 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:43:46.060915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.060900 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-jfltd\"" Jun 03 19:43:46.070041 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.070016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-dvnzj"] Jun 03 19:43:46.131903 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.131876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjk2\" (UniqueName: \"kubernetes.io/projected/725dc69c-b04d-400d-81f2-4d5715e63902-kube-api-access-fzjk2\") pod \"keycloak-operator-dd84cbf46-dvnzj\" (UID: \"725dc69c-b04d-400d-81f2-4d5715e63902\") " pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" Jun 03 19:43:46.232526 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.232484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjk2\" (UniqueName: \"kubernetes.io/projected/725dc69c-b04d-400d-81f2-4d5715e63902-kube-api-access-fzjk2\") pod \"keycloak-operator-dd84cbf46-dvnzj\" (UID: \"725dc69c-b04d-400d-81f2-4d5715e63902\") " pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" Jun 03 19:43:46.244226 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.244201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjk2\" (UniqueName: \"kubernetes.io/projected/725dc69c-b04d-400d-81f2-4d5715e63902-kube-api-access-fzjk2\") pod \"keycloak-operator-dd84cbf46-dvnzj\" (UID: \"725dc69c-b04d-400d-81f2-4d5715e63902\") " pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" Jun 03 19:43:46.366836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.366807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" Jun 03 19:43:46.497970 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:46.497943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-dvnzj"] Jun 03 19:43:46.498794 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:43:46.498766 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725dc69c_b04d_400d_81f2_4d5715e63902.slice/crio-8c6b72e2a63775d07b4ff20676b53a6f7d619027d9d0371151bbcf637372bf26 WatchSource:0}: Error finding container 8c6b72e2a63775d07b4ff20676b53a6f7d619027d9d0371151bbcf637372bf26: Status 404 returned error can't find the container with id 8c6b72e2a63775d07b4ff20676b53a6f7d619027d9d0371151bbcf637372bf26 Jun 03 19:43:47.259029 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:47.258960 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" event={"ID":"725dc69c-b04d-400d-81f2-4d5715e63902","Type":"ContainerStarted","Data":"8c6b72e2a63775d07b4ff20676b53a6f7d619027d9d0371151bbcf637372bf26"} Jun 03 19:43:53.299546 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:53.299512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" event={"ID":"725dc69c-b04d-400d-81f2-4d5715e63902","Type":"ContainerStarted","Data":"78a50314244fbe1cf108be75fdc8dce33badcd045c375b2f73badc5eb3b2a5e8"} Jun 03 19:43:53.314769 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:43:53.314724 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-dvnzj" podStartSLOduration=1.325819965 podStartE2EDuration="7.314709961s" totalImagesPullingTime="5.988889996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:53.314002441 +0000 UTC m=+798.009858160" watchObservedRunningTime="2026-06-03 19:43:53.314709961 +0000 UTC m=+798.010565681" Jun 03 19:44:00.973147 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:00.973111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:01.022699 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:01.022671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:32.419704 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.419663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:32.635744 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.635710 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:32.640064 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.640048 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:32.642915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.642895 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mrjgz\"" Jun 03 19:44:32.644968 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.644944 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:32.740722 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.740663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktr7n\" (UniqueName: \"kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n\") pod \"authorino-5d4b67c446-4cxdf\" (UID: \"c724251a-35cc-4364-9ea5-18523cca99ee\") " pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:32.785195 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.785166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:32.841843 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.841822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktr7n\" (UniqueName: \"kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n\") pod \"authorino-5d4b67c446-4cxdf\" (UID: \"c724251a-35cc-4364-9ea5-18523cca99ee\") " pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:32.848968 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.848939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktr7n\" (UniqueName: \"kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n\") pod \"authorino-5d4b67c446-4cxdf\" (UID: \"c724251a-35cc-4364-9ea5-18523cca99ee\") " pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:32.858695 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.858675 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:32.858893 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.858882 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:32.880651 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.880627 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fbdc6fd7-cw2md"] Jun 03 19:44:32.884350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.884331 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:32.890891 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.890870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fbdc6fd7-cw2md"] Jun 03 19:44:32.942244 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.942205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4nt\" (UniqueName: \"kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt\") pod \"authorino-56fbdc6fd7-cw2md\" (UID: \"e65abe5c-cd16-4e88-998f-88d2bd4df8dd\") " pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:32.982936 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.982907 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fbdc6fd7-cw2md"] Jun 03 19:44:32.983288 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:44:32.983221 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7x4nt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" podUID="e65abe5c-cd16-4e88-998f-88d2bd4df8dd" Jun 03 19:44:32.994564 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:32.994538 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:32.995763 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:44:32.995741 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc724251a_35cc_4364_9ea5_18523cca99ee.slice/crio-d92337397640e05970f7df05df6b8cddd0b2b9ff15a483d4cf535bd9383ae421 WatchSource:0}: Error finding container d92337397640e05970f7df05df6b8cddd0b2b9ff15a483d4cf535bd9383ae421: Status 404 returned error can't find the container with id d92337397640e05970f7df05df6b8cddd0b2b9ff15a483d4cf535bd9383ae421 Jun 03 19:44:33.008629 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.008601 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:44:33.011930 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.011906 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.014149 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.014132 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 19:44:33.021080 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.021061 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:44:33.042797 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.042776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.042932 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.042819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4nt\" (UniqueName: \"kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt\") pod \"authorino-56fbdc6fd7-cw2md\" (UID: \"e65abe5c-cd16-4e88-998f-88d2bd4df8dd\") " pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:33.042932 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.042876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndwrl\" (UniqueName: \"kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.050346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.050327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4nt\" (UniqueName: \"kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt\") pod \"authorino-56fbdc6fd7-cw2md\" (UID: \"e65abe5c-cd16-4e88-998f-88d2bd4df8dd\") " pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:33.143426 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.143393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.143582 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.143461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndwrl\" (UniqueName: \"kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.145703 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.145676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.150855 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.150828 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndwrl\" (UniqueName: \"kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl\") pod \"authorino-67ffc84595-lghwh\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.322099 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.322034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:44:33.455917 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.455892 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:44:33.456651 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:44:33.456626 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62cfd43d_ff88_4ca6_8dcc_420a90500918.slice/crio-0d19e4a1a79c3dcbb2684cfa1b9f8e57fb1047efaef145e80ce5e76120b9da2e WatchSource:0}: Error finding container 0d19e4a1a79c3dcbb2684cfa1b9f8e57fb1047efaef145e80ce5e76120b9da2e: Status 404 returned error can't find the container with id 0d19e4a1a79c3dcbb2684cfa1b9f8e57fb1047efaef145e80ce5e76120b9da2e Jun 03 19:44:33.544796 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.544759 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ffc84595-lghwh" event={"ID":"62cfd43d-ff88-4ca6-8dcc-420a90500918","Type":"ContainerStarted","Data":"0d19e4a1a79c3dcbb2684cfa1b9f8e57fb1047efaef145e80ce5e76120b9da2e"} Jun 03 19:44:33.546433 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.546402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" event={"ID":"c724251a-35cc-4364-9ea5-18523cca99ee","Type":"ContainerStarted","Data":"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00"} Jun 03 19:44:33.546576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.546446 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" event={"ID":"c724251a-35cc-4364-9ea5-18523cca99ee","Type":"ContainerStarted","Data":"d92337397640e05970f7df05df6b8cddd0b2b9ff15a483d4cf535bd9383ae421"} Jun 03 19:44:33.546576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.546414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:33.546576 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.546479 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" podUID="c724251a-35cc-4364-9ea5-18523cca99ee" containerName="authorino" containerID="cri-o://45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00" gracePeriod=30 Jun 03 19:44:33.554255 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.554226 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:33.561043 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.561000 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" podStartSLOduration=1.184312868 podStartE2EDuration="1.560988343s" totalImagesPullingTime="376.675475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:33.559010497 +0000 UTC m=+838.254866217" watchObservedRunningTime="2026-06-03 19:44:33.560988343 +0000 UTC m=+838.256844061" Jun 03 19:44:33.647151 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.647126 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x4nt\" (UniqueName: \"kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt\") pod \"e65abe5c-cd16-4e88-998f-88d2bd4df8dd\" (UID: \"e65abe5c-cd16-4e88-998f-88d2bd4df8dd\") " Jun 03 19:44:33.649098 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.649076 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt" (OuterVolumeSpecName: "kube-api-access-7x4nt") pod "e65abe5c-cd16-4e88-998f-88d2bd4df8dd" (UID: "e65abe5c-cd16-4e88-998f-88d2bd4df8dd"). InnerVolumeSpecName "kube-api-access-7x4nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:44:33.748483 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.748442 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x4nt\" (UniqueName: \"kubernetes.io/projected/e65abe5c-cd16-4e88-998f-88d2bd4df8dd-kube-api-access-7x4nt\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:44:33.784802 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.784779 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:33.949779 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.949751 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktr7n\" (UniqueName: \"kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n\") pod \"c724251a-35cc-4364-9ea5-18523cca99ee\" (UID: \"c724251a-35cc-4364-9ea5-18523cca99ee\") " Jun 03 19:44:33.951813 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:33.951786 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n" (OuterVolumeSpecName: "kube-api-access-ktr7n") pod "c724251a-35cc-4364-9ea5-18523cca99ee" (UID: "c724251a-35cc-4364-9ea5-18523cca99ee"). InnerVolumeSpecName "kube-api-access-ktr7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:44:34.050564 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.050529 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktr7n\" (UniqueName: \"kubernetes.io/projected/c724251a-35cc-4364-9ea5-18523cca99ee-kube-api-access-ktr7n\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:44:34.553171 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.553132 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ffc84595-lghwh" event={"ID":"62cfd43d-ff88-4ca6-8dcc-420a90500918","Type":"ContainerStarted","Data":"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1"} Jun 03 19:44:34.554408 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554383 2573 generic.go:356] "Generic (PLEG): container finished" podID="c724251a-35cc-4364-9ea5-18523cca99ee" containerID="45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00" exitCode=0 Jun 03 19:44:34.554518 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554414 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" Jun 03 19:44:34.554518 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" event={"ID":"c724251a-35cc-4364-9ea5-18523cca99ee","Type":"ContainerDied","Data":"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00"} Jun 03 19:44:34.554518 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554491 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4cxdf" event={"ID":"c724251a-35cc-4364-9ea5-18523cca99ee","Type":"ContainerDied","Data":"d92337397640e05970f7df05df6b8cddd0b2b9ff15a483d4cf535bd9383ae421"} Jun 03 19:44:34.554518 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554513 2573 scope.go:117] "RemoveContainer" containerID="45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00" Jun 03 19:44:34.554685 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.554609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fbdc6fd7-cw2md" Jun 03 19:44:34.563614 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.563598 2573 scope.go:117] "RemoveContainer" containerID="45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00" Jun 03 19:44:34.563884 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:44:34.563866 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00\": container with ID starting with 45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00 not found: ID does not exist" containerID="45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00" Jun 03 19:44:34.563936 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.563891 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00"} err="failed to get container status \"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00\": rpc error: code = NotFound desc = could not find container \"45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00\": container with ID starting with 45935fa11958dd51dc0325944bb59430c8d20c2ab0222b209a7329a9b1bfbd00 not found: ID does not exist" Jun 03 19:44:34.568574 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.568536 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67ffc84595-lghwh" podStartSLOduration=2.188354804 podStartE2EDuration="2.568524019s" totalImagesPullingTime="380.169215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:34.566880236 +0000 UTC m=+839.262735956" watchObservedRunningTime="2026-06-03 19:44:34.568524019 +0000 UTC m=+839.264379738" Jun 03 19:44:34.584624 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.584599 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:34.588436 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.588413 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4cxdf"] Jun 03 19:44:34.614487 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.614465 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fbdc6fd7-cw2md"] Jun 03 19:44:34.620676 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:34.620650 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fbdc6fd7-cw2md"] Jun 03 19:44:35.801642 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:35.801615 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c724251a-35cc-4364-9ea5-18523cca99ee" path="/var/lib/kubelet/pods/c724251a-35cc-4364-9ea5-18523cca99ee/volumes" Jun 03 19:44:35.801998 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:35.801905 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65abe5c-cd16-4e88-998f-88d2bd4df8dd" path="/var/lib/kubelet/pods/e65abe5c-cd16-4e88-998f-88d2bd4df8dd/volumes" Jun 03 19:44:40.553346 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:40.553309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:44:40.653389 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:44:40.653336 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:10.719959 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:10.719921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:11.064855 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:11.064774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:11.163596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:11.163563 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:18.613914 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:18.613880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:18.714245 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:18.714214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:18.850634 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:18.850066 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kwvqk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:48164->10.132.0.52:15021: read: connection reset by peer" start-of-body= Jun 03 19:45:18.850634 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:18.850128 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podUID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:48164->10.132.0.52:15021: read: connection reset by peer" Jun 03 19:45:19.822458 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.822423 2573 generic.go:356] "Generic (PLEG): container finished" podID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerID="3679bfa04c6609e06cf5d36a2492bd427fb6ec189718b7ff61bf8ebcbd2ae279" exitCode=0 Jun 03 19:45:19.822934 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.822496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" event={"ID":"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad","Type":"ContainerDied","Data":"3679bfa04c6609e06cf5d36a2492bd427fb6ec189718b7ff61bf8ebcbd2ae279"} Jun 03 19:45:19.822934 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.822915 2573 scope.go:117] "RemoveContainer" containerID="3679bfa04c6609e06cf5d36a2492bd427fb6ec189718b7ff61bf8ebcbd2ae279" Jun 03 19:45:19.823874 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.823846 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:45:19.823967 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.823911 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:45:19.823967 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:19.823943 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 19:45:20.832379 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:20.832343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" event={"ID":"7b59a5f1-49dd-4bc7-9a16-f5a5749545ad","Type":"ContainerStarted","Data":"5d45d2eb1c2fe9577ebf2d64fe1a9b579f9bce9718e49d1a5d9ed6db64e65871"} Jun 03 19:45:21.032849 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:21.032815 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:45:21.033153 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:21.033043 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kwvqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jun 03 19:45:21.033329 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:21.033307 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podUID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jun 03 19:45:22.032280 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:22.032216 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kwvqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jun 03 19:45:22.032754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:22.032303 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podUID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jun 03 19:45:23.032523 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:23.032037 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kwvqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jun 03 19:45:23.032523 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:23.032110 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podUID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jun 03 19:45:24.032975 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:24.032931 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-kwvqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jun 03 19:45:24.033475 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:24.033000 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" podUID="7b59a5f1-49dd-4bc7-9a16-f5a5749545ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jun 03 19:45:25.035620 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:25.035591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:45:25.036070 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:25.036051 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:45:25.036781 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:25.036763 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-kwvqk" Jun 03 19:45:35.822072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:35.822045 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:45:35.830105 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:35.830079 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:45:54.476635 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:54.476602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:45:55.532757 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:45:55.532721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:00.423837 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.423795 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:46:00.424454 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.424434 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c724251a-35cc-4364-9ea5-18523cca99ee" containerName="authorino" Jun 03 19:46:00.424542 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.424456 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c724251a-35cc-4364-9ea5-18523cca99ee" containerName="authorino" Jun 03 19:46:00.424596 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.424559 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c724251a-35cc-4364-9ea5-18523cca99ee" containerName="authorino" Jun 03 19:46:00.427684 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.427663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.430403 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.430385 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 19:46:00.436549 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.436526 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:46:00.532787 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.532760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5h2d\" (UniqueName: \"kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.532889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.532793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.532889 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.532812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.633730 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.633701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5h2d\" (UniqueName: \"kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.633849 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.633737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.633849 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.633766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.634350 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.634331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.636067 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.636052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.641389 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.641372 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5h2d\" (UniqueName: \"kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d\") pod \"authorino-57c7b6f6ff-m2lcc\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.737770 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.737718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:46:00.867648 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.867620 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:46:00.868635 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:46:00.868611 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1381bdb4_f329_414a_a284_77d260092085.slice/crio-ccd3d24d16e9520fdddcb98cee6908e52cc59695306038f957182d3f6a7f2fd8 WatchSource:0}: Error finding container ccd3d24d16e9520fdddcb98cee6908e52cc59695306038f957182d3f6a7f2fd8: Status 404 returned error can't find the container with id ccd3d24d16e9520fdddcb98cee6908e52cc59695306038f957182d3f6a7f2fd8 Jun 03 19:46:00.869950 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:00.869934 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:46:01.071817 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:01.071737 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" event={"ID":"1381bdb4-f329-414a-a284-77d260092085","Type":"ContainerStarted","Data":"ccd3d24d16e9520fdddcb98cee6908e52cc59695306038f957182d3f6a7f2fd8"} Jun 03 19:46:02.080974 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.080935 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" event={"ID":"1381bdb4-f329-414a-a284-77d260092085","Type":"ContainerStarted","Data":"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8"} Jun 03 19:46:02.100470 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.100412 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" podStartSLOduration=1.6484021420000001 podStartE2EDuration="2.100396071s" totalImagesPullingTime="451.993929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:02.097889026 +0000 UTC m=+926.793744746" watchObservedRunningTime="2026-06-03 19:46:02.100396071 +0000 UTC m=+926.796251790" Jun 03 19:46:02.127988 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.127957 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:46:02.128158 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.128122 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67ffc84595-lghwh" podUID="62cfd43d-ff88-4ca6-8dcc-420a90500918" containerName="authorino" containerID="cri-o://eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1" gracePeriod=30 Jun 03 19:46:02.399749 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.399721 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:46:02.453486 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.453457 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert\") pod \"62cfd43d-ff88-4ca6-8dcc-420a90500918\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " Jun 03 19:46:02.453623 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.453557 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndwrl\" (UniqueName: \"kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl\") pod \"62cfd43d-ff88-4ca6-8dcc-420a90500918\" (UID: \"62cfd43d-ff88-4ca6-8dcc-420a90500918\") " Jun 03 19:46:02.455613 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.455584 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl" (OuterVolumeSpecName: "kube-api-access-ndwrl") pod "62cfd43d-ff88-4ca6-8dcc-420a90500918" (UID: "62cfd43d-ff88-4ca6-8dcc-420a90500918"). InnerVolumeSpecName "kube-api-access-ndwrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:46:02.463717 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.463694 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "62cfd43d-ff88-4ca6-8dcc-420a90500918" (UID: "62cfd43d-ff88-4ca6-8dcc-420a90500918"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:46:02.532314 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.532279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:02.554768 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.554735 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndwrl\" (UniqueName: \"kubernetes.io/projected/62cfd43d-ff88-4ca6-8dcc-420a90500918-kube-api-access-ndwrl\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:46:02.554768 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.554759 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/62cfd43d-ff88-4ca6-8dcc-420a90500918-tls-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:46:02.632754 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:02.632681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:03.087747 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.087713 2573 generic.go:356] "Generic (PLEG): container finished" podID="62cfd43d-ff88-4ca6-8dcc-420a90500918" containerID="eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1" exitCode=0 Jun 03 19:46:03.088192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.087763 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ffc84595-lghwh" Jun 03 19:46:03.088192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.087792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ffc84595-lghwh" event={"ID":"62cfd43d-ff88-4ca6-8dcc-420a90500918","Type":"ContainerDied","Data":"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1"} Jun 03 19:46:03.088192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.087832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ffc84595-lghwh" event={"ID":"62cfd43d-ff88-4ca6-8dcc-420a90500918","Type":"ContainerDied","Data":"0d19e4a1a79c3dcbb2684cfa1b9f8e57fb1047efaef145e80ce5e76120b9da2e"} Jun 03 19:46:03.088192 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.087848 2573 scope.go:117] "RemoveContainer" containerID="eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1" Jun 03 19:46:03.099527 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.099504 2573 scope.go:117] "RemoveContainer" containerID="eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1" Jun 03 19:46:03.099958 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:46:03.099936 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1\": container with ID starting with eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1 not found: ID does not exist" containerID="eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1" Jun 03 19:46:03.100051 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.099967 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1"} err="failed to get container status \"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1\": rpc error: code = NotFound desc = could not find container \"eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1\": container with ID starting with eb5916e19a26222ebb1894d6d8e62e3a4e3f1e79809d53b75f90ff7b6a2f16d1 not found: ID does not exist" Jun 03 19:46:03.109191 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.109166 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:46:03.112910 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.112886 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67ffc84595-lghwh"] Jun 03 19:46:03.802321 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:03.802289 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62cfd43d-ff88-4ca6-8dcc-420a90500918" path="/var/lib/kubelet/pods/62cfd43d-ff88-4ca6-8dcc-420a90500918/volumes" Jun 03 19:46:21.859447 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:21.859409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:40.317451 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:40.317422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:45.388695 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:45.388664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:45.439741 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:45.439713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:47.990112 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:47.990075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:52.443322 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:52.443232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:46:59.831371 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:46:59.831339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:09.536937 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:47:09.536907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:10.380072 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:47:10.380038 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:13.184904 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:47:13.184866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:47:22.325466 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:47:22.325432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:33.548447 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.548408 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-656fb56f4b-lk92n"] Jun 03 19:48:33.548875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.548819 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62cfd43d-ff88-4ca6-8dcc-420a90500918" containerName="authorino" Jun 03 19:48:33.548875 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.548829 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62cfd43d-ff88-4ca6-8dcc-420a90500918" containerName="authorino" Jun 03 19:48:33.548948 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.548899 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="62cfd43d-ff88-4ca6-8dcc-420a90500918" containerName="authorino" Jun 03 19:48:33.551848 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.551833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.558844 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.558819 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656fb56f4b-lk92n"] Jun 03 19:48:33.576972 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.576938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be7f8f8c-86da-40b2-9a57-064a11058e6b-oidc-ca\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.577133 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.576979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be7f8f8c-86da-40b2-9a57-064a11058e6b-tls-cert\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.577133 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.577066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvk7\" (UniqueName: \"kubernetes.io/projected/be7f8f8c-86da-40b2-9a57-064a11058e6b-kube-api-access-6pvk7\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.678200 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.678157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be7f8f8c-86da-40b2-9a57-064a11058e6b-oidc-ca\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.678200 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.678203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be7f8f8c-86da-40b2-9a57-064a11058e6b-tls-cert\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.678476 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.678271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvk7\" (UniqueName: \"kubernetes.io/projected/be7f8f8c-86da-40b2-9a57-064a11058e6b-kube-api-access-6pvk7\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.679059 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.679030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be7f8f8c-86da-40b2-9a57-064a11058e6b-oidc-ca\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.681041 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.681017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be7f8f8c-86da-40b2-9a57-064a11058e6b-tls-cert\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.685684 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.685661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvk7\" (UniqueName: \"kubernetes.io/projected/be7f8f8c-86da-40b2-9a57-064a11058e6b-kube-api-access-6pvk7\") pod \"authorino-656fb56f4b-lk92n\" (UID: \"be7f8f8c-86da-40b2-9a57-064a11058e6b\") " pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:33.862413 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:33.862383 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656fb56f4b-lk92n" Jun 03 19:48:34.008347 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.008317 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656fb56f4b-lk92n"] Jun 03 19:48:34.009992 ip-10-0-133-145 kubenswrapper[2573]: W0603 19:48:34.009967 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe7f8f8c_86da_40b2_9a57_064a11058e6b.slice/crio-dd48d6c46544f25f4e1742c1481f21beb63997eac10e7c14cfd3d181a3a1d1ad WatchSource:0}: Error finding container dd48d6c46544f25f4e1742c1481f21beb63997eac10e7c14cfd3d181a3a1d1ad: Status 404 returned error can't find the container with id dd48d6c46544f25f4e1742c1481f21beb63997eac10e7c14cfd3d181a3a1d1ad Jun 03 19:48:34.038835 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.038804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:34.133540 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.133455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:34.957483 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.957440 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656fb56f4b-lk92n" event={"ID":"be7f8f8c-86da-40b2-9a57-064a11058e6b","Type":"ContainerStarted","Data":"a16c7fa5d42f0ed2c475198b7fe73a56350e327e45707cebd40b3a2c9a704c64"} Jun 03 19:48:34.958028 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.957996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656fb56f4b-lk92n" event={"ID":"be7f8f8c-86da-40b2-9a57-064a11058e6b","Type":"ContainerStarted","Data":"dd48d6c46544f25f4e1742c1481f21beb63997eac10e7c14cfd3d181a3a1d1ad"} Jun 03 19:48:34.973026 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:34.972972 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-656fb56f4b-lk92n" podStartSLOduration=1.538107028 podStartE2EDuration="1.972957607s" totalImagesPullingTime="434.850579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:34.971140126 +0000 UTC m=+1079.666995847" watchObservedRunningTime="2026-06-03 19:48:34.972957607 +0000 UTC m=+1079.668813326" Jun 03 19:48:35.001648 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.001597 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:48:35.002926 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.002891 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" podUID="1381bdb4-f329-414a-a284-77d260092085" containerName="authorino" containerID="cri-o://7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8" gracePeriod=30 Jun 03 19:48:35.095358 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.095323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:35.194765 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.194733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:48:35.268994 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.268972 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:48:35.292181 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.292147 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca\") pod \"1381bdb4-f329-414a-a284-77d260092085\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " Jun 03 19:48:35.292325 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.292228 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5h2d\" (UniqueName: \"kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d\") pod \"1381bdb4-f329-414a-a284-77d260092085\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " Jun 03 19:48:35.292325 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.292314 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert\") pod \"1381bdb4-f329-414a-a284-77d260092085\" (UID: \"1381bdb4-f329-414a-a284-77d260092085\") " Jun 03 19:48:35.294759 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.294724 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d" (OuterVolumeSpecName: "kube-api-access-h5h2d") pod "1381bdb4-f329-414a-a284-77d260092085" (UID: "1381bdb4-f329-414a-a284-77d260092085"). InnerVolumeSpecName "kube-api-access-h5h2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:48:35.297953 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.297926 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "1381bdb4-f329-414a-a284-77d260092085" (UID: "1381bdb4-f329-414a-a284-77d260092085"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:48:35.302735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.302704 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1381bdb4-f329-414a-a284-77d260092085" (UID: "1381bdb4-f329-414a-a284-77d260092085"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:48:35.393040 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.393013 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1381bdb4-f329-414a-a284-77d260092085-oidc-ca\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:48:35.393040 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.393038 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5h2d\" (UniqueName: \"kubernetes.io/projected/1381bdb4-f329-414a-a284-77d260092085-kube-api-access-h5h2d\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:48:35.393184 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.393046 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1381bdb4-f329-414a-a284-77d260092085-tls-cert\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 19:48:35.964420 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.964347 2573 generic.go:356] "Generic (PLEG): container finished" podID="1381bdb4-f329-414a-a284-77d260092085" containerID="7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8" exitCode=0 Jun 03 19:48:35.964420 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.964399 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" Jun 03 19:48:35.964836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.964429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" event={"ID":"1381bdb4-f329-414a-a284-77d260092085","Type":"ContainerDied","Data":"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8"} Jun 03 19:48:35.964836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.964475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c7b6f6ff-m2lcc" event={"ID":"1381bdb4-f329-414a-a284-77d260092085","Type":"ContainerDied","Data":"ccd3d24d16e9520fdddcb98cee6908e52cc59695306038f957182d3f6a7f2fd8"} Jun 03 19:48:35.964836 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.964492 2573 scope.go:117] "RemoveContainer" containerID="7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8" Jun 03 19:48:35.973550 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.973538 2573 scope.go:117] "RemoveContainer" containerID="7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8" Jun 03 19:48:35.973780 ip-10-0-133-145 kubenswrapper[2573]: E0603 19:48:35.973760 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8\": container with ID starting with 7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8 not found: ID does not exist" containerID="7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8" Jun 03 19:48:35.973847 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.973791 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8"} err="failed to get container status \"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8\": rpc error: code = NotFound desc = could not find container \"7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8\": container with ID starting with 7a2f2532ec01c39d1c5a6f31437cf9377fde17801d1e4b43df291c8964bcbed8 not found: ID does not exist" Jun 03 19:48:35.981496 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.981475 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:48:35.986915 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:35.986894 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57c7b6f6ff-m2lcc"] Jun 03 19:48:37.801125 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:48:37.801094 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1381bdb4-f329-414a-a284-77d260092085" path="/var/lib/kubelet/pods/1381bdb4-f329-414a-a284-77d260092085/volumes" Jun 03 19:50:35.870387 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:35.870357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:50:35.878553 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:35.878534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:50:40.916749 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:40.916704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:50:41.000572 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:41.000540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:50:49.248686 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:49.248652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:50:54.935511 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:54.935478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:50:55.036231 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:50:55.036187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:27.014069 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:27.014038 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:28.146954 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:28.146914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:50.851980 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:50.851931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.438067 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.438032 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.497213 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.497184 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.574735 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.574701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.674083 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.674052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.791127 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.791042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:51:56.891966 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:51:56.891936 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:13.316087 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:13.316052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:13.416373 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:13.416338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:13.517981 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:13.517947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:19.227929 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:19.227895 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:19.325656 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:19.325620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:27.379449 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:27.379414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:27.471976 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:27.471944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:27.571898 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:27.571864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:27.671786 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:27.671691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:44.066665 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:44.066625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:44.168634 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:44.168603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:44.269136 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:44.269106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:50.157691 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:50.157650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:52:50.267767 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:52:50.267732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:53:28.992500 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:53:28.992459 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:54:10.543844 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:54:10.543809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:54:10.594921 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:54:10.594885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 19:55:35.918829 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:55:35.918726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 19:55:35.927508 ip-10-0-133-145 kubenswrapper[2573]: I0603 19:55:35.927486 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:00:00.146045 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.146007 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-9z4qz"] Jun 03 20:00:00.146552 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.146494 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1381bdb4-f329-414a-a284-77d260092085" containerName="authorino" Jun 03 20:00:00.146552 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.146508 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1381bdb4-f329-414a-a284-77d260092085" containerName="authorino" Jun 03 20:00:00.146627 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.146582 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1381bdb4-f329-414a-a284-77d260092085" containerName="authorino" Jun 03 20:00:00.149562 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.149546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:00.152400 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.152381 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-49pd5\"" Jun 03 20:00:00.162363 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.162337 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-9z4qz"] Jun 03 20:00:00.238383 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.238348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrnv\" (UniqueName: \"kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv\") pod \"maas-api-key-cleanup-29675280-9z4qz\" (UID: \"273c9149-4a45-46c1-85fe-e58a29bbef13\") " pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:00.339144 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.339103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrnv\" (UniqueName: \"kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv\") pod \"maas-api-key-cleanup-29675280-9z4qz\" (UID: \"273c9149-4a45-46c1-85fe-e58a29bbef13\") " pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:00.347255 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.347213 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrnv\" (UniqueName: \"kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv\") pod \"maas-api-key-cleanup-29675280-9z4qz\" (UID: \"273c9149-4a45-46c1-85fe-e58a29bbef13\") " pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:00.460107 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.460028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:00.592160 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.592132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-9z4qz"] Jun 03 20:00:00.593763 ip-10-0-133-145 kubenswrapper[2573]: W0603 20:00:00.593726 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273c9149_4a45_46c1_85fe_e58a29bbef13.slice/crio-377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e WatchSource:0}: Error finding container 377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e: Status 404 returned error can't find the container with id 377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e Jun 03 20:00:00.595573 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.595557 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:00:00.915426 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:00.915392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" event={"ID":"273c9149-4a45-46c1-85fe-e58a29bbef13","Type":"ContainerStarted","Data":"377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e"} Jun 03 20:00:06.953301 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:06.953268 2573 generic.go:356] "Generic (PLEG): container finished" podID="273c9149-4a45-46c1-85fe-e58a29bbef13" containerID="e511e7a0f0d2d7369fc649d0bede9f544b1c0f6974431221a6fbcd745c6ae32b" exitCode=0 Jun 03 20:00:06.953634 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:06.953325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" event={"ID":"273c9149-4a45-46c1-85fe-e58a29bbef13","Type":"ContainerDied","Data":"e511e7a0f0d2d7369fc649d0bede9f544b1c0f6974431221a6fbcd745c6ae32b"} Jun 03 20:00:08.095424 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.095402 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:08.213108 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.213020 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkrnv\" (UniqueName: \"kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv\") pod \"273c9149-4a45-46c1-85fe-e58a29bbef13\" (UID: \"273c9149-4a45-46c1-85fe-e58a29bbef13\") " Jun 03 20:00:08.215135 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.215107 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv" (OuterVolumeSpecName: "kube-api-access-nkrnv") pod "273c9149-4a45-46c1-85fe-e58a29bbef13" (UID: "273c9149-4a45-46c1-85fe-e58a29bbef13"). InnerVolumeSpecName "kube-api-access-nkrnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:00:08.314670 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.314644 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkrnv\" (UniqueName: \"kubernetes.io/projected/273c9149-4a45-46c1-85fe-e58a29bbef13-kube-api-access-nkrnv\") on node \"ip-10-0-133-145.ec2.internal\" DevicePath \"\"" Jun 03 20:00:08.966352 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.966325 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" Jun 03 20:00:08.966503 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.966327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-9z4qz" event={"ID":"273c9149-4a45-46c1-85fe-e58a29bbef13","Type":"ContainerDied","Data":"377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e"} Jun 03 20:00:08.966503 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:08.966439 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="377ca741e60ddee1ded1d6bbe204c68e22d9a7ebc08a37cb2ea797712b292b0e" Jun 03 20:00:35.959897 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:35.959799 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:00:35.969725 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:00:35.969706 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:01:05.793292 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:05.793229 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:06.887549 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:06.887505 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:01:24.295603 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.295572 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b"] Jun 03 20:01:24.296024 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.295976 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273c9149-4a45-46c1-85fe-e58a29bbef13" containerName="cleanup" Jun 03 20:01:24.296024 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.295986 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="273c9149-4a45-46c1-85fe-e58a29bbef13" containerName="cleanup" Jun 03 20:01:24.296113 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.296068 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="273c9149-4a45-46c1-85fe-e58a29bbef13" containerName="cleanup" Jun 03 20:01:24.297970 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.297954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.300402 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.300381 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjhn\"" Jun 03 20:01:24.311706 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.311684 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b"] Jun 03 20:01:24.378014 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.377983 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbk47\" (UniqueName: \"kubernetes.io/projected/7a412108-f150-488d-924f-5278061ccf73-kube-api-access-wbk47\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.378189 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.378044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a412108-f150-488d-924f-5278061ccf73-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.479580 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.479550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbk47\" (UniqueName: \"kubernetes.io/projected/7a412108-f150-488d-924f-5278061ccf73-kube-api-access-wbk47\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.479731 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.479605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a412108-f150-488d-924f-5278061ccf73-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.479970 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.479954 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a412108-f150-488d-924f-5278061ccf73-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.487297 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.487273 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbk47\" (UniqueName: \"kubernetes.io/projected/7a412108-f150-488d-924f-5278061ccf73-kube-api-access-wbk47\") pod \"kuadrant-operator-controller-manager-86878c769f-mwr2b\" (UID: \"7a412108-f150-488d-924f-5278061ccf73\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.608206 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.608177 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:24.745462 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:24.745437 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b"] Jun 03 20:01:24.747202 ip-10-0-133-145 kubenswrapper[2573]: W0603 20:01:24.747168 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a412108_f150_488d_924f_5278061ccf73.slice/crio-6060eed3c74a117b5cc224923f0b71d9be0b322dec40578dc7a07adf19138087 WatchSource:0}: Error finding container 6060eed3c74a117b5cc224923f0b71d9be0b322dec40578dc7a07adf19138087: Status 404 returned error can't find the container with id 6060eed3c74a117b5cc224923f0b71d9be0b322dec40578dc7a07adf19138087 Jun 03 20:01:25.413835 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:25.413803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" event={"ID":"7a412108-f150-488d-924f-5278061ccf73","Type":"ContainerStarted","Data":"2a4e58b8d1b2288044fbd4d1073fb9f244bad3b7a9282cac668b59519de690bc"} Jun 03 20:01:25.414268 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:25.413861 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" event={"ID":"7a412108-f150-488d-924f-5278061ccf73","Type":"ContainerStarted","Data":"6060eed3c74a117b5cc224923f0b71d9be0b322dec40578dc7a07adf19138087"} Jun 03 20:01:25.414268 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:25.413884 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:01:25.433849 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:25.433803 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" podStartSLOduration=1.433786158 podStartE2EDuration="1.433786158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:01:25.432641085 +0000 UTC m=+1850.128496803" watchObservedRunningTime="2026-06-03 20:01:25.433786158 +0000 UTC m=+1850.129641877" Jun 03 20:01:36.423331 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:01:36.423302 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mwr2b" Jun 03 20:05:36.000736 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:05:36.000633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:05:36.010921 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:05:36.010902 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:10:31.328423 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:10:31.328388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:10:36.050055 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:10:36.049948 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:10:36.055171 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:10:36.055146 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:10:40.825026 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:10:40.824975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:10:43.102356 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:10:43.102322 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:11:05.084208 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:05.084089 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:11:18.102834 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:18.102798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:11:25.355120 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:25.355087 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656fb56f4b-lk92n_be7f8f8c-86da-40b2-9a57-064a11058e6b/authorino/0.log" Jun 03 20:11:29.739047 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:29.739017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbff5bcdc-cznmg_f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1/nginx/0.log" Jun 03 20:11:30.173575 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:30.173551 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675280-9z4qz_273c9149-4a45-46c1-85fe-e58a29bbef13/cleanup/0.log" Jun 03 20:11:30.876684 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:30.876658 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-dgd6s_234d27d0-175b-41bc-8308-9c04a0fda579/copy-manifests/0.log" Jun 03 20:11:30.882912 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:30.882883 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-dgd6s_234d27d0-175b-41bc-8308-9c04a0fda579/manager/0.log" Jun 03 20:11:30.988213 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:30.988181 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wvpn2_ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9/postgres/0.log" Jun 03 20:11:31.725997 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.725971 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/util/0.log" Jun 03 20:11:31.731870 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.731836 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/pull/0.log" Jun 03 20:11:31.737295 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.737275 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/extract/0.log" Jun 03 20:11:31.843777 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.843756 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/util/0.log" Jun 03 20:11:31.849250 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.849211 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/pull/0.log" Jun 03 20:11:31.854433 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.854416 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/extract/0.log" Jun 03 20:11:31.959149 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.959121 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/util/0.log" Jun 03 20:11:31.964836 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.964819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/pull/0.log" Jun 03 20:11:31.970592 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:31.970577 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/extract/0.log" Jun 03 20:11:32.076638 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.076564 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/util/0.log" Jun 03 20:11:32.082137 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.082114 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/pull/0.log" Jun 03 20:11:32.087666 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.087650 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/extract/0.log" Jun 03 20:11:32.202006 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.201981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656fb56f4b-lk92n_be7f8f8c-86da-40b2-9a57-064a11058e6b/authorino/0.log" Jun 03 20:11:32.642573 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.642543 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gk8nl_1bd2800c-a61f-4a46-ac21-0227b9011032/registry-server/0.log" Jun 03 20:11:32.761488 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.761462 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mwr2b_7a412108-f150-488d-924f-5278061ccf73/manager/0.log" Jun 03 20:11:32.991108 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:32.991026 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6m7f8_0871187c-5904-4744-9122-0fd88f0261f0/manager/0.log" Jun 03 20:11:33.322450 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:33.322377 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcct8hj_21a8203d-062f-4e13-9c41-5bb1518ee88b/istio-proxy/0.log" Jun 03 20:11:33.757253 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:33.757210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/1.log" Jun 03 20:11:33.979972 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:33.979945 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c99bfd76f-46v5r_623f04e8-7671-43f5-8390-773d6ce68100/router/0.log" Jun 03 20:11:39.054793 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:39.054751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:11:39.154048 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:39.154002 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" limit=1024 Jun 03 20:11:41.946141 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:41.946112 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6p4tr_df90e458-d4ec-408a-84af-e78b50a9de78/global-pull-secret-syncer/0.log" Jun 03 20:11:42.062977 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:42.062904 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-762t7_4b153b22-fd10-428a-8daf-4bfe23079226/konnectivity-agent/0.log" Jun 03 20:11:42.162053 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:42.162025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-145.ec2.internal_320fd542d1a0a5133cb1d86dfcc2a9af/haproxy/0.log" Jun 03 20:11:46.431281 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.431226 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/extract/0.log" Jun 03 20:11:46.455656 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.455620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/util/0.log" Jun 03 20:11:46.477307 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.477284 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759czphx_d8bc20de-875f-4e88-af5d-3c390e5dfeb6/pull/0.log" Jun 03 20:11:46.550872 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.550846 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/extract/0.log" Jun 03 20:11:46.572111 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.572086 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/util/0.log" Jun 03 20:11:46.592438 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.592416 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9jx7_5c917e40-35e0-4d9d-b8af-a26bdec374d3/pull/0.log" Jun 03 20:11:46.615651 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.615625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/extract/0.log" Jun 03 20:11:46.634587 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.634567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/util/0.log" Jun 03 20:11:46.659558 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.659537 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nz27q_94b08de0-f09b-44df-b3de-7b9f6775df6a/pull/0.log" Jun 03 20:11:46.687812 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.687751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/extract/0.log" Jun 03 20:11:46.708438 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.708413 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/util/0.log" Jun 03 20:11:46.727373 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.727347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hqjnk_8962b3c4-0262-4c4f-8904-8fbb2f7e250d/pull/0.log" Jun 03 20:11:46.969675 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:46.969578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656fb56f4b-lk92n_be7f8f8c-86da-40b2-9a57-064a11058e6b/authorino/0.log" Jun 03 20:11:47.112550 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:47.112513 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gk8nl_1bd2800c-a61f-4a46-ac21-0227b9011032/registry-server/0.log" Jun 03 20:11:47.173817 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:47.173785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mwr2b_7a412108-f150-488d-924f-5278061ccf73/manager/0.log" Jun 03 20:11:47.284762 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:47.284680 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6m7f8_0871187c-5904-4744-9122-0fd88f0261f0/manager/0.log" Jun 03 20:11:48.923517 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:48.923488 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/alertmanager/0.log" Jun 03 20:11:48.943865 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:48.943836 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/config-reloader/0.log" Jun 03 20:11:48.969388 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:48.969363 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/kube-rbac-proxy-web/0.log" Jun 03 20:11:48.992503 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:48.992470 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/kube-rbac-proxy/0.log" Jun 03 20:11:49.019949 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.019931 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/kube-rbac-proxy-metric/0.log" Jun 03 20:11:49.044421 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.044395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/prom-label-proxy/0.log" Jun 03 20:11:49.070179 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.070160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d3e49a9-211d-427d-9e90-e2b07350709f/init-config-reloader/0.log" Jun 03 20:11:49.112736 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.112720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-qzq8f_2e010408-d4d8-4013-8f9f-cf71e1791243/cluster-monitoring-operator/0.log" Jun 03 20:11:49.246105 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.246044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-fxsxp_65fea322-25e0-4190-8948-34c8e0ff1603/monitoring-plugin/0.log" Jun 03 20:11:49.348252 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.348208 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkwhv_e12c7a0a-be02-4bd3-8640-0d4aa38ca392/node-exporter/0.log" Jun 03 20:11:49.366914 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.366886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkwhv_e12c7a0a-be02-4bd3-8640-0d4aa38ca392/kube-rbac-proxy/0.log" Jun 03 20:11:49.387664 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.387631 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkwhv_e12c7a0a-be02-4bd3-8640-0d4aa38ca392/init-textfile/0.log" Jun 03 20:11:49.781332 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.781304 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-lq6pm_d705b782-0f50-48f8-8dd8-1d4adc5f1876/prometheus-operator-admission-webhook/0.log" Jun 03 20:11:49.814505 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.814482 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7468bc9964-xjb4q_35cbb23e-aa3f-47e5-a747-00c2c39c905e/telemeter-client/0.log" Jun 03 20:11:49.838396 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.838375 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7468bc9964-xjb4q_35cbb23e-aa3f-47e5-a747-00c2c39c905e/reload/0.log" Jun 03 20:11:49.859602 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.859582 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7468bc9964-xjb4q_35cbb23e-aa3f-47e5-a747-00c2c39c905e/kube-rbac-proxy/0.log" Jun 03 20:11:49.909449 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.909427 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/thanos-query/0.log" Jun 03 20:11:49.936653 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.936616 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/kube-rbac-proxy-web/0.log" Jun 03 20:11:49.958545 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.958525 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/kube-rbac-proxy/0.log" Jun 03 20:11:49.983581 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:49.983559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/prom-label-proxy/0.log" Jun 03 20:11:50.006140 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:50.006122 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/kube-rbac-proxy-rules/0.log" Jun 03 20:11:50.027083 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:50.027063 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9ffd8dbb9-cwvdg_c33c5f76-4db9-48e9-90a7-875c4a5996d4/kube-rbac-proxy-metrics/0.log" Jun 03 20:11:52.932747 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:52.932717 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57458c6fc4-2c72m_78f17d34-0dc1-42eb-b01c-c99eec289e5a/console/0.log" Jun 03 20:11:53.700294 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:53.700225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-7tz2l_cb4c9830-aa9e-414e-9d3a-cbed47f98248/volume-data-source-validator/0.log" Jun 03 20:11:54.543646 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.543611 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6"] Jun 03 20:11:54.547410 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.547387 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.549824 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.549800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"kube-root-ca.crt\"" Jun 03 20:11:54.550932 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.550909 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"openshift-service-ca.crt\"" Jun 03 20:11:54.551017 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.550919 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jrmj9\"/\"default-dockercfg-8mhg6\"" Jun 03 20:11:54.554459 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.554436 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6"] Jun 03 20:11:54.616821 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.616793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-proc\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.616948 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.616829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-sys\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.616948 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.616850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-podres\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.616948 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.616870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2r2\" (UniqueName: \"kubernetes.io/projected/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-kube-api-access-cj2r2\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.617058 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.616948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-lib-modules\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717788 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-proc\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-sys\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-podres\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2r2\" (UniqueName: \"kubernetes.io/projected/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-kube-api-access-cj2r2\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-proc\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-sys\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.717927 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-lib-modules\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.718164 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-podres\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.718164 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.717990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-lib-modules\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.725546 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.725529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2r2\" (UniqueName: \"kubernetes.io/projected/a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a-kube-api-access-cj2r2\") pod \"perf-node-gather-daemonset-w47m6\" (UID: \"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.815311 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.815207 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2drfp_408ccba7-220b-4d2d-a232-617e6a90ab8c/dns/0.log" Jun 03 20:11:54.835277 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.835260 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2drfp_408ccba7-220b-4d2d-a232-617e6a90ab8c/kube-rbac-proxy/0.log" Jun 03 20:11:54.858720 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.858703 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:54.954548 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.954519 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dhdg_fa3f6443-6c02-4091-a04b-054ca3683d30/dns-node-resolver/0.log" Jun 03 20:11:54.991829 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:54.991805 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6"] Jun 03 20:11:54.993621 ip-10-0-133-145 kubenswrapper[2573]: W0603 20:11:54.993592 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5abac5f_2fa8_45ac_a8d8_4d8ea0f63e6a.slice/crio-0d8edfa67499bcd6500ebbd639cf2d3c93e810d4119bdc6f937317e22ac92c57 WatchSource:0}: Error finding container 0d8edfa67499bcd6500ebbd639cf2d3c93e810d4119bdc6f937317e22ac92c57: Status 404 returned error can't find the container with id 0d8edfa67499bcd6500ebbd639cf2d3c93e810d4119bdc6f937317e22ac92c57 Jun 03 20:11:55.182801 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:55.182766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" event={"ID":"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a","Type":"ContainerStarted","Data":"9943fdd87d8522d9c09a06473c43d3adc3d57e629bbdf863712781992703d513"} Jun 03 20:11:55.183007 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:55.182826 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:11:55.183007 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:55.182848 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" event={"ID":"a5abac5f-2fa8-45ac-a8d8-4d8ea0f63e6a","Type":"ContainerStarted","Data":"0d8edfa67499bcd6500ebbd639cf2d3c93e810d4119bdc6f937317e22ac92c57"} Jun 03 20:11:55.199350 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:55.199305 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" podStartSLOduration=1.19929035 podStartE2EDuration="1.19929035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:11:55.196982833 +0000 UTC m=+2479.892838553" watchObservedRunningTime="2026-06-03 20:11:55.19929035 +0000 UTC m=+2479.895146105" Jun 03 20:11:55.569763 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:55.569655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cm7lm_fb1fc591-025d-40f7-8b8c-c33b92125a66/node-ca/0.log" Jun 03 20:11:56.531188 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:56.531160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcct8hj_21a8203d-062f-4e13-9c41-5bb1518ee88b/istio-proxy/0.log" Jun 03 20:11:56.703254 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:56.703206 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/0.log" Jun 03 20:11:56.732081 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:56.732052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/1.log" Jun 03 20:11:56.830451 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:56.830369 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c99bfd76f-46v5r_623f04e8-7671-43f5-8390-773d6ce68100/router/0.log" Jun 03 20:11:57.446255 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:57.446215 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nnnlv_fffae973-7b4c-446f-96b2-8164848342a2/serve-healthcheck-canary/0.log" Jun 03 20:11:58.049151 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:58.049114 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-hznlb_ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7/insights-operator/0.log" Jun 03 20:11:58.049649 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:58.049483 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-hznlb_ea8abb5d-ba0e-48fb-adfa-fc46d20a21c7/insights-operator/1.log" Jun 03 20:11:58.203831 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:58.203788 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdnmz_af512cef-3556-49d8-8726-7ed4af20f2be/kube-rbac-proxy/0.log" Jun 03 20:11:58.223281 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:58.223254 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdnmz_af512cef-3556-49d8-8726-7ed4af20f2be/exporter/0.log" Jun 03 20:11:58.244505 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:11:58.244478 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdnmz_af512cef-3556-49d8-8726-7ed4af20f2be/extractor/0.log" Jun 03 20:12:00.536328 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:00.536299 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbff5bcdc-cznmg_f8124adc-cf5c-4eae-a6c4-3fd4b9e3e4c1/nginx/0.log" Jun 03 20:12:00.709637 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:00.709609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675280-9z4qz_273c9149-4a45-46c1-85fe-e58a29bbef13/cleanup/0.log" Jun 03 20:12:01.087971 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:01.087939 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-dgd6s_234d27d0-175b-41bc-8308-9c04a0fda579/manager/0.log" Jun 03 20:12:01.105709 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:01.105685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-dgd6s_234d27d0-175b-41bc-8308-9c04a0fda579/copy-manifests/0.log" Jun 03 20:12:01.128707 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:01.128685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wvpn2_ba4d7ffb-2b9b-4295-8efd-94cd88c6daa9/postgres/0.log" Jun 03 20:12:01.197928 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:01.197904 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-w47m6" Jun 03 20:12:02.594013 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:02.593988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cc8ff6b7b-559cc_038f3d95-6a91-4e8f-8768-881536442926/manager/0.log" Jun 03 20:12:07.191152 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:07.191119 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcct8hj_21a8203d-062f-4e13-9c41-5bb1518ee88b/istio-proxy/0.log" Jun 03 20:12:07.342376 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:07.342344 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/0.log" Jun 03 20:12:07.373513 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:07.373477 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/1.log" Jun 03 20:12:07.459460 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:07.459399 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c99bfd76f-46v5r_623f04e8-7671-43f5-8390-773d6ce68100/router/0.log" Jun 03 20:12:08.482390 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.482360 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv_11cf4553-6400-44f0-96b6-890d2d4e5e1d/kube-storage-version-migrator-operator/1.log" Jun 03 20:12:08.483400 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.483379 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-kjrbv_11cf4553-6400-44f0-96b6-890d2d4e5e1d/kube-storage-version-migrator-operator/0.log" Jun 03 20:12:08.612886 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.612851 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcct8hj_21a8203d-062f-4e13-9c41-5bb1518ee88b/istio-proxy/0.log" Jun 03 20:12:08.752709 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.752625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/0.log" Jun 03 20:12:08.781845 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.781820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/1.log" Jun 03 20:12:08.865828 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:08.865808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c99bfd76f-46v5r_623f04e8-7671-43f5-8390-773d6ce68100/router/0.log" Jun 03 20:12:09.812486 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:09.812447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4669k_525d846b-c6fa-4b54-bf97-cf9e2f594a69/kube-multus/0.log" Jun 03 20:12:10.125603 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.125581 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/kube-multus-additional-cni-plugins/0.log" Jun 03 20:12:10.145782 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.145757 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/egress-router-binary-copy/0.log" Jun 03 20:12:10.164190 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.164151 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/cni-plugins/0.log" Jun 03 20:12:10.182205 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.182183 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/bond-cni-plugin/0.log" Jun 03 20:12:10.200453 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.200434 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/routeoverride-cni/0.log" Jun 03 20:12:10.218922 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.218902 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/whereabouts-cni-bincopy/0.log" Jun 03 20:12:10.238192 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.238173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdhr9_ec73668e-d4f7-4a21-96e1-7c551cf5e5b3/whereabouts-cni/0.log" Jun 03 20:12:10.309519 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.309499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77lpm_b91d5e97-8471-4b51-8ea7-2bc33f6674c7/network-metrics-daemon/0.log" Jun 03 20:12:10.327446 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.327426 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77lpm_b91d5e97-8471-4b51-8ea7-2bc33f6674c7/kube-rbac-proxy/0.log" Jun 03 20:12:10.418891 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.418816 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcct8hj_21a8203d-062f-4e13-9c41-5bb1518ee88b/istio-proxy/0.log" Jun 03 20:12:10.560555 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.560530 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/0.log" Jun 03 20:12:10.590841 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.590814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-kwvqk_7b59a5f1-49dd-4bc7-9a16-f5a5749545ad/istio-proxy/1.log" Jun 03 20:12:10.668685 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:10.668663 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c99bfd76f-46v5r_623f04e8-7671-43f5-8390-773d6ce68100/router/0.log" Jun 03 20:12:11.392322 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.392291 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-controller/0.log" Jun 03 20:12:11.408205 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.408177 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/0.log" Jun 03 20:12:11.408357 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.408227 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovn-acl-logging/1.log" Jun 03 20:12:11.430035 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.430009 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/kube-rbac-proxy-node/0.log" Jun 03 20:12:11.451679 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.451656 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 20:12:11.467636 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.467614 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/northd/0.log" Jun 03 20:12:11.486393 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.486374 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/nbdb/0.log" Jun 03 20:12:11.505466 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.505449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/sbdb/0.log" Jun 03 20:12:11.552018 ip-10-0-133-145 kubenswrapper[2573]: I0603 20:12:11.551994 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9sbz_9f7d172d-80a2-4ced-9dfd-b2da531e7227/ovnkube-controller/0.log"