Jun 03 13:51:19.007191 ip-10-0-136-17 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 13:51:19.007204 ip-10-0-136-17 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 13:51:19.007211 ip-10-0-136-17 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 13:51:19.007430 ip-10-0-136-17 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 13:51:29.232935 ip-10-0-136-17 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 13:51:29.232957 ip-10-0-136-17 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 58514b7dc7b64dd6924a2ad1454a1c48 -- Jun 03 13:54:05.894970 ip-10-0-136-17 systemd[1]: Starting Kubernetes Kubelet... Jun 03 13:54:06.365326 ip-10-0-136-17 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:54:06.365326 ip-10-0-136-17 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 13:54:06.365326 ip-10-0-136-17 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:54:06.365326 ip-10-0-136-17 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 13:54:06.365326 ip-10-0-136-17 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:54:06.368822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.368731 2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 13:54:06.372951 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372935 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:54:06.372951 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372951 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372955 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372958 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372960 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372963 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372966 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372968 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372971 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372973 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372976 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372978 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372981 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372987 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372991 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372995 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.372999 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373003 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373006 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373008 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:54:06.373013 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373011 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373013 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373016 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373019 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373021 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373024 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373027 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373029 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373032 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373034 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373037 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373039 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373042 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373044 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373047 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373050 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373053 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373055 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373058 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373061 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:54:06.373461 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373063 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373066 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373068 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373072 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373074 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373077 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373079 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373081 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373084 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373086 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373088 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373091 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373093 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373096 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373099 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373102 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373104 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373106 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373109 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373111 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:54:06.373966 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373114 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373116 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373119 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373122 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373124 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373127 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373129 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373132 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373134 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373138 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373143 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373146 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373148 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373151 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373154 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373156 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373158 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373161 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373163 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373166 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:54:06.374441 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373168 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373171 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373173 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373175 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373178 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.373180 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374564 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374572 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374576 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374579 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374582 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374585 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374588 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374591 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374593 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374596 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374599 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374601 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374604 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374607 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:54:06.374940 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374609 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374612 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374614 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374618 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374620 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374623 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374625 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374628 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374630 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374632 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374635 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374637 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374640 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374642 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374646 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374649 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374651 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374654 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374656 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374659 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:54:06.375417 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374661 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374664 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374667 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374681 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374684 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374687 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374689 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374692 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374694 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374697 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374699 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374702 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374704 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374707 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374710 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374712 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374715 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374718 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374721 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374723 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:54:06.375934 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374726 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374728 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374731 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374733 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374736 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374738 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374740 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374743 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374745 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374749 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374752 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374754 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374757 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374759 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374763 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374767 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374769 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374772 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374774 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:54:06.376432 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374777 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374779 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374782 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374785 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374788 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374791 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374793 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374796 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374798 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374800 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374805 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374808 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.374810 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374876 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374884 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374889 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374894 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374898 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374902 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374906 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374910 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 13:54:06.376908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374914 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374917 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374920 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374924 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374927 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374930 2581 flags.go:64] FLAG: --cgroup-root="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374933 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374936 2581 flags.go:64] FLAG: --client-ca-file="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374939 2581 flags.go:64] FLAG: --cloud-config="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374941 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374944 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374949 2581 flags.go:64] FLAG: --cluster-domain="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374952 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374955 2581 flags.go:64] FLAG: --config-dir="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374958 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374962 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374965 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374968 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374971 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374975 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374977 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374981 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374985 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374988 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374991 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 13:54:06.377404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374995 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.374998 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375001 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375004 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375007 2581 flags.go:64] FLAG: --enable-server="true" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375010 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375014 2581 flags.go:64] FLAG: --event-burst="100" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375017 2581 flags.go:64] FLAG: --event-qps="50" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375020 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375023 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375026 2581 flags.go:64] FLAG: --eviction-hard="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375030 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375033 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375036 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375039 2581 flags.go:64] FLAG: --eviction-soft="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375042 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375045 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375047 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375050 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375053 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375056 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375058 2581 flags.go:64] FLAG: --feature-gates="" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375062 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375065 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375068 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 13:54:06.378055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375071 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375074 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375079 2581 flags.go:64] FLAG: --help="false" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375081 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375084 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375088 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375091 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375095 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375098 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375101 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375104 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375106 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375109 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375113 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375116 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375119 2581 flags.go:64] FLAG: --kube-reserved="" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375122 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375124 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375127 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375130 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375133 2581 flags.go:64] FLAG: --lock-file="" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375135 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375138 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375141 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 13:54:06.378652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375146 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375149 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375152 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375154 2581 flags.go:64] FLAG: --logging-format="text" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375157 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375160 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375163 2581 flags.go:64] FLAG: --manifest-url="" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375165 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375170 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375173 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375178 2581 flags.go:64] FLAG: --max-pods="110" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375182 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375185 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375188 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375191 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375194 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375197 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375200 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375211 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375214 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375216 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375220 2581 flags.go:64] FLAG: --pod-cidr="" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375222 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 13:54:06.379272 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375228 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375231 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375234 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375237 2581 flags.go:64] FLAG: --port="10250" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375240 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375243 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ce9110cf296a2f80" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375246 2581 flags.go:64] FLAG: --qos-reserved="" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375249 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375251 2581 flags.go:64] FLAG: --register-node="true" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375254 2581 flags.go:64] FLAG: --register-schedulable="true" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375257 2581 flags.go:64] FLAG: --register-with-taints="" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375261 2581 flags.go:64] FLAG: --registry-burst="10" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375264 2581 flags.go:64] FLAG: --registry-qps="5" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375266 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375269 2581 flags.go:64] FLAG: --reserved-memory="" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375273 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375276 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375279 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375282 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375286 2581 flags.go:64] FLAG: --runonce="false" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375288 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375291 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375294 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375297 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375300 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375303 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 13:54:06.379852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375306 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375309 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375311 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375314 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375317 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375320 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375322 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375325 2581 flags.go:64] FLAG: --system-cgroups="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375328 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375333 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375336 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375338 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375343 2581 flags.go:64] FLAG: --tls-min-version="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375345 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375348 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375351 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375353 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375356 2581 flags.go:64] FLAG: --v="2" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375360 2581 flags.go:64] FLAG: --version="false" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375364 2581 flags.go:64] FLAG: --vmodule="" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375368 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.375371 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375462 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375466 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:54:06.380462 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375468 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375472 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375475 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375477 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375480 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375483 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375485 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375488 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375491 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375493 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375495 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375498 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375500 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375502 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375505 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375507 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375509 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375512 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375514 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375518 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:54:06.381036 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375520 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375523 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375525 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375527 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375530 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375532 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375535 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375537 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375539 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375542 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375544 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375547 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375550 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375552 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375555 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375557 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375560 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375563 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375565 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375568 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:54:06.381513 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375570 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375573 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375575 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375578 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375580 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375584 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375587 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375591 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375594 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375598 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375600 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375603 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375605 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375608 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375610 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375612 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375615 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375617 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375620 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:54:06.382025 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375622 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375625 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375627 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375630 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375632 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375635 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375638 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375640 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375642 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375645 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375647 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375650 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375652 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375655 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375666 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375682 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375686 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375688 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375691 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375693 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:54:06.382530 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375696 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:54:06.383110 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375698 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:54:06.383110 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375701 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:54:06.383110 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375703 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:54:06.383110 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.375705 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:54:06.383110 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.376563 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:54:06.386558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.386536 2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 13:54:06.386558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.386555 2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386607 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386612 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386616 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386619 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386622 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386625 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386628 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386631 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386633 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386636 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386639 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386642 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386644 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386647 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386649 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386652 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386654 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386656 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386659 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:54:06.386697 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386661 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386663 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386666 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386668 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386689 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386693 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386696 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386703 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386707 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386711 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386714 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386716 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386719 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386721 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386724 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386727 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386730 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386732 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386735 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:54:06.387205 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386737 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386739 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386742 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386744 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386746 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386749 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386751 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386753 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386756 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386758 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386761 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386763 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386765 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386768 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386770 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386774 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386776 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386779 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386781 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386784 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:54:06.387701 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386787 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386789 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386791 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386794 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386796 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386799 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386801 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386804 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386806 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386808 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386811 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386813 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386816 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386818 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386821 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386823 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386826 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386828 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386833 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:54:06.388175 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386838 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386841 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386844 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386847 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386850 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386852 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386855 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386858 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386860 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.386866 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386962 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386967 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386971 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386973 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386976 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386979 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:54:06.388632 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386982 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386985 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386988 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386990 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386993 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386995 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.386998 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387000 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387003 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387005 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387008 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387010 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387013 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387015 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387018 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387020 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387024 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387027 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387029 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387032 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:54:06.389035 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387034 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387037 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387039 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387042 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387045 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387047 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387050 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387053 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387055 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387059 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387062 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387065 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387067 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387069 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387072 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387074 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387077 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387079 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387082 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387084 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:54:06.389557 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387086 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387089 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387091 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387094 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387096 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387098 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387101 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387103 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387106 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387109 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387111 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387115 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387118 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387121 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387123 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387126 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387128 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387131 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387134 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:54:06.390056 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387136 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387139 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387141 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387144 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387146 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387149 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387151 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387154 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387156 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387158 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387161 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387163 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387166 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387168 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387170 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387173 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387175 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387178 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387180 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387182 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:54:06.390517 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:06.387185 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:54:06.391018 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.387190 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:54:06.391018 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.388022 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 13:54:06.392447 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.392433 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 13:54:06.393379 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.393368 2581 server.go:1019] "Starting client certificate rotation" Jun 03 13:54:06.393486 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.393468 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:54:06.393547 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.393520 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:54:06.419513 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.419487 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:54:06.420654 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.420631 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:54:06.436688 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.436649 2581 log.go:25] "Validated CRI v1 runtime API" Jun 03 13:54:06.443114 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.443089 2581 log.go:25] "Validated CRI v1 image API" Jun 03 13:54:06.444266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.444244 2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 13:54:06.447239 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.447206 2581 fs.go:135] Filesystem UUIDs: map[03878ead-ba02-446a-87c4-952f09e348e3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b63aee56-c3a2-4ff3-b347-b8eb37d47ddc:/dev/nvme0n1p3] Jun 03 13:54:06.447339 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.447240 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 13:54:06.447999 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.447964 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:54:06.452209 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.452096 2581 manager.go:217] Machine: {Timestamp:2026-06-03 13:54:06.451556681 +0000 UTC m=+0.426906189 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097990 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28215bdb691ff1b5685504b4c3a2ff SystemUUID:ec28215b-db69-1ff1-b568-5504b4c3a2ff BootID:58514b7d-c7b6-4dd6-924a-2ad1454a1c48 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:58:59:84:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:58:59:84:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:78:2a:3e:4b:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 13:54:06.452209 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.452202 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 13:54:06.452339 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.452281 2581 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 13:54:06.453391 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.453369 2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 13:54:06.453525 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.453394 2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 13:54:06.453573 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.453534 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 13:54:06.453573 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.453543 2581 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 13:54:06.453573 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.453550 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:54:06.454315 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.454304 2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:54:06.455589 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.455580 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:54:06.455764 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.455754 2581 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 13:54:06.459557 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.459547 2581 kubelet.go:491] "Attempting to sync node with API server" Jun 03 13:54:06.459594 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.459560 2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 13:54:06.459594 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.459576 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 13:54:06.459594 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.459585 2581 kubelet.go:397] "Adding apiserver pod source" Jun 03 13:54:06.459594 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.459593 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 13:54:06.460717 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.460706 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:54:06.460770 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.460724 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:54:06.463865 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.463848 2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 13:54:06.466218 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.466202 2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 13:54:06.468098 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.468080 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7n5t" Jun 03 13:54:06.469096 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469084 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 13:54:06.469132 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469102 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 13:54:06.469132 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469109 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 13:54:06.469132 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469115 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 13:54:06.469132 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469123 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 13:54:06.469132 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469128 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469134 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469143 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469153 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469159 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469174 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 13:54:06.469266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.469180 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 13:54:06.470213 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.470203 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 13:54:06.470257 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.470214 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 13:54:06.473405 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.473391 2581 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 13:54:06.473480 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.473437 2581 server.go:1295] "Started kubelet" Jun 03 13:54:06.474327 ip-10-0-136-17 systemd[1]: Started Kubernetes Kubelet. Jun 03 13:54:06.475159 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.475143 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7n5t" Jun 03 13:54:06.475205 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.475142 2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 13:54:06.475289 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.475200 2581 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 13:54:06.477024 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.476990 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 13:54:06.477083 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.477038 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 13:54:06.477167 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.477152 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 13:54:06.477242 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.477229 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 13:54:06.477756 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.477740 2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 13:54:06.479635 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.479622 2581 server.go:317] "Adding debug handlers to kubelet server" Jun 03 13:54:06.481329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.481312 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 13:54:06.481864 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.481853 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 13:54:06.481960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.481946 2581 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 13:54:06.481960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.481958 2581 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 13:54:06.482421 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.482100 2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 13:54:06.482421 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.482131 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 03 13:54:06.482421 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.482143 2581 reconciler.go:26] "Reconciler: start to sync state" Jun 03 13:54:06.482780 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.482762 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.483203 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.483190 2581 factory.go:153] Registering CRI-O factory Jun 03 13:54:06.483274 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.483207 2581 factory.go:223] Registration of the crio container factory successfully Jun 03 13:54:06.483274 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.483271 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 13:54:06.483374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.483281 2581 factory.go:55] Registering systemd factory Jun 03 13:54:06.483374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.483290 2581 factory.go:223] Registration of the systemd container factory successfully Jun 03 13:54:06.484058 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.484039 2581 factory.go:103] Registering Raw factory Jun 03 13:54:06.484129 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.484064 2581 manager.go:1196] Started watching for new ooms in manager Jun 03 13:54:06.488009 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.487759 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:06.489473 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.489448 2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 13:54:06.489579 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.489483 2581 manager.go:319] Starting recovery of all containers Jun 03 13:54:06.494659 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.494634 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-17.ec2.internal\" not found" node="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.500887 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.500871 2581 manager.go:324] Recovery completed Jun 03 13:54:06.505011 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.504999 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.507033 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507017 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.507101 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507050 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.507101 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507064 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.507541 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507527 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 13:54:06.507541 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507538 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 13:54:06.507624 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.507555 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:54:06.510144 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.510132 2581 policy_none.go:49] "None policy: Start" Jun 03 13:54:06.510184 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.510149 2581 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 13:54:06.510218 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.510184 2581 state_mem.go:35] "Initializing new in-memory state store" Jun 03 13:54:06.547246 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547230 2581 manager.go:341] "Starting Device Plugin manager" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.547260 2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547270 2581 server.go:85] "Starting device plugin registration server" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547564 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547578 2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547650 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547775 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.547784 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.548368 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 13:54:06.557625 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.548442 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.613403 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.613365 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 13:54:06.614614 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.614597 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 13:54:06.614746 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.614628 2581 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 13:54:06.614746 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.614654 2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 13:54:06.614746 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.614663 2581 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 13:54:06.614894 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.614736 2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 13:54:06.617914 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.617855 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:06.648514 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.648495 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.652008 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.651986 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.652086 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.652017 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.652086 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.652030 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.652086 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.652054 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.660483 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.660466 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.660572 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.660492 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-17.ec2.internal\": node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.678933 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.678910 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.715908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.715881 2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal"] Jun 03 13:54:06.715993 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.715948 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.716899 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.716886 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.716957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.716911 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.716957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.716922 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.718181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718169 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.718327 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718312 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.718374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718346 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.718848 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718829 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.719002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718862 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.719002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718876 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.719002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718884 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.719002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718904 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.719002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.718915 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.720267 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.720250 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.720362 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.720277 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:54:06.720914 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.720899 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:54:06.720994 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.720928 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:54:06.720994 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.720944 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:54:06.750234 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.750213 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-17.ec2.internal\" not found" node="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.754416 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.754402 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-17.ec2.internal\" not found" node="ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.779943 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.779917 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.880271 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.880198 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.883568 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.883549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.883638 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.883578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.883638 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.883606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45d28ecc598cce1c956e6a0098a3c5fa-config\") pod \"kube-apiserver-proxy-ip-10-0-136-17.ec2.internal\" (UID: \"45d28ecc598cce1c956e6a0098a3c5fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.980619 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:06.980581 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:06.983880 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983852 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.983924 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983890 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45d28ecc598cce1c956e6a0098a3c5fa-config\") pod \"kube-apiserver-proxy-ip-10-0-136-17.ec2.internal\" (UID: \"45d28ecc598cce1c956e6a0098a3c5fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.983924 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983907 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.983992 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45d28ecc598cce1c956e6a0098a3c5fa-config\") pod \"kube-apiserver-proxy-ip-10-0-136-17.ec2.internal\" (UID: \"45d28ecc598cce1c956e6a0098a3c5fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.983992 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:06.984054 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:06.983991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9974e13d5686df16cbcbd87e6d4c647-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal\" (UID: \"a9974e13d5686df16cbcbd87e6d4c647\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:07.053023 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.052983 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:07.058692 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.058651 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:07.081633 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.081598 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.182169 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.182072 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.282543 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.282498 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.382842 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.382806 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.394143 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.394119 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 13:54:07.394302 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.394286 2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 13:54:07.394344 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.394306 2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 13:54:07.477793 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.477723 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 13:49:06 +0000 UTC" deadline="2028-02-10 00:10:49.57795203 +0000 UTC" Jun 03 13:54:07.477793 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.477758 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14794h16m42.100197269s" Jun 03 13:54:07.481628 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.481599 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 13:54:07.482880 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.482863 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.496165 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.496144 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:54:07.520315 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.520286 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thm7f" Jun 03 13:54:07.528555 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.528530 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thm7f" Jun 03 13:54:07.583076 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:07.583053 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-17.ec2.internal\" not found" Jun 03 13:54:07.585737 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.585721 2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:07.590809 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:07.590785 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9974e13d5686df16cbcbd87e6d4c647.slice/crio-c057f144b605528c46a6c20c9209e0baf493c8481db259fdb75b6c84aacbb3c8 WatchSource:0}: Error finding container c057f144b605528c46a6c20c9209e0baf493c8481db259fdb75b6c84aacbb3c8: Status 404 returned error can't find the container with id c057f144b605528c46a6c20c9209e0baf493c8481db259fdb75b6c84aacbb3c8 Jun 03 13:54:07.591038 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:07.591015 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d28ecc598cce1c956e6a0098a3c5fa.slice/crio-b5476615a851ccecfa08dd9c808a36df6c5cd35c80d3bf4d6dee0eda75970908 WatchSource:0}: Error finding container b5476615a851ccecfa08dd9c808a36df6c5cd35c80d3bf4d6dee0eda75970908: Status 404 returned error can't find the container with id b5476615a851ccecfa08dd9c808a36df6c5cd35c80d3bf4d6dee0eda75970908 Jun 03 13:54:07.598701 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.598664 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:54:07.617978 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.617931 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" event={"ID":"a9974e13d5686df16cbcbd87e6d4c647","Type":"ContainerStarted","Data":"c057f144b605528c46a6c20c9209e0baf493c8481db259fdb75b6c84aacbb3c8"} Jun 03 13:54:07.618841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.618811 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" event={"ID":"45d28ecc598cce1c956e6a0098a3c5fa","Type":"ContainerStarted","Data":"b5476615a851ccecfa08dd9c808a36df6c5cd35c80d3bf4d6dee0eda75970908"} Jun 03 13:54:07.661125 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.661103 2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:07.683021 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.682993 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" Jun 03 13:54:07.694937 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.694915 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:54:07.695981 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.695969 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" Jun 03 13:54:07.708606 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:07.708590 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:54:08.401312 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.401282 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:08.417585 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.417563 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:08.461510 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.461483 2581 apiserver.go:52] "Watching apiserver" Jun 03 13:54:08.467922 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.467897 2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 13:54:08.468263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.468238 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-s5grz","openshift-multus/network-metrics-daemon-t6mtg","openshift-network-diagnostics/network-check-target-z9bbf","kube-system/konnectivity-agent-jnf4m","kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal","openshift-multus/multus-6ww2v","openshift-network-operator/iptables-alerter-vkp86","openshift-ovn-kubernetes/ovnkube-node-28r5s","openshift-cluster-node-tuning-operator/tuned-p929l","openshift-dns/node-resolver-k4dtw","openshift-image-registry/node-ca-v4fvg"] Jun 03 13:54:08.470474 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.470448 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.471816 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.471794 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.471922 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.471881 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:08.473438 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473206 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.473438 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473244 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.473438 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473256 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxjcz\"" Jun 03 13:54:08.473991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473863 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 13:54:08.473991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473892 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 13:54:08.473991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473901 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 13:54:08.473991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.473920 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 13:54:08.474580 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.474372 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:08.474580 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.474432 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:08.476066 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.475858 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.476923 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.476905 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.477005 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.476982 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.477804 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.477779 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 13:54:08.477900 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.477842 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 13:54:08.477900 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.477847 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tqscp\"" Jun 03 13:54:08.478123 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.478108 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.479576 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.479932 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prpmb\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480006 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480188 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480272 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p2wfx\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480300 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 13:54:08.480704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480512 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.481073 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.480920 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z86xz\"" Jun 03 13:54:08.481174 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.481129 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.481737 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.481294 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.481737 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.481316 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 13:54:08.481737 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.481714 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 13:54:08.482724 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.482598 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.482724 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.482688 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 13:54:08.485276 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.485089 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.485712 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.485694 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 13:54:08.485782 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.485721 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 13:54:08.485841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.485824 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tfptg\"" Jun 03 13:54:08.486903 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.486879 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.487690 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.487511 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkqg5\"" Jun 03 13:54:08.487690 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.487631 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.487852 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.487828 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.487954 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.487869 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.489763 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.489744 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.489966 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.489918 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gcsrd\"" Jun 03 13:54:08.490134 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490119 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.490306 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490270 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 13:54:08.490401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490208 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 13:54:08.490497 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490484 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgvgc\"" Jun 03 13:54:08.490606 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490593 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 13:54:08.490977 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.490954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-config\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:08.491064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-k8s-cni-cncf-io\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-log-socket\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491193 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-os-release\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491193 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kxm\" (UniqueName: \"kubernetes.io/projected/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-kube-api-access-87kxm\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491193 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.491317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-multus\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-system-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-hostroot\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.491317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzprc\" (UniqueName: \"kubernetes.io/projected/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-kube-api-access-gzprc\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwlr\" (UniqueName: \"kubernetes.io/projected/b32714fb-178b-4bd9-9745-e6b897cce2a4-kube-api-access-5qwlr\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-device-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-systemd-units\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-ovn\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-netns\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-bin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-kubelet\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-multus-certs\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-systemd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-env-overrides\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-os-release\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-kubelet\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4447b7-9003-483b-a82a-b3746d21a042-ovn-node-metrics-cert\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-registration-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.491825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-socket-dir-parent\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-daemon-config\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-etc-kubernetes\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-sys-fs\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-system-cni-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.491982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-var-lib-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89225f41-81ac-42b0-a03b-d83adeaeb75e-agent-certs\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-socket-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxd2\" (UniqueName: \"kubernetes.io/projected/680104bf-eb29-42da-953e-6d8ece5116b3-kube-api-access-7fxd2\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-etc-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-node-log\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cni-binary-copy\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-iptables-alerter-script\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-host-slash\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-slash\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-netns\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-netd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-script-lib\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-bin\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89225f41-81ac-42b0-a03b-d83adeaeb75e-konnectivity-ca\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cnibin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492464 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-cnibin\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kfr\" (UniqueName: \"kubernetes.io/projected/2f4447b7-9003-483b-a82a-b3746d21a042-kube-api-access-z9kfr\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-conf-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t642v\" (UniqueName: \"kubernetes.io/projected/66d91a39-d368-4199-9db1-90a40d9a9881-kube-api-access-t642v\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.492840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.492615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.529335 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.529301 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:49:07 +0000 UTC" deadline="2028-02-26 17:01:33.3439162 +0000 UTC" Jun 03 13:54:08.529335 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.529334 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15195h7m24.814585822s" Jun 03 13:54:08.582931 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.582906 2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 13:54:08.593413 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593381 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-bin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593413 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593413 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-kubelet\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593437 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-multus-certs\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593461 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-systemd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-systemd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-bin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593538 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-kubelet\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593552 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593564 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-multus-certs\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593588 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-env-overrides\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.593597 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593597 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593613 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-os-release\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e87676-1566-46fb-b387-9c6b06a52a03-host\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wvzl\" (UniqueName: \"kubernetes.io/projected/73e87676-1566-46fb-b387-9c6b06a52a03-kube-api-access-2wvzl\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-kubernetes\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593737 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-kubelet\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593753 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4447b7-9003-483b-a82a-b3746d21a042-ovn-node-metrics-cert\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593774 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593798 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-registration-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593818 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593839 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-socket-dir-parent\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysconfig\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-host\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-tuned\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-789gt\" (UniqueName: \"kubernetes.io/projected/9aea1d61-86dd-4c23-92f8-203e692b9863-kube-api-access-789gt\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593927 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-daemon-config\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593941 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-etc-kubernetes\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.594049 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593963 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-sys-fs\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.593983 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-system-cni-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594007 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e87676-1566-46fb-b387-9c6b06a52a03-serviceca\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-systemd\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-tmp\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594097 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-var-lib-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594112 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594127 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89225f41-81ac-42b0-a03b-d83adeaeb75e-agent-certs\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-os-release\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594161 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-socket-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594185 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594204 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxd2\" (UniqueName: \"kubernetes.io/projected/680104bf-eb29-42da-953e-6d8ece5116b3-kube-api-access-7fxd2\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-lib-modules\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-socket-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxbmh\" (UniqueName: \"kubernetes.io/projected/f67e4f2d-326b-457c-8d26-fea35c824d64-kube-api-access-wxbmh\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594303 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-etc-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.594841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-kubelet\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594327 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-node-log\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-run\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594381 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cni-binary-copy\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594397 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-iptables-alerter-script\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594412 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-host-slash\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594428 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-slash\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594448 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-netns\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594465 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-netd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-env-overrides\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594484 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-script-lib\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594509 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-bin\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594537 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-bin\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594582 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594581 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89225f41-81ac-42b0-a03b-d83adeaeb75e-konnectivity-ca\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594614 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cnibin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.595452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594623 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-etc-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-registration-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594633 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-cnibin\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-node-log\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-modprobe-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-cnibin\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594703 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594742 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-host-slash\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595084 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-iptables-alerter-script\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595147 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-daemon-config\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-etc-kubernetes\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595226 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kfr\" (UniqueName: \"kubernetes.io/projected/2f4447b7-9003-483b-a82a-b3746d21a042-kube-api-access-z9kfr\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-system-cni-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595255 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595272 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-conf-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595288 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t642v\" (UniqueName: \"kubernetes.io/projected/66d91a39-d368-4199-9db1-90a40d9a9881-kube-api-access-t642v\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595309 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596055 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595350 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-config\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-sys-fs\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595434 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595451 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-k8s-cni-cncf-io\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595467 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-log-socket\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595491 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-os-release\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-conf\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aea1d61-86dd-4c23-92f8-203e692b9863-tmp-dir\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595555 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87kxm\" (UniqueName: \"kubernetes.io/projected/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-kube-api-access-87kxm\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595577 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-sys\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9aea1d61-86dd-4c23-92f8-203e692b9863-hosts-file\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595625 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-multus\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-var-lib-openvswitch\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595649 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-system-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595695 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-hostroot\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.596830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595714 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-var-lib-kubelet\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595753 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzprc\" (UniqueName: \"kubernetes.io/projected/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-kube-api-access-gzprc\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595771 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwlr\" (UniqueName: \"kubernetes.io/projected/b32714fb-178b-4bd9-9745-e6b897cce2a4-kube-api-access-5qwlr\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-k8s-cni-cncf-io\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595826 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-device-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595853 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-config\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595876 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-systemd-units\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-conf-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595908 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-ovn\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595941 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.595969 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-netns\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.594585 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-var-lib-cni-multus\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596080 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89225f41-81ac-42b0-a03b-d83adeaeb75e-konnectivity-ca\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-system-cni-dir\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.597582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-multus-socket-dir-parent\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596242 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cnibin\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.596326 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/680104bf-eb29-42da-953e-6d8ece5116b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-cni-binary-copy\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596357 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66d91a39-d368-4199-9db1-90a40d9a9881-device-dir\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-host-run-netns\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596575 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-ovn-kubernetes\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/680104bf-eb29-42da-953e-6d8ece5116b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-slash\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-cni-netd\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.596665 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:09.096590724 +0000 UTC m=+3.071940251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-log-socket\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596714 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-run-ovn\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-systemd-units\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-os-release\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.598407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4447b7-9003-483b-a82a-b3746d21a042-host-run-netns\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.599250 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f4447b7-9003-483b-a82a-b3746d21a042-ovnkube-script-lib\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.599250 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.596826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-hostroot\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.599470 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.599452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4447b7-9003-483b-a82a-b3746d21a042-ovn-node-metrics-cert\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.599654 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.599634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89225f41-81ac-42b0-a03b-d83adeaeb75e-agent-certs\") pod \"konnectivity-agent-jnf4m\" (UID: \"89225f41-81ac-42b0-a03b-d83adeaeb75e\") " pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.605274 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.605255 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:08.605356 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.605278 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:08.605356 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.605290 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:08.605436 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:08.605365 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:09.105349575 +0000 UTC m=+3.080699083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:08.607961 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.607939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kxm\" (UniqueName: \"kubernetes.io/projected/b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7-kube-api-access-87kxm\") pod \"multus-6ww2v\" (UID: \"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7\") " pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.608404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.608384 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxd2\" (UniqueName: \"kubernetes.io/projected/680104bf-eb29-42da-953e-6d8ece5116b3-kube-api-access-7fxd2\") pod \"multus-additional-cni-plugins-s5grz\" (UID: \"680104bf-eb29-42da-953e-6d8ece5116b3\") " pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.608480 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.608385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzprc\" (UniqueName: \"kubernetes.io/projected/d2e0f4e5-aff1-462f-8b7f-6b9fa195469c-kube-api-access-gzprc\") pod \"iptables-alerter-vkp86\" (UID: \"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c\") " pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.608514 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.608497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwlr\" (UniqueName: \"kubernetes.io/projected/b32714fb-178b-4bd9-9745-e6b897cce2a4-kube-api-access-5qwlr\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:08.608966 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.608943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kfr\" (UniqueName: \"kubernetes.io/projected/2f4447b7-9003-483b-a82a-b3746d21a042-kube-api-access-z9kfr\") pod \"ovnkube-node-28r5s\" (UID: \"2f4447b7-9003-483b-a82a-b3746d21a042\") " pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.609440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.609417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t642v\" (UniqueName: \"kubernetes.io/projected/66d91a39-d368-4199-9db1-90a40d9a9881-kube-api-access-t642v\") pod \"aws-ebs-csi-driver-node-pjrd9\" (UID: \"66d91a39-d368-4199-9db1-90a40d9a9881\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.696843 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696754 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysconfig\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.696843 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696802 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-host\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.696843 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696827 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-tuned\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696852 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-789gt\" (UniqueName: \"kubernetes.io/projected/9aea1d61-86dd-4c23-92f8-203e692b9863-kube-api-access-789gt\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e87676-1566-46fb-b387-9c6b06a52a03-serviceca\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696901 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysconfig\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696915 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-systemd\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696930 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-tmp\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696955 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-lib-modules\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.696979 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxbmh\" (UniqueName: \"kubernetes.io/projected/f67e4f2d-326b-457c-8d26-fea35c824d64-kube-api-access-wxbmh\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697001 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697016 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-run\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697045 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-modprobe-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697086 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-conf\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697101 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aea1d61-86dd-4c23-92f8-203e692b9863-tmp-dir\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697128 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-sys\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697152 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9aea1d61-86dd-4c23-92f8-203e692b9863-hosts-file\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697169 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-var-lib-kubelet\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-host\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697199 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e87676-1566-46fb-b387-9c6b06a52a03-host\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697234 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wvzl\" (UniqueName: \"kubernetes.io/projected/73e87676-1566-46fb-b387-9c6b06a52a03-kube-api-access-2wvzl\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697259 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-kubernetes\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-kubernetes\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697611 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9aea1d61-86dd-4c23-92f8-203e692b9863-hosts-file\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-modprobe-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73e87676-1566-46fb-b387-9c6b06a52a03-host\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697686 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-var-lib-kubelet\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-sys\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-systemd\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73e87676-1566-46fb-b387-9c6b06a52a03-serviceca\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-conf\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-sysctl-d\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aea1d61-86dd-4c23-92f8-203e692b9863-tmp-dir\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-lib-modules\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.697991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.697974 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f67e4f2d-326b-457c-8d26-fea35c824d64-run\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.699776 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.699741 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-etc-tuned\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.701451 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.701422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f67e4f2d-326b-457c-8d26-fea35c824d64-tmp\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.706000 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.705976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-789gt\" (UniqueName: \"kubernetes.io/projected/9aea1d61-86dd-4c23-92f8-203e692b9863-kube-api-access-789gt\") pod \"node-resolver-k4dtw\" (UID: \"9aea1d61-86dd-4c23-92f8-203e692b9863\") " pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:08.706361 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.706344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wvzl\" (UniqueName: \"kubernetes.io/projected/73e87676-1566-46fb-b387-9c6b06a52a03-kube-api-access-2wvzl\") pod \"node-ca-v4fvg\" (UID: \"73e87676-1566-46fb-b387-9c6b06a52a03\") " pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.707033 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.707016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxbmh\" (UniqueName: \"kubernetes.io/projected/f67e4f2d-326b-457c-8d26-fea35c824d64-kube-api-access-wxbmh\") pod \"tuned-p929l\" (UID: \"f67e4f2d-326b-457c-8d26-fea35c824d64\") " pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.790217 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.790187 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:08.798161 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.798142 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:08.805525 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.805503 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" Jun 03 13:54:08.810080 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.810064 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ww2v" Jun 03 13:54:08.817592 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.817575 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkp86" Jun 03 13:54:08.824135 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.824118 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s5grz" Jun 03 13:54:08.829762 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.829745 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p929l" Jun 03 13:54:08.837256 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.837238 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4fvg" Jun 03 13:54:08.843755 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:08.843737 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4dtw" Jun 03 13:54:09.099628 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.099586 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:09.099795 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.099776 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:09.099866 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.099851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:10.099836092 +0000 UTC m=+4.075185591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:09.200241 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.200198 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:09.200434 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.200353 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:09.200434 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.200374 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:09.200434 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.200388 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:09.200606 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:09.200451 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:10.200437137 +0000 UTC m=+4.175786636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:09.279144 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.278989 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aea1d61_86dd_4c23_92f8_203e692b9863.slice/crio-d1188030011f32444bcaa7a7f3e412fcbf913cc730075c9dfc146240a6e46131 WatchSource:0}: Error finding container d1188030011f32444bcaa7a7f3e412fcbf913cc730075c9dfc146240a6e46131: Status 404 returned error can't find the container with id d1188030011f32444bcaa7a7f3e412fcbf913cc730075c9dfc146240a6e46131 Jun 03 13:54:09.280469 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.280397 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680104bf_eb29_42da_953e_6d8ece5116b3.slice/crio-c679aa4d9cb11d59d38b738f4500ffe5111c0a1137084aee6ef2fa5485d840b3 WatchSource:0}: Error finding container c679aa4d9cb11d59d38b738f4500ffe5111c0a1137084aee6ef2fa5485d840b3: Status 404 returned error can't find the container with id c679aa4d9cb11d59d38b738f4500ffe5111c0a1137084aee6ef2fa5485d840b3 Jun 03 13:54:09.283794 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.283763 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e0f4e5_aff1_462f_8b7f_6b9fa195469c.slice/crio-7b06fb345732f6cc6f33039a1ed646a0aa4adc584499ded5788785ecf6b6f63c WatchSource:0}: Error finding container 7b06fb345732f6cc6f33039a1ed646a0aa4adc584499ded5788785ecf6b6f63c: Status 404 returned error can't find the container with id 7b06fb345732f6cc6f33039a1ed646a0aa4adc584499ded5788785ecf6b6f63c Jun 03 13:54:09.284549 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.284529 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4447b7_9003_483b_a82a_b3746d21a042.slice/crio-7332405589a716bffd32cd73b39c1c576fde1f61bcef1bf294d5553d52765013 WatchSource:0}: Error finding container 7332405589a716bffd32cd73b39c1c576fde1f61bcef1bf294d5553d52765013: Status 404 returned error can't find the container with id 7332405589a716bffd32cd73b39c1c576fde1f61bcef1bf294d5553d52765013 Jun 03 13:54:09.285419 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.285399 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67e4f2d_326b_457c_8d26_fea35c824d64.slice/crio-77052dd0862549afeb5ccb2e88c18c92d4632baa2d6a0a1836ce93ec6fbe4b80 WatchSource:0}: Error finding container 77052dd0862549afeb5ccb2e88c18c92d4632baa2d6a0a1836ce93ec6fbe4b80: Status 404 returned error can't find the container with id 77052dd0862549afeb5ccb2e88c18c92d4632baa2d6a0a1836ce93ec6fbe4b80 Jun 03 13:54:09.288195 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.288172 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b214cf_e87e_4ee2_b8ab_2b1fd9da08f7.slice/crio-7ee7a6ca87dfe8d6bb5f3259c0c1b446abb930bfd044637c049889b109c2731f WatchSource:0}: Error finding container 7ee7a6ca87dfe8d6bb5f3259c0c1b446abb930bfd044637c049889b109c2731f: Status 404 returned error can't find the container with id 7ee7a6ca87dfe8d6bb5f3259c0c1b446abb930bfd044637c049889b109c2731f Jun 03 13:54:09.289200 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:54:09.289141 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e87676_1566_46fb_b387_9c6b06a52a03.slice/crio-8839389b9a175deef4a819b959a857cdf8c0ca2eccee2a68556be40edb49891c WatchSource:0}: Error finding container 8839389b9a175deef4a819b959a857cdf8c0ca2eccee2a68556be40edb49891c: Status 404 returned error can't find the container with id 8839389b9a175deef4a819b959a857cdf8c0ca2eccee2a68556be40edb49891c Jun 03 13:54:09.530360 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.530329 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:49:07 +0000 UTC" deadline="2028-02-19 19:13:03.387468096 +0000 UTC" Jun 03 13:54:09.530360 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.530356 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15029h18m53.857114289s" Jun 03 13:54:09.623920 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.623834 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" event={"ID":"45d28ecc598cce1c956e6a0098a3c5fa","Type":"ContainerStarted","Data":"72c0a663405f8333306129641624392e79ec11ca00497cc20c1e40b7e2938844"} Jun 03 13:54:09.624866 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.624838 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"7332405589a716bffd32cd73b39c1c576fde1f61bcef1bf294d5553d52765013"} Jun 03 13:54:09.625721 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.625699 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" event={"ID":"66d91a39-d368-4199-9db1-90a40d9a9881","Type":"ContainerStarted","Data":"d1873bb0ae9b82590a5359876aa89dea0c9fa2ee9845c94f3efa8556b7cae993"} Jun 03 13:54:09.626630 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.626606 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4fvg" event={"ID":"73e87676-1566-46fb-b387-9c6b06a52a03","Type":"ContainerStarted","Data":"8839389b9a175deef4a819b959a857cdf8c0ca2eccee2a68556be40edb49891c"} Jun 03 13:54:09.627577 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.627557 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ww2v" event={"ID":"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7","Type":"ContainerStarted","Data":"7ee7a6ca87dfe8d6bb5f3259c0c1b446abb930bfd044637c049889b109c2731f"} Jun 03 13:54:09.628544 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.628526 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p929l" event={"ID":"f67e4f2d-326b-457c-8d26-fea35c824d64","Type":"ContainerStarted","Data":"77052dd0862549afeb5ccb2e88c18c92d4632baa2d6a0a1836ce93ec6fbe4b80"} Jun 03 13:54:09.629492 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.629470 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4dtw" event={"ID":"9aea1d61-86dd-4c23-92f8-203e692b9863","Type":"ContainerStarted","Data":"d1188030011f32444bcaa7a7f3e412fcbf913cc730075c9dfc146240a6e46131"} Jun 03 13:54:09.630363 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.630343 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnf4m" event={"ID":"89225f41-81ac-42b0-a03b-d83adeaeb75e","Type":"ContainerStarted","Data":"d53cf9c885894a3fdb1bd9db0c57c83bf776c6b48734ba600a4ee5e1450db5f6"} Jun 03 13:54:09.631218 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.631200 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkp86" event={"ID":"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c","Type":"ContainerStarted","Data":"7b06fb345732f6cc6f33039a1ed646a0aa4adc584499ded5788785ecf6b6f63c"} Jun 03 13:54:09.632079 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.632062 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerStarted","Data":"c679aa4d9cb11d59d38b738f4500ffe5111c0a1137084aee6ef2fa5485d840b3"} Jun 03 13:54:09.633264 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.633241 2581 generic.go:358] "Generic (PLEG): container finished" podID="a9974e13d5686df16cbcbd87e6d4c647" containerID="403f749fa8e56bbccaa92738189766d4e81d771a8b91398a91a09037f2f761a1" exitCode=0 Jun 03 13:54:09.633264 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.633266 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" event={"ID":"a9974e13d5686df16cbcbd87e6d4c647","Type":"ContainerDied","Data":"403f749fa8e56bbccaa92738189766d4e81d771a8b91398a91a09037f2f761a1"} Jun 03 13:54:09.639863 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:09.639830 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-17.ec2.internal" podStartSLOduration=2.639821143 podStartE2EDuration="2.639821143s" podCreationTimestamp="2026-06-03 13:54:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:54:09.639806702 +0000 UTC m=+3.615156218" watchObservedRunningTime="2026-06-03 13:54:09.639821143 +0000 UTC m=+3.615170660" Jun 03 13:54:10.106928 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:10.106880 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:10.107163 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.107064 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:10.107163 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.107134 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:12.10711478 +0000 UTC m=+6.082464280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:10.208312 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:10.208267 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:10.208490 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.208465 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:10.208490 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.208486 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:10.208618 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.208499 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:10.208618 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.208559 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:12.208540243 +0000 UTC m=+6.183889738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:10.615863 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:10.615819 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:10.616406 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.615943 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:10.616406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:10.616049 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:10.616406 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:10.616176 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:10.655825 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:10.655772 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" event={"ID":"a9974e13d5686df16cbcbd87e6d4c647","Type":"ContainerStarted","Data":"bd5d4eb4d0725bc500d08b6918b94cd79438e7271a995a890e87b0fb82fa2b04"} Jun 03 13:54:12.124173 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:12.123521 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:12.124173 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.123728 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:12.124173 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.123796 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:16.123777026 +0000 UTC m=+10.099126538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:12.225412 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:12.224778 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:12.225412 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.224946 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:12.225412 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.224966 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:12.225412 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.224980 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:12.225412 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.225047 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:16.225026132 +0000 UTC m=+10.200375631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:12.615071 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:12.615033 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:12.615268 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.615170 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:12.615615 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:12.615593 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:12.615746 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:12.615723 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:14.620753 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:14.620722 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:14.621226 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:14.620860 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:14.621295 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:14.621238 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:14.621349 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:14.621326 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:16.160792 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:16.160745 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:16.161240 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.160908 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:16.161240 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.160975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:24.160955209 +0000 UTC m=+18.136304706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:16.261359 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:16.261317 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:16.261520 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.261482 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:16.261520 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.261503 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:16.261520 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.261515 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:16.261633 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.261579 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:24.261562255 +0000 UTC m=+18.236911756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:16.618387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:16.618358 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:16.618387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:16.618374 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:16.618616 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.618472 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:16.618616 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:16.618592 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:18.616064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:18.615454 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:18.616064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:18.615470 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:18.616064 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:18.615581 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:18.616064 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:18.616024 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:20.615432 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:20.615399 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:20.615950 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:20.615406 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:20.615950 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:20.615492 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:20.615950 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:20.615587 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:22.614882 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:22.614846 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:22.614882 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:22.614880 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:22.615334 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:22.614987 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:22.615334 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:22.615088 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:24.219808 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:24.219769 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:24.220247 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.219911 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:24.220247 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.219970 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:40.219956839 +0000 UTC m=+34.195306333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:24.320960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:24.320922 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:24.321145 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.321064 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:24.321145 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.321089 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:24.321145 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.321102 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:24.321292 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.321168 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:54:40.321149592 +0000 UTC m=+34.296499099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:24.615111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:24.615077 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:24.615289 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:24.615125 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:24.615289 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.615208 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:24.615389 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:24.615345 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:26.615925 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:26.615885 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:26.616359 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:26.615983 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:26.616359 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:26.616075 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:26.616359 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:26.616260 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:28.615764 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.615421 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:28.616520 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.615477 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:28.616520 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:28.615881 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:28.616520 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:28.616336 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:28.706149 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:54:28.706567 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706538 2581 generic.go:358] "Generic (PLEG): container finished" podID="2f4447b7-9003-483b-a82a-b3746d21a042" containerID="60eed2203b7b03c79fd95377a5da92e10dfdcd4c1c17c8cd08f5fe1142000a41" exitCode=1 Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706618 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"fa380133fd1c35a70ccf1a285c50d60aca151914fd1d933fea3f61fa9fa387e6"} Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706648 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"440c0b41ceff5b5007952c3668c9f7879ac3c30414671c4a03e7d3ea1b44c7d0"} Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706661 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"b90e9052210e6e8a3e40f1fd3cd0773c7608b098fd950987ebffbce030866c42"} Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706693 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"721405e9e82c665117295952ab2096fbeb1aa6be8c7cfa7edc30d784e546a0f1"} Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706704 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerDied","Data":"60eed2203b7b03c79fd95377a5da92e10dfdcd4c1c17c8cd08f5fe1142000a41"} Jun 03 13:54:28.706722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.706715 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"c4d4ee7d90555cd9e9dff4d8d130f0cc24d752eb4b0fe0aca0d74e407ea60875"} Jun 03 13:54:28.708316 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.708227 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" event={"ID":"66d91a39-d368-4199-9db1-90a40d9a9881","Type":"ContainerStarted","Data":"e6e72ff0aa842d023096e01808a73e8cb3cb3db5bac64f29a869ddbfd7fe0d44"} Jun 03 13:54:28.709546 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.709516 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4fvg" event={"ID":"73e87676-1566-46fb-b387-9c6b06a52a03","Type":"ContainerStarted","Data":"f03acd66f55696750be2247c3f6f51a93a0e090af36f784cd7702954c89081f5"} Jun 03 13:54:28.710860 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.710827 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ww2v" event={"ID":"b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7","Type":"ContainerStarted","Data":"05923bcec358b4f3a3548f58585b528a1c7e8e4c8d07c7675d6d78c0cb1a2a04"} Jun 03 13:54:28.712931 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.712910 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p929l" event={"ID":"f67e4f2d-326b-457c-8d26-fea35c824d64","Type":"ContainerStarted","Data":"a88076a5e3425d6146133f1e5516b9b87e2b8d2680726e8df71cd2a8b14cfed4"} Jun 03 13:54:28.714555 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.714532 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4dtw" event={"ID":"9aea1d61-86dd-4c23-92f8-203e692b9863","Type":"ContainerStarted","Data":"6828fe4156b84f52f90333c69ddd93a3bb7440c5cc6fc6c92ed1fbb02412771b"} Jun 03 13:54:28.716056 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.716032 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnf4m" event={"ID":"89225f41-81ac-42b0-a03b-d83adeaeb75e","Type":"ContainerStarted","Data":"8c924bd5654e1ce44e11a4b77a66888fe27b6bf3329a252bd5dabbadaf9d19c1"} Jun 03 13:54:28.717950 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.717561 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="8a446adf3d9e78a6e5276301273b5314d744d536e92dcb5fcdd0b9bc1b6f21e8" exitCode=0 Jun 03 13:54:28.717950 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.717599 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"8a446adf3d9e78a6e5276301273b5314d744d536e92dcb5fcdd0b9bc1b6f21e8"} Jun 03 13:54:28.725112 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.725074 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v4fvg" podStartSLOduration=4.342831052 podStartE2EDuration="22.725033161s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.292835728 +0000 UTC m=+3.268185228" lastFinishedPulling="2026-06-03 13:54:27.675037827 +0000 UTC m=+21.650387337" observedRunningTime="2026-06-03 13:54:28.725031054 +0000 UTC m=+22.700380570" watchObservedRunningTime="2026-06-03 13:54:28.725033161 +0000 UTC m=+22.700382663" Jun 03 13:54:28.725558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.725527 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-17.ec2.internal" podStartSLOduration=21.725516235 podStartE2EDuration="21.725516235s" podCreationTimestamp="2026-06-03 13:54:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:54:10.672055569 +0000 UTC m=+4.647405088" watchObservedRunningTime="2026-06-03 13:54:28.725516235 +0000 UTC m=+22.700865753" Jun 03 13:54:28.743641 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.743551 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6ww2v" podStartSLOduration=4.31488401 podStartE2EDuration="22.743537229s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.291327473 +0000 UTC m=+3.266676971" lastFinishedPulling="2026-06-03 13:54:27.719980687 +0000 UTC m=+21.695330190" observedRunningTime="2026-06-03 13:54:28.74322734 +0000 UTC m=+22.718576858" watchObservedRunningTime="2026-06-03 13:54:28.743537229 +0000 UTC m=+22.718886745" Jun 03 13:54:28.784986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.784927 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p929l" podStartSLOduration=4.354237465 podStartE2EDuration="22.78490828s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.287128305 +0000 UTC m=+3.262477814" lastFinishedPulling="2026-06-03 13:54:27.717799115 +0000 UTC m=+21.693148629" observedRunningTime="2026-06-03 13:54:28.784548563 +0000 UTC m=+22.759898081" watchObservedRunningTime="2026-06-03 13:54:28.78490828 +0000 UTC m=+22.760257798" Jun 03 13:54:28.832099 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.832054 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k4dtw" podStartSLOduration=4.396024652 podStartE2EDuration="22.832040696s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.281387116 +0000 UTC m=+3.256736628" lastFinishedPulling="2026-06-03 13:54:27.717403177 +0000 UTC m=+21.692752672" observedRunningTime="2026-06-03 13:54:28.807566364 +0000 UTC m=+22.782915882" watchObservedRunningTime="2026-06-03 13:54:28.832040696 +0000 UTC m=+22.807390266" Jun 03 13:54:28.832288 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:28.832266 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jnf4m" podStartSLOduration=4.451527061 podStartE2EDuration="22.832261118s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.294295381 +0000 UTC m=+3.269644904" lastFinishedPulling="2026-06-03 13:54:27.675029463 +0000 UTC m=+21.650378961" observedRunningTime="2026-06-03 13:54:28.83191625 +0000 UTC m=+22.807265758" watchObservedRunningTime="2026-06-03 13:54:28.832261118 +0000 UTC m=+22.807610637" Jun 03 13:54:29.573826 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:29.573798 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 13:54:29.722342 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:29.722263 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" event={"ID":"66d91a39-d368-4199-9db1-90a40d9a9881","Type":"ContainerStarted","Data":"9a3b8f58d1af41f7c6cdbd82032a6c8e11471fb03c49f170b6e6d9a944cd617c"} Jun 03 13:54:29.723532 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:29.723506 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkp86" event={"ID":"d2e0f4e5-aff1-462f-8b7f-6b9fa195469c","Type":"ContainerStarted","Data":"c4fbbff06c870580f777a7430ab62c83be64b4cf2816b569a6be94d4b2f60254"} Jun 03 13:54:30.560642 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:30.560304 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T13:54:29.573821853Z","UUID":"0765d4e8-bdda-496a-a496-2e8b9b628fb4","Handler":null,"Name":"","Endpoint":""} Jun 03 13:54:30.564874 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:30.564830 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 13:54:30.564874 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:30.564873 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 13:54:30.617216 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:30.617178 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:30.617373 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:30.617340 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:30.617841 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:30.617821 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:30.617939 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:30.617915 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:31.159458 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.159417 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:31.160054 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.160033 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:31.176520 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.176456 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vkp86" podStartSLOduration=6.73815917 podStartE2EDuration="25.176438318s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.285586658 +0000 UTC m=+3.260936167" lastFinishedPulling="2026-06-03 13:54:27.723865817 +0000 UTC m=+21.699215315" observedRunningTime="2026-06-03 13:54:29.742866392 +0000 UTC m=+23.718215922" watchObservedRunningTime="2026-06-03 13:54:31.176438318 +0000 UTC m=+25.151787838" Jun 03 13:54:31.729897 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.729870 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:54:31.730217 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.730191 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"40e35d18655c91cfe3590dd351c056c95e0b89a7f325d9ceec1936333e31ee86"} Jun 03 13:54:31.731838 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.731815 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" event={"ID":"66d91a39-d368-4199-9db1-90a40d9a9881","Type":"ContainerStarted","Data":"1d3dc3d55c221a673676c99840a8bf53baffcd60c7d14e3b6b10e27667958356"} Jun 03 13:54:31.732056 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.732039 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:31.732476 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.732460 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jnf4m" Jun 03 13:54:31.762084 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:31.762042 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjrd9" podStartSLOduration=4.026159225 podStartE2EDuration="25.762029256s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.295862663 +0000 UTC m=+3.271212173" lastFinishedPulling="2026-06-03 13:54:31.031732708 +0000 UTC m=+25.007082204" observedRunningTime="2026-06-03 13:54:31.748595757 +0000 UTC m=+25.723945273" watchObservedRunningTime="2026-06-03 13:54:31.762029256 +0000 UTC m=+25.737378801" Jun 03 13:54:32.615486 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:32.615451 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:32.616140 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:32.615565 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:32.616140 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:32.615615 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:32.616140 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:32.615743 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:34.616153 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.615972 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:34.616707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.615970 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:34.616707 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:34.616252 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:34.616707 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:34.616361 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:34.738594 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.738517 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="9c2bbd3ba02b7910a04ebe48654dc72b4c29a1cd9d8d0f0c429c4ebc8327cb3b" exitCode=0 Jun 03 13:54:34.738757 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.738593 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"9c2bbd3ba02b7910a04ebe48654dc72b4c29a1cd9d8d0f0c429c4ebc8327cb3b"} Jun 03 13:54:34.741767 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.741741 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:54:34.742074 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.742050 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"31a652e0d70d921f74c38712439f410fce7d9ad99e67f0d4d3e2e6797a79c028"} Jun 03 13:54:34.742387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.742358 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:34.742387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.742371 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:34.742387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.742382 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:34.742566 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.742551 2581 scope.go:117] "RemoveContainer" containerID="60eed2203b7b03c79fd95377a5da92e10dfdcd4c1c17c8cd08f5fe1142000a41" Jun 03 13:54:34.759386 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.759362 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:34.759496 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:34.759451 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:54:35.747136 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:35.747108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:54:35.750139 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:35.750107 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" event={"ID":"2f4447b7-9003-483b-a82a-b3746d21a042","Type":"ContainerStarted","Data":"3e8e5f4758bc74c445066f26a4299d11f9083f2a66d6ac969859c4806a0728a2"} Jun 03 13:54:35.784103 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:35.784049 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" podStartSLOduration=11.325880414 podStartE2EDuration="29.784036435s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.287090574 +0000 UTC m=+3.262440082" lastFinishedPulling="2026-06-03 13:54:27.745246606 +0000 UTC m=+21.720596103" observedRunningTime="2026-06-03 13:54:35.782815678 +0000 UTC m=+29.758165194" watchObservedRunningTime="2026-06-03 13:54:35.784036435 +0000 UTC m=+29.759385951" Jun 03 13:54:36.423171 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.423136 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9bbf"] Jun 03 13:54:36.423321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.423307 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:36.423453 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:36.423425 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:36.425376 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.425356 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6mtg"] Jun 03 13:54:36.425467 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.425447 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:36.425543 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:36.425527 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:36.753854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.753763 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="1fd192eb0411bf4c5253dac30e2d1aafa7767014a5ab2e98ddedd50b69a7c48c" exitCode=0 Jun 03 13:54:36.754213 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:36.753843 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"1fd192eb0411bf4c5253dac30e2d1aafa7767014a5ab2e98ddedd50b69a7c48c"} Jun 03 13:54:37.757612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:37.757524 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="017387f441c9acc225672cdcde715cec6939478803397d4a72227c762e514520" exitCode=0 Jun 03 13:54:37.757612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:37.757569 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"017387f441c9acc225672cdcde715cec6939478803397d4a72227c762e514520"} Jun 03 13:54:38.615172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:38.615139 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:38.615348 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:38.615147 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:38.615348 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:38.615285 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:38.615348 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:38.615317 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:40.247620 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.247588 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:40.248106 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.247759 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:40.248106 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.247827 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:12.247812784 +0000 UTC m=+66.223162283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:40.348044 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.348009 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:40.348198 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.348146 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:40.348198 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.348167 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:40.348198 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.348179 2581 projected.go:194] Error preparing data for projected volume kube-api-access-gtnt8 for pod openshift-network-diagnostics/network-check-target-z9bbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:40.348322 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.348244 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8 podName:1631db63-a2b3-4b60-b040-da5cbf87b93a nodeName:}" failed. No retries permitted until 2026-06-03 13:55:12.348225582 +0000 UTC m=+66.323575090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtnt8" (UniqueName: "kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8") pod "network-check-target-z9bbf" (UID: "1631db63-a2b3-4b60-b040-da5cbf87b93a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:40.615972 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.615510 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:40.615972 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.615628 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bbf" podUID="1631db63-a2b3-4b60-b040-da5cbf87b93a" Jun 03 13:54:40.615972 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.615707 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:40.615972 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:40.615819 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:54:40.828104 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.828067 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-17.ec2.internal" event="NodeReady" Jun 03 13:54:40.828374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.828215 2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 13:54:40.878442 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.878409 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-84qm2"] Jun 03 13:54:40.892828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.892780 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vrkqc"] Jun 03 13:54:40.892989 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.892941 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:40.895761 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.895737 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 13:54:40.896158 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.896134 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zsshc\"" Jun 03 13:54:40.896869 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.896848 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 13:54:40.903465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.903172 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84qm2"] Jun 03 13:54:40.903465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.903197 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrkqc"] Jun 03 13:54:40.903465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.903304 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:40.905562 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.905547 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 13:54:40.906059 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.906043 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 13:54:40.906226 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.906207 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 13:54:40.906350 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:40.906283 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gxcmr\"" Jun 03 13:54:41.053458 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3159a48e-b426-4194-bd31-02f50ab6e96e-config-volume\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.053715 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3159a48e-b426-4194-bd31-02f50ab6e96e-tmp-dir\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.053715 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.053715 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.053715 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dscp\" (UniqueName: \"kubernetes.io/projected/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-kube-api-access-9dscp\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.053715 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.053700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bhv\" (UniqueName: \"kubernetes.io/projected/3159a48e-b426-4194-bd31-02f50ab6e96e-kube-api-access-p5bhv\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.154783 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.154696 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.154783 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.154753 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dscp\" (UniqueName: \"kubernetes.io/projected/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-kube-api-access-9dscp\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.154786 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bhv\" (UniqueName: \"kubernetes.io/projected/3159a48e-b426-4194-bd31-02f50ab6e96e-kube-api-access-p5bhv\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.154819 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3159a48e-b426-4194-bd31-02f50ab6e96e-config-volume\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.154881 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.154887 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3159a48e-b426-4194-bd31-02f50ab6e96e-tmp-dir\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.154965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:41.654944031 +0000 UTC m=+35.630293541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:41.155125 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.155050 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.155466 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.155170 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:41.155466 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.155219 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3159a48e-b426-4194-bd31-02f50ab6e96e-tmp-dir\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.155466 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.155227 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:41.655207495 +0000 UTC m=+35.630557009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:54:41.155466 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.155433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3159a48e-b426-4194-bd31-02f50ab6e96e-config-volume\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.165367 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.165341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bhv\" (UniqueName: \"kubernetes.io/projected/3159a48e-b426-4194-bd31-02f50ab6e96e-kube-api-access-p5bhv\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.165483 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.165400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dscp\" (UniqueName: \"kubernetes.io/projected/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-kube-api-access-9dscp\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.659888 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.659850 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:41.659888 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:41.659894 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:41.660502 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.660015 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:41.660502 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.660015 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:41.660502 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.660088 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:42.660068757 +0000 UTC m=+36.635418253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:41.660502 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:41.660104 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:42.660097795 +0000 UTC m=+36.635447303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:54:42.615793 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.615758 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:54:42.615986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.615763 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:54:42.619465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.619403 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj8sj\"" Jun 03 13:54:42.619465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.619421 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:54:42.619465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.619423 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:54:42.619465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.619463 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9kxv\"" Jun 03 13:54:42.619740 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.619405 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:54:42.667416 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.667380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:42.667831 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:42.667426 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:42.667831 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:42.667527 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:42.667831 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:42.667539 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:42.667831 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:42.667600 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:44.667580215 +0000 UTC m=+38.642929718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:54:42.667831 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:42.667617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:44.667610466 +0000 UTC m=+38.642959960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:43.772138 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:43.771892 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="85c6d5fa03be459f8620ed3ab9951e972fdaa3f0487312ce26fc55dbae535774" exitCode=0 Jun 03 13:54:43.772138 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:43.771968 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"85c6d5fa03be459f8620ed3ab9951e972fdaa3f0487312ce26fc55dbae535774"} Jun 03 13:54:44.684392 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:44.684350 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:44.684588 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:44.684456 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:44.684588 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:44.684489 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:44.684588 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:44.684553 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:48.684536502 +0000 UTC m=+42.659885997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:44.684588 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:44.684554 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:44.684794 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:44.684614 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:48.684598989 +0000 UTC m=+42.659948484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:54:44.776374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:44.776344 2581 generic.go:358] "Generic (PLEG): container finished" podID="680104bf-eb29-42da-953e-6d8ece5116b3" containerID="babd3c12460d83196bce4ccae9e6b44a5f6ae1b0a14b5e0d19fe030ca2d8b72f" exitCode=0 Jun 03 13:54:44.776722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:44.776382 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerDied","Data":"babd3c12460d83196bce4ccae9e6b44a5f6ae1b0a14b5e0d19fe030ca2d8b72f"} Jun 03 13:54:45.780776 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:45.780731 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s5grz" event={"ID":"680104bf-eb29-42da-953e-6d8ece5116b3","Type":"ContainerStarted","Data":"6b68e08e368605aa529cc5dae546f328ad99bf25f33fc33944d73403cc90382b"} Jun 03 13:54:45.804229 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:45.804174 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s5grz" podStartSLOduration=5.706480215 podStartE2EDuration="39.804159663s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:09.282783036 +0000 UTC m=+3.258132530" lastFinishedPulling="2026-06-03 13:54:43.380462479 +0000 UTC m=+37.355811978" observedRunningTime="2026-06-03 13:54:45.80379854 +0000 UTC m=+39.779148054" watchObservedRunningTime="2026-06-03 13:54:45.804159663 +0000 UTC m=+39.779509177" Jun 03 13:54:48.714094 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:48.714054 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:48.714094 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:48.714097 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:48.714591 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:48.714213 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:48.714591 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:48.714213 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:48.714591 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:48.714289 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:56.714256491 +0000 UTC m=+50.689605987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:48.714591 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:48.714307 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:56.714298987 +0000 UTC m=+50.689648482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:54:56.769003 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:56.768963 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:54:56.769003 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:54:56.769009 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:54:56.769410 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:56.769107 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:56.769410 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:56.769117 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:56.769410 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:56.769176 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:12.769160552 +0000 UTC m=+66.744510049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:54:56.769410 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:54:56.769189 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:55:12.769183339 +0000 UTC m=+66.744532834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:55:06.765106 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:06.765081 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28r5s" Jun 03 13:55:12.279916 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.279872 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:55:12.282600 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.282577 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:55:12.290504 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.290483 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 13:55:12.290592 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.290546 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:16.290527481 +0000 UTC m=+130.265876977 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : secret "metrics-daemon-secret" not found Jun 03 13:55:12.381202 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.381155 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:55:12.383330 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.383313 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:55:12.394380 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.394359 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:55:12.406408 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.406380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/1631db63-a2b3-4b60-b040-da5cbf87b93a-kube-api-access-gtnt8\") pod \"network-check-target-z9bbf\" (UID: \"1631db63-a2b3-4b60-b040-da5cbf87b93a\") " pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:55:12.638133 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.638097 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9kxv\"" Jun 03 13:55:12.646032 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.646008 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:55:12.775618 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.775547 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9bbf"] Jun 03 13:55:12.779524 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:55:12.779499 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1631db63_a2b3_4b60_b040_da5cbf87b93a.slice/crio-0d9b72e03734666cc3d4192070a2a23af067856812eeff3902b1eaf9c2ea34d6 WatchSource:0}: Error finding container 0d9b72e03734666cc3d4192070a2a23af067856812eeff3902b1eaf9c2ea34d6: Status 404 returned error can't find the container with id 0d9b72e03734666cc3d4192070a2a23af067856812eeff3902b1eaf9c2ea34d6 Jun 03 13:55:12.784397 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.784372 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:55:12.784556 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.784434 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:55:12.784556 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.784547 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:55:12.784633 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.784554 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:55:12.784633 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.784595 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:55:44.784581486 +0000 UTC m=+98.759930981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:55:12.784633 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:12.784628 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:44.784611255 +0000 UTC m=+98.759960750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:55:12.835063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:12.835033 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9bbf" event={"ID":"1631db63-a2b3-4b60-b040-da5cbf87b93a","Type":"ContainerStarted","Data":"0d9b72e03734666cc3d4192070a2a23af067856812eeff3902b1eaf9c2ea34d6"} Jun 03 13:55:16.844322 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:16.844283 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9bbf" event={"ID":"1631db63-a2b3-4b60-b040-da5cbf87b93a","Type":"ContainerStarted","Data":"d92b47ec8b39bc8351b51a3ef3f7740881fd3d44ff4ab6a288c640e18bc1135e"} Jun 03 13:55:16.844718 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:16.844438 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:55:16.860119 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:16.860022 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9bbf" podStartSLOduration=67.794433913 podStartE2EDuration="1m10.860007614s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:55:12.781786451 +0000 UTC m=+66.757135948" lastFinishedPulling="2026-06-03 13:55:15.847360138 +0000 UTC m=+69.822709649" observedRunningTime="2026-06-03 13:55:16.859936128 +0000 UTC m=+70.835285646" watchObservedRunningTime="2026-06-03 13:55:16.860007614 +0000 UTC m=+70.835357132" Jun 03 13:55:44.801561 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:44.801530 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:55:44.802030 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:44.801571 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:55:44.802030 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:44.801658 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:55:44.802030 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:44.801666 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:55:44.802030 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:44.801727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert podName:86f1366b-dee9-41dd-94a7-3c38f10bd5f0 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:48.801712081 +0000 UTC m=+162.777061576 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert") pod "ingress-canary-vrkqc" (UID: "86f1366b-dee9-41dd-94a7-3c38f10bd5f0") : secret "canary-serving-cert" not found Jun 03 13:55:44.802030 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:55:44.801751 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls podName:3159a48e-b426-4194-bd31-02f50ab6e96e nodeName:}" failed. No retries permitted until 2026-06-03 13:56:48.801737266 +0000 UTC m=+162.777086760 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls") pod "dns-default-84qm2" (UID: "3159a48e-b426-4194-bd31-02f50ab6e96e") : secret "dns-default-metrics-tls" not found Jun 03 13:55:47.851255 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:55:47.851225 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9bbf" Jun 03 13:56:06.778330 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.778299 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c"] Jun 03 13:56:06.781357 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.781333 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.781812 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.781784 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9kwns"] Jun 03 13:56:06.783529 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.783503 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 13:56:06.783625 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.783506 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 13:56:06.783979 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.783962 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.784257 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.784226 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8wcj6\"" Jun 03 13:56:06.784321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.784250 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 13:56:06.785741 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.785724 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 13:56:06.785828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.785783 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6bnhc\"" Jun 03 13:56:06.785989 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.785975 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 13:56:06.786403 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.786387 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 13:56:06.786484 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.786464 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 13:56:06.786708 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.786692 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 13:56:06.792745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.792726 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c"] Jun 03 13:56:06.793440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.793421 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 13:56:06.797960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.797939 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9kwns"] Jun 03 13:56:06.847097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpsz\" (UniqueName: \"kubernetes.io/projected/ef320e45-577f-423d-81b8-dc66cd0dc66e-kube-api-access-9fpsz\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-service-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-snapshots\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a6dbb54-58a6-4864-b315-283a46268f8f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.847321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-tmp\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847321 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef320e45-577f-423d-81b8-dc66cd0dc66e-serving-cert\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.847494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8gt8\" (UniqueName: \"kubernetes.io/projected/4a6dbb54-58a6-4864-b315-283a46268f8f-kube-api-access-t8gt8\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.847494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.847384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.948602 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948572 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948620 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948638 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpsz\" (UniqueName: \"kubernetes.io/projected/ef320e45-577f-423d-81b8-dc66cd0dc66e-kube-api-access-9fpsz\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948658 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-service-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:06.948762 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948784 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-snapshots\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.948822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948819 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a6dbb54-58a6-4864-b315-283a46268f8f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.949072 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:06.948834 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:07.448814794 +0000 UTC m=+121.424164288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:06.949072 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948863 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-tmp\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.949072 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948888 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef320e45-577f-423d-81b8-dc66cd0dc66e-serving-cert\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.949072 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.948922 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8gt8\" (UniqueName: \"kubernetes.io/projected/4a6dbb54-58a6-4864-b315-283a46268f8f-kube-api-access-t8gt8\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.949735 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.949708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-service-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.949854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.949776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-tmp\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.949854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.949780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ef320e45-577f-423d-81b8-dc66cd0dc66e-snapshots\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.949973 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.949917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef320e45-577f-423d-81b8-dc66cd0dc66e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.950029 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.949987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a6dbb54-58a6-4864-b315-283a46268f8f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:06.952612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.952587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef320e45-577f-423d-81b8-dc66cd0dc66e-serving-cert\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.956985 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.956960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpsz\" (UniqueName: \"kubernetes.io/projected/ef320e45-577f-423d-81b8-dc66cd0dc66e-kube-api-access-9fpsz\") pod \"insights-operator-788bf58df5-9kwns\" (UID: \"ef320e45-577f-423d-81b8-dc66cd0dc66e\") " pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:06.958052 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:06.958028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8gt8\" (UniqueName: \"kubernetes.io/projected/4a6dbb54-58a6-4864-b315-283a46268f8f-kube-api-access-t8gt8\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:07.100307 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:07.100266 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9kwns" Jun 03 13:56:07.237446 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:07.237412 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9kwns"] Jun 03 13:56:07.240724 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:07.240695 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef320e45_577f_423d_81b8_dc66cd0dc66e.slice/crio-710ef71a9b944b5d32b0b73ede0dda74dbcbeeb38178bb7b4cf9b9d0631eeaa5 WatchSource:0}: Error finding container 710ef71a9b944b5d32b0b73ede0dda74dbcbeeb38178bb7b4cf9b9d0631eeaa5: Status 404 returned error can't find the container with id 710ef71a9b944b5d32b0b73ede0dda74dbcbeeb38178bb7b4cf9b9d0631eeaa5 Jun 03 13:56:07.452822 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:07.452725 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:07.452971 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:07.452877 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:07.452971 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:07.452955 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:08.452938138 +0000 UTC m=+122.428287633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:07.941089 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:07.941053 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9kwns" event={"ID":"ef320e45-577f-423d-81b8-dc66cd0dc66e","Type":"ContainerStarted","Data":"710ef71a9b944b5d32b0b73ede0dda74dbcbeeb38178bb7b4cf9b9d0631eeaa5"} Jun 03 13:56:08.460474 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:08.460432 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:08.460638 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:08.460547 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:08.460638 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:08.460611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:10.460596875 +0000 UTC m=+124.435946370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:09.946452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:09.946417 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9kwns" event={"ID":"ef320e45-577f-423d-81b8-dc66cd0dc66e","Type":"ContainerStarted","Data":"f2b919cea1376c6efad5216fc22b58e424a0f8fbe2597492ccbae9080b15f9e7"} Jun 03 13:56:09.962725 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:09.962639 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-9kwns" podStartSLOduration=2.094272664 podStartE2EDuration="3.962623795s" podCreationTimestamp="2026-06-03 13:56:06 +0000 UTC" firstStartedPulling="2026-06-03 13:56:07.242541715 +0000 UTC m=+121.217891209" lastFinishedPulling="2026-06-03 13:56:09.110892841 +0000 UTC m=+123.086242340" observedRunningTime="2026-06-03 13:56:09.962046958 +0000 UTC m=+123.937396476" watchObservedRunningTime="2026-06-03 13:56:09.962623795 +0000 UTC m=+123.937973312" Jun 03 13:56:10.476984 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:10.476944 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:10.477159 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:10.477062 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:10.477159 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:10.477117 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:14.477103463 +0000 UTC m=+128.452452958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:11.741533 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.741494 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-gts7k"] Jun 03 13:56:11.743315 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.743299 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.745412 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.745387 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:11.745542 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.745452 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 13:56:11.745542 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.745472 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 13:56:11.746323 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.746301 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 13:56:11.746464 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.746437 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7ss4n\"" Jun 03 13:56:11.753606 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.753585 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 13:56:11.755854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.755827 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-gts7k"] Jun 03 13:56:11.888979 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.888945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-config\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.889249 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.888988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrkt\" (UniqueName: \"kubernetes.io/projected/7dfc771f-6c4a-43d3-a80f-e053d257e428-kube-api-access-qzrkt\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.889249 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.889073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dfc771f-6c4a-43d3-a80f-e053d257e428-serving-cert\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.889249 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.889097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-trusted-ca\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990009 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.989964 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-trusted-ca\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990229 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.990031 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-config\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990229 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.990061 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrkt\" (UniqueName: \"kubernetes.io/projected/7dfc771f-6c4a-43d3-a80f-e053d257e428-kube-api-access-qzrkt\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990351 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.990310 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dfc771f-6c4a-43d3-a80f-e053d257e428-serving-cert\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990710 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.990667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-config\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.990868 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.990850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc771f-6c4a-43d3-a80f-e053d257e428-trusted-ca\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.992805 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.992765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dfc771f-6c4a-43d3-a80f-e053d257e428-serving-cert\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:11.998974 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:11.998949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrkt\" (UniqueName: \"kubernetes.io/projected/7dfc771f-6c4a-43d3-a80f-e053d257e428-kube-api-access-qzrkt\") pod \"console-operator-86d7c6cc77-gts7k\" (UID: \"7dfc771f-6c4a-43d3-a80f-e053d257e428\") " pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:12.055154 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:12.055116 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:12.177711 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:12.177663 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-gts7k"] Jun 03 13:56:12.180919 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:12.180887 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfc771f_6c4a_43d3_a80f_e053d257e428.slice/crio-13e6ff14b44a8d5857f800ce14f72f8f69a585ee9a65a85fa7de8dba7ba86088 WatchSource:0}: Error finding container 13e6ff14b44a8d5857f800ce14f72f8f69a585ee9a65a85fa7de8dba7ba86088: Status 404 returned error can't find the container with id 13e6ff14b44a8d5857f800ce14f72f8f69a585ee9a65a85fa7de8dba7ba86088 Jun 03 13:56:12.224905 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:12.224883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4dtw_9aea1d61-86dd-4c23-92f8-203e692b9863/dns-node-resolver/0.log" Jun 03 13:56:12.952448 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:12.952413 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" event={"ID":"7dfc771f-6c4a-43d3-a80f-e053d257e428","Type":"ContainerStarted","Data":"13e6ff14b44a8d5857f800ce14f72f8f69a585ee9a65a85fa7de8dba7ba86088"} Jun 03 13:56:13.227656 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:13.227580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4fvg_73e87676-1566-46fb-b387-9c6b06a52a03/node-ca/0.log" Jun 03 13:56:14.512280 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:14.512168 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:14.512630 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:14.512320 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:14.512630 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:14.512389 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:22.512370159 +0000 UTC m=+136.487719659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:14.957838 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:14.957811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/0.log" Jun 03 13:56:14.958025 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:14.957852 2581 generic.go:358] "Generic (PLEG): container finished" podID="7dfc771f-6c4a-43d3-a80f-e053d257e428" containerID="9f4b0f73d21ecb3f53adbb56b516cf7be1fbc774c47b77d82f27255564a91cfa" exitCode=255 Jun 03 13:56:14.958025 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:14.957915 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" event={"ID":"7dfc771f-6c4a-43d3-a80f-e053d257e428","Type":"ContainerDied","Data":"9f4b0f73d21ecb3f53adbb56b516cf7be1fbc774c47b77d82f27255564a91cfa"} Jun 03 13:56:14.958160 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:14.958144 2581 scope.go:117] "RemoveContainer" containerID="9f4b0f73d21ecb3f53adbb56b516cf7be1fbc774c47b77d82f27255564a91cfa" Jun 03 13:56:15.961090 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 13:56:15.961584 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961479 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/0.log" Jun 03 13:56:15.961584 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961520 2581 generic.go:358] "Generic (PLEG): container finished" podID="7dfc771f-6c4a-43d3-a80f-e053d257e428" containerID="dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3" exitCode=255 Jun 03 13:56:15.961584 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961578 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" event={"ID":"7dfc771f-6c4a-43d3-a80f-e053d257e428","Type":"ContainerDied","Data":"dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3"} Jun 03 13:56:15.961774 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961622 2581 scope.go:117] "RemoveContainer" containerID="9f4b0f73d21ecb3f53adbb56b516cf7be1fbc774c47b77d82f27255564a91cfa" Jun 03 13:56:15.961854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:15.961823 2581 scope.go:117] "RemoveContainer" containerID="dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3" Jun 03 13:56:15.962032 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:15.962014 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-gts7k_openshift-console-operator(7dfc771f-6c4a-43d3-a80f-e053d257e428)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" podUID="7dfc771f-6c4a-43d3-a80f-e053d257e428" Jun 03 13:56:16.327448 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.327408 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:56:16.327621 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:16.327549 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 13:56:16.327621 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:16.327619 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs podName:b32714fb-178b-4bd9-9745-e6b897cce2a4 nodeName:}" failed. No retries permitted until 2026-06-03 13:58:18.327602749 +0000 UTC m=+252.302952245 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs") pod "network-metrics-daemon-t6mtg" (UID: "b32714fb-178b-4bd9-9745-e6b897cce2a4") : secret "metrics-daemon-secret" not found Jun 03 13:56:16.747638 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.747549 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5"] Jun 03 13:56:16.749536 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.749521 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.751910 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.751892 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 13:56:16.752668 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.752644 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 13:56:16.752668 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.752654 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:16.752834 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.752710 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 13:56:16.752834 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.752749 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-krvgs\"" Jun 03 13:56:16.761451 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.761429 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5"] Jun 03 13:56:16.831099 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.831060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9jx\" (UniqueName: \"kubernetes.io/projected/bb03a9e9-364d-4ed3-8cca-b95560ac708e-kube-api-access-gf9jx\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.831261 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.831128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb03a9e9-364d-4ed3-8cca-b95560ac708e-serving-cert\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.831261 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.831169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb03a9e9-364d-4ed3-8cca-b95560ac708e-config\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.931879 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.931834 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb03a9e9-364d-4ed3-8cca-b95560ac708e-serving-cert\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.932011 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.931898 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb03a9e9-364d-4ed3-8cca-b95560ac708e-config\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.932011 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.931940 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9jx\" (UniqueName: \"kubernetes.io/projected/bb03a9e9-364d-4ed3-8cca-b95560ac708e-kube-api-access-gf9jx\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.932479 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.932455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb03a9e9-364d-4ed3-8cca-b95560ac708e-config\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.934259 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.934238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb03a9e9-364d-4ed3-8cca-b95560ac708e-serving-cert\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.940192 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.940173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9jx\" (UniqueName: \"kubernetes.io/projected/bb03a9e9-364d-4ed3-8cca-b95560ac708e-kube-api-access-gf9jx\") pod \"service-ca-operator-69877444c-9qgg5\" (UID: \"bb03a9e9-364d-4ed3-8cca-b95560ac708e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:16.964850 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.964829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 13:56:16.965159 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:16.965144 2581 scope.go:117] "RemoveContainer" containerID="dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3" Jun 03 13:56:16.965308 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:16.965294 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-gts7k_openshift-console-operator(7dfc771f-6c4a-43d3-a80f-e053d257e428)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" podUID="7dfc771f-6c4a-43d3-a80f-e053d257e428" Jun 03 13:56:17.058140 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.058117 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" Jun 03 13:56:17.178240 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.178196 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5"] Jun 03 13:56:17.182001 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:17.181975 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb03a9e9_364d_4ed3_8cca_b95560ac708e.slice/crio-c4f89348f6a5d5bd66ca057c3ee488dd46fa8f0463f47d0485ec171874a1da54 WatchSource:0}: Error finding container c4f89348f6a5d5bd66ca057c3ee488dd46fa8f0463f47d0485ec171874a1da54: Status 404 returned error can't find the container with id c4f89348f6a5d5bd66ca057c3ee488dd46fa8f0463f47d0485ec171874a1da54 Jun 03 13:56:17.550244 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.550216 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b"] Jun 03 13:56:17.552810 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.552794 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" Jun 03 13:56:17.555206 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.555190 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z75lh\"" Jun 03 13:56:17.562842 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.562821 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b"] Jun 03 13:56:17.637842 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.637811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjjz\" (UniqueName: \"kubernetes.io/projected/f2fa216e-66ec-439a-942e-37eb6694b4ab-kube-api-access-5rjjz\") pod \"network-check-source-56d84b9f44-xfl7b\" (UID: \"f2fa216e-66ec-439a-942e-37eb6694b4ab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" Jun 03 13:56:17.738263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.738232 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjjz\" (UniqueName: \"kubernetes.io/projected/f2fa216e-66ec-439a-942e-37eb6694b4ab-kube-api-access-5rjjz\") pod \"network-check-source-56d84b9f44-xfl7b\" (UID: \"f2fa216e-66ec-439a-942e-37eb6694b4ab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" Jun 03 13:56:17.747828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.747799 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjjz\" (UniqueName: \"kubernetes.io/projected/f2fa216e-66ec-439a-942e-37eb6694b4ab-kube-api-access-5rjjz\") pod \"network-check-source-56d84b9f44-xfl7b\" (UID: \"f2fa216e-66ec-439a-942e-37eb6694b4ab\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" Jun 03 13:56:17.861977 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.861901 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" Jun 03 13:56:17.968289 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:17.968246 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" event={"ID":"bb03a9e9-364d-4ed3-8cca-b95560ac708e","Type":"ContainerStarted","Data":"c4f89348f6a5d5bd66ca057c3ee488dd46fa8f0463f47d0485ec171874a1da54"} Jun 03 13:56:18.000398 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:18.000357 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b"] Jun 03 13:56:18.003739 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:18.003707 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fa216e_66ec_439a_942e_37eb6694b4ab.slice/crio-7620ff3068d623dbe5ce877dfd23a849232122780e72e85c1ecbddcad0f807a0 WatchSource:0}: Error finding container 7620ff3068d623dbe5ce877dfd23a849232122780e72e85c1ecbddcad0f807a0: Status 404 returned error can't find the container with id 7620ff3068d623dbe5ce877dfd23a849232122780e72e85c1ecbddcad0f807a0 Jun 03 13:56:18.971790 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:18.971746 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" event={"ID":"f2fa216e-66ec-439a-942e-37eb6694b4ab","Type":"ContainerStarted","Data":"c1801f3c8c110cdd223aafa8793bbd20e2d2807ad512d7ad37e6fc05b68ad104"} Jun 03 13:56:18.971790 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:18.971794 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" event={"ID":"f2fa216e-66ec-439a-942e-37eb6694b4ab","Type":"ContainerStarted","Data":"7620ff3068d623dbe5ce877dfd23a849232122780e72e85c1ecbddcad0f807a0"} Jun 03 13:56:19.976433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:19.976389 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" event={"ID":"bb03a9e9-364d-4ed3-8cca-b95560ac708e","Type":"ContainerStarted","Data":"347bf5c1d852870e5d88c3ac156de8cd40efc14414bea80a5538b1cbd074dd1b"} Jun 03 13:56:19.993862 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:19.993811 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xfl7b" podStartSLOduration=2.9937968870000002 podStartE2EDuration="2.993796887s" podCreationTimestamp="2026-06-03 13:56:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:56:18.986932512 +0000 UTC m=+132.962282029" watchObservedRunningTime="2026-06-03 13:56:19.993796887 +0000 UTC m=+133.969146403" Jun 03 13:56:19.994456 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:19.994421 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" podStartSLOduration=2.075821515 podStartE2EDuration="3.994410716s" podCreationTimestamp="2026-06-03 13:56:16 +0000 UTC" firstStartedPulling="2026-06-03 13:56:17.183816191 +0000 UTC m=+131.159165686" lastFinishedPulling="2026-06-03 13:56:19.102405393 +0000 UTC m=+133.077754887" observedRunningTime="2026-06-03 13:56:19.99356645 +0000 UTC m=+133.968915968" watchObservedRunningTime="2026-06-03 13:56:19.994410716 +0000 UTC m=+133.969760233" Jun 03 13:56:20.744863 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.744827 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc"] Jun 03 13:56:20.747011 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.746993 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" Jun 03 13:56:20.749558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.749535 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 13:56:20.749694 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.749535 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:20.750292 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.750275 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cqsb5\"" Jun 03 13:56:20.762655 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.762634 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc"] Jun 03 13:56:20.864725 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.864667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65lxq\" (UniqueName: \"kubernetes.io/projected/db147461-26cd-48fa-a23c-717e1fed4460-kube-api-access-65lxq\") pod \"migrator-96c6f749-2mbmc\" (UID: \"db147461-26cd-48fa-a23c-717e1fed4460\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" Jun 03 13:56:20.966015 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.965983 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65lxq\" (UniqueName: \"kubernetes.io/projected/db147461-26cd-48fa-a23c-717e1fed4460-kube-api-access-65lxq\") pod \"migrator-96c6f749-2mbmc\" (UID: \"db147461-26cd-48fa-a23c-717e1fed4460\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" Jun 03 13:56:20.990263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:20.990233 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65lxq\" (UniqueName: \"kubernetes.io/projected/db147461-26cd-48fa-a23c-717e1fed4460-kube-api-access-65lxq\") pod \"migrator-96c6f749-2mbmc\" (UID: \"db147461-26cd-48fa-a23c-717e1fed4460\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" Jun 03 13:56:21.055320 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:21.055287 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" Jun 03 13:56:21.179156 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:21.179107 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc"] Jun 03 13:56:21.182779 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:21.182752 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb147461_26cd_48fa_a23c_717e1fed4460.slice/crio-526410f653c9506a636dec1fa2fb5a684a8d1ecd96ae297eb2610ed895c16703 WatchSource:0}: Error finding container 526410f653c9506a636dec1fa2fb5a684a8d1ecd96ae297eb2610ed895c16703: Status 404 returned error can't find the container with id 526410f653c9506a636dec1fa2fb5a684a8d1ecd96ae297eb2610ed895c16703 Jun 03 13:56:21.982902 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:21.982854 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" event={"ID":"db147461-26cd-48fa-a23c-717e1fed4460","Type":"ContainerStarted","Data":"526410f653c9506a636dec1fa2fb5a684a8d1ecd96ae297eb2610ed895c16703"} Jun 03 13:56:22.055524 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.055477 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:22.055524 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.055526 2581 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:22.056079 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.056016 2581 scope.go:117] "RemoveContainer" containerID="dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3" Jun 03 13:56:22.056233 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:22.056202 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-gts7k_openshift-console-operator(7dfc771f-6c4a-43d3-a80f-e053d257e428)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" podUID="7dfc771f-6c4a-43d3-a80f-e053d257e428" Jun 03 13:56:22.580761 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.580726 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:22.580976 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:22.580901 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:22.581038 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:22.580983 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls podName:4a6dbb54-58a6-4864-b315-283a46268f8f nodeName:}" failed. No retries permitted until 2026-06-03 13:56:38.580961608 +0000 UTC m=+152.556311104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mwz2c" (UID: "4a6dbb54-58a6-4864-b315-283a46268f8f") : secret "cluster-monitoring-operator-tls" not found Jun 03 13:56:22.883921 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.883884 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mqfjq"] Jun 03 13:56:22.887562 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.887074 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:22.889734 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.889709 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 13:56:22.889865 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.889814 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 13:56:22.890802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.890772 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 13:56:22.890924 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.890777 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f4h5m\"" Jun 03 13:56:22.890924 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.890850 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 13:56:22.896957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.896935 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mqfjq"] Jun 03 13:56:22.983106 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.983064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-key\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:22.983106 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.983106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-cabundle\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:22.983339 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.983132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqdk\" (UniqueName: \"kubernetes.io/projected/a1113f12-7299-4a0b-8944-2e71d82308e9-kube-api-access-skqdk\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:22.986960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.986928 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" event={"ID":"db147461-26cd-48fa-a23c-717e1fed4460","Type":"ContainerStarted","Data":"211d5c81cf4ffacbc8afcad9c17e26239a08e8daf152f80d35e3da9c444da2c7"} Jun 03 13:56:22.986960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:22.986962 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" event={"ID":"db147461-26cd-48fa-a23c-717e1fed4460","Type":"ContainerStarted","Data":"bdcc1b1f6bbc414cb3d3d6c696cf72366f5552ca6f6e350c7f59feecc5219bd2"} Jun 03 13:56:23.002558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.002512 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-2mbmc" podStartSLOduration=1.7545699639999999 podStartE2EDuration="3.002494275s" podCreationTimestamp="2026-06-03 13:56:20 +0000 UTC" firstStartedPulling="2026-06-03 13:56:21.185098715 +0000 UTC m=+135.160448210" lastFinishedPulling="2026-06-03 13:56:22.433023022 +0000 UTC m=+136.408372521" observedRunningTime="2026-06-03 13:56:23.002112754 +0000 UTC m=+136.977462271" watchObservedRunningTime="2026-06-03 13:56:23.002494275 +0000 UTC m=+136.977843838" Jun 03 13:56:23.084514 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.084473 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-key\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.085018 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.084524 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-cabundle\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.085018 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.084659 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skqdk\" (UniqueName: \"kubernetes.io/projected/a1113f12-7299-4a0b-8944-2e71d82308e9-kube-api-access-skqdk\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.085284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.085266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-cabundle\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.087108 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.087086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1113f12-7299-4a0b-8944-2e71d82308e9-signing-key\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.093979 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.093955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqdk\" (UniqueName: \"kubernetes.io/projected/a1113f12-7299-4a0b-8944-2e71d82308e9-kube-api-access-skqdk\") pod \"service-ca-685df94d57-mqfjq\" (UID: \"a1113f12-7299-4a0b-8944-2e71d82308e9\") " pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.196991 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.196906 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-mqfjq" Jun 03 13:56:23.320259 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.320226 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mqfjq"] Jun 03 13:56:23.323505 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:23.323480 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1113f12_7299_4a0b_8944_2e71d82308e9.slice/crio-791dc523d3c273629bde362ce3e783ad47a0e6313a5c3ad931be0aeae31eb308 WatchSource:0}: Error finding container 791dc523d3c273629bde362ce3e783ad47a0e6313a5c3ad931be0aeae31eb308: Status 404 returned error can't find the container with id 791dc523d3c273629bde362ce3e783ad47a0e6313a5c3ad931be0aeae31eb308 Jun 03 13:56:23.991375 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.991333 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-mqfjq" event={"ID":"a1113f12-7299-4a0b-8944-2e71d82308e9","Type":"ContainerStarted","Data":"776d349190eaad595ffa85be4b6c1fb26d0ec39d73609e831f52fab19a4704c9"} Jun 03 13:56:23.991375 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:23.991377 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-mqfjq" event={"ID":"a1113f12-7299-4a0b-8944-2e71d82308e9","Type":"ContainerStarted","Data":"791dc523d3c273629bde362ce3e783ad47a0e6313a5c3ad931be0aeae31eb308"} Jun 03 13:56:24.009602 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:24.009542 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-mqfjq" podStartSLOduration=2.009523757 podStartE2EDuration="2.009523757s" podCreationTimestamp="2026-06-03 13:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:56:24.008200582 +0000 UTC m=+137.983550093" watchObservedRunningTime="2026-06-03 13:56:24.009523757 +0000 UTC m=+137.984873275" Jun 03 13:56:36.617497 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:36.617126 2581 scope.go:117] "RemoveContainer" containerID="dedf2964600a52091df2875111466854dbcaf14922bb2d719f5b019797e38cd3" Jun 03 13:56:37.034250 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:37.034172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 13:56:37.034406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:37.034259 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" event={"ID":"7dfc771f-6c4a-43d3-a80f-e053d257e428","Type":"ContainerStarted","Data":"3756abb1650c4057e25e7eb8b6a1f149eac99e2447dbe31d3756855ec6e9ea49"} Jun 03 13:56:37.034621 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:37.034598 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:37.040004 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:37.039983 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" Jun 03 13:56:37.050750 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:37.050709 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-gts7k" podStartSLOduration=24.108440082 podStartE2EDuration="26.050696005s" podCreationTimestamp="2026-06-03 13:56:11 +0000 UTC" firstStartedPulling="2026-06-03 13:56:12.182886937 +0000 UTC m=+126.158236447" lastFinishedPulling="2026-06-03 13:56:14.125142876 +0000 UTC m=+128.100492370" observedRunningTime="2026-06-03 13:56:37.049942345 +0000 UTC m=+151.025291862" watchObservedRunningTime="2026-06-03 13:56:37.050696005 +0000 UTC m=+151.026045516" Jun 03 13:56:38.593590 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:38.593545 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:38.596261 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:38.596231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a6dbb54-58a6-4864-b315-283a46268f8f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mwz2c\" (UID: \"4a6dbb54-58a6-4864-b315-283a46268f8f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:38.893468 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:38.893375 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" Jun 03 13:56:39.028285 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:39.028248 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c"] Jun 03 13:56:39.031953 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:39.031918 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6dbb54_58a6_4864_b315_283a46268f8f.slice/crio-72d521dec5ea471d5006312dfe1264d000e135045a304b838cc8eff6fbe6deae WatchSource:0}: Error finding container 72d521dec5ea471d5006312dfe1264d000e135045a304b838cc8eff6fbe6deae: Status 404 returned error can't find the container with id 72d521dec5ea471d5006312dfe1264d000e135045a304b838cc8eff6fbe6deae Jun 03 13:56:39.040398 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:39.040371 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" event={"ID":"4a6dbb54-58a6-4864-b315-283a46268f8f","Type":"ContainerStarted","Data":"72d521dec5ea471d5006312dfe1264d000e135045a304b838cc8eff6fbe6deae"} Jun 03 13:56:41.047369 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:41.047330 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" event={"ID":"4a6dbb54-58a6-4864-b315-283a46268f8f","Type":"ContainerStarted","Data":"223c4070e1ac2bc8b186aa41c43b5d6bf17fc94cfeaafe47d4155c938d54f038"} Jun 03 13:56:41.064571 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:41.064526 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mwz2c" podStartSLOduration=33.397502764 podStartE2EDuration="35.064513469s" podCreationTimestamp="2026-06-03 13:56:06 +0000 UTC" firstStartedPulling="2026-06-03 13:56:39.034158524 +0000 UTC m=+153.009508019" lastFinishedPulling="2026-06-03 13:56:40.701169229 +0000 UTC m=+154.676518724" observedRunningTime="2026-06-03 13:56:41.063079898 +0000 UTC m=+155.038429406" watchObservedRunningTime="2026-06-03 13:56:41.064513469 +0000 UTC m=+155.039862986" Jun 03 13:56:43.907625 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:43.907582 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-84qm2" podUID="3159a48e-b426-4194-bd31-02f50ab6e96e" Jun 03 13:56:43.914744 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:43.914714 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vrkqc" podUID="86f1366b-dee9-41dd-94a7-3c38f10bd5f0" Jun 03 13:56:44.056775 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.056747 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84qm2" Jun 03 13:56:44.073746 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.073709 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mgst9"] Jun 03 13:56:44.097345 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.097316 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mgst9"] Jun 03 13:56:44.097493 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.097466 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.099910 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.099881 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 13:56:44.100795 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.100773 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8c6lj\"" Jun 03 13:56:44.100895 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.100871 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 13:56:44.132731 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.132700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwq97\" (UniqueName: \"kubernetes.io/projected/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-api-access-xwq97\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.132844 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.132815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.132908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.132842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-data-volume\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.132908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.132870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-crio-socket\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.132908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.132895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.167239 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.167182 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8"] Jun 03 13:56:44.182171 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.182150 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-hgrmq"] Jun 03 13:56:44.182337 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.182313 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:44.185976 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.185955 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n65tm\"" Jun 03 13:56:44.186428 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.186409 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 13:56:44.196637 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.196618 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8"] Jun 03 13:56:44.196637 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.196639 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-hgrmq"] Jun 03 13:56:44.196768 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.196736 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:56:44.201226 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.201206 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 13:56:44.201409 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.201272 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 13:56:44.201409 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.201324 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m2lqn\"" Jun 03 13:56:44.234300 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqvsl\" (UniqueName: \"kubernetes.io/projected/48760028-2210-41f8-8614-b1bc71497e1b-kube-api-access-sqvsl\") pod \"downloads-c65b8dc4b-hgrmq\" (UID: \"48760028-2210-41f8-8614-b1bc71497e1b\") " pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:56:44.234406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af9bb845-3922-4e05-847c-b2d25079d62f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrnc8\" (UID: \"af9bb845-3922-4e05-847c-b2d25079d62f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:44.234406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234320 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234338 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-data-volume\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234406 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234363 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-crio-socket\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234615 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234409 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234615 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-crio-socket\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234615 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234519 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwq97\" (UniqueName: \"kubernetes.io/projected/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-api-access-xwq97\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234840 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-data-volume\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.234956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.234935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.236823 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.236797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.252685 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.252641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwq97\" (UniqueName: \"kubernetes.io/projected/f0a0ba07-30f6-4093-80d2-6ecfb636d94c-kube-api-access-xwq97\") pod \"insights-runtime-extractor-mgst9\" (UID: \"f0a0ba07-30f6-4093-80d2-6ecfb636d94c\") " pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.335773 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.335733 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af9bb845-3922-4e05-847c-b2d25079d62f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrnc8\" (UID: \"af9bb845-3922-4e05-847c-b2d25079d62f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:44.335958 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.335864 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqvsl\" (UniqueName: \"kubernetes.io/projected/48760028-2210-41f8-8614-b1bc71497e1b-kube-api-access-sqvsl\") pod \"downloads-c65b8dc4b-hgrmq\" (UID: \"48760028-2210-41f8-8614-b1bc71497e1b\") " pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:56:44.338237 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.338219 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af9bb845-3922-4e05-847c-b2d25079d62f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-jrnc8\" (UID: \"af9bb845-3922-4e05-847c-b2d25079d62f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:44.348210 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.348180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqvsl\" (UniqueName: \"kubernetes.io/projected/48760028-2210-41f8-8614-b1bc71497e1b-kube-api-access-sqvsl\") pod \"downloads-c65b8dc4b-hgrmq\" (UID: \"48760028-2210-41f8-8614-b1bc71497e1b\") " pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:56:44.406365 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.406342 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mgst9" Jun 03 13:56:44.493966 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.493939 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:44.508537 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.508513 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:56:44.537282 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.537251 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mgst9"] Jun 03 13:56:44.543792 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:44.543758 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a0ba07_30f6_4093_80d2_6ecfb636d94c.slice/crio-98380f8bc0daecf898fff0c814e8abfd54a3466f3d7761e0838ad227ab852556 WatchSource:0}: Error finding container 98380f8bc0daecf898fff0c814e8abfd54a3466f3d7761e0838ad227ab852556: Status 404 returned error can't find the container with id 98380f8bc0daecf898fff0c814e8abfd54a3466f3d7761e0838ad227ab852556 Jun 03 13:56:44.636737 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.636687 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8"] Jun 03 13:56:44.642803 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:44.642767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9bb845_3922_4e05_847c_b2d25079d62f.slice/crio-427516651ee44cfd3a0de76657a9776726db2e4533e5d7bb91037a33976ac227 WatchSource:0}: Error finding container 427516651ee44cfd3a0de76657a9776726db2e4533e5d7bb91037a33976ac227: Status 404 returned error can't find the container with id 427516651ee44cfd3a0de76657a9776726db2e4533e5d7bb91037a33976ac227 Jun 03 13:56:44.657268 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:44.657238 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-hgrmq"] Jun 03 13:56:44.659917 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:44.659882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48760028_2210_41f8_8614_b1bc71497e1b.slice/crio-1da65aa4edac68cad23fb27535f222c3ae96c50915218721a98ee79da903e631 WatchSource:0}: Error finding container 1da65aa4edac68cad23fb27535f222c3ae96c50915218721a98ee79da903e631: Status 404 returned error can't find the container with id 1da65aa4edac68cad23fb27535f222c3ae96c50915218721a98ee79da903e631 Jun 03 13:56:45.060961 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:45.060916 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-hgrmq" event={"ID":"48760028-2210-41f8-8614-b1bc71497e1b","Type":"ContainerStarted","Data":"1da65aa4edac68cad23fb27535f222c3ae96c50915218721a98ee79da903e631"} Jun 03 13:56:45.062298 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:45.062272 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" event={"ID":"af9bb845-3922-4e05-847c-b2d25079d62f","Type":"ContainerStarted","Data":"427516651ee44cfd3a0de76657a9776726db2e4533e5d7bb91037a33976ac227"} Jun 03 13:56:45.063653 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:45.063632 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mgst9" event={"ID":"f0a0ba07-30f6-4093-80d2-6ecfb636d94c","Type":"ContainerStarted","Data":"a52595ed06fcedd2ad6942053040e76a2f61e11b1618f93d2603782c9a7e0186"} Jun 03 13:56:45.063653 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:45.063655 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mgst9" event={"ID":"f0a0ba07-30f6-4093-80d2-6ecfb636d94c","Type":"ContainerStarted","Data":"98380f8bc0daecf898fff0c814e8abfd54a3466f3d7761e0838ad227ab852556"} Jun 03 13:56:45.628664 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:45.628621 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t6mtg" podUID="b32714fb-178b-4bd9-9745-e6b897cce2a4" Jun 03 13:56:46.069871 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:46.069824 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mgst9" event={"ID":"f0a0ba07-30f6-4093-80d2-6ecfb636d94c","Type":"ContainerStarted","Data":"a61a02679d8e906ba13bfa20299a2475dfbac49a1074a8e1e03f27f51532b105"} Jun 03 13:56:47.076639 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.076542 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" event={"ID":"af9bb845-3922-4e05-847c-b2d25079d62f","Type":"ContainerStarted","Data":"2616a6f32f7d60eb8c3e3c2018eef4ca1f12676990178a2b9c1e258525591d52"} Jun 03 13:56:47.077053 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.076812 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:47.078870 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.078841 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mgst9" event={"ID":"f0a0ba07-30f6-4093-80d2-6ecfb636d94c","Type":"ContainerStarted","Data":"d9f663906c6878c876f9cbc71f03d8683ab908363dcf0d1fbf994d0cfb856351"} Jun 03 13:56:47.082643 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.082622 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" Jun 03 13:56:47.092157 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.092107 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-jrnc8" podStartSLOduration=1.608058736 podStartE2EDuration="3.092092968s" podCreationTimestamp="2026-06-03 13:56:44 +0000 UTC" firstStartedPulling="2026-06-03 13:56:44.64482492 +0000 UTC m=+158.620174415" lastFinishedPulling="2026-06-03 13:56:46.128859148 +0000 UTC m=+160.104208647" observedRunningTime="2026-06-03 13:56:47.091498315 +0000 UTC m=+161.066847837" watchObservedRunningTime="2026-06-03 13:56:47.092092968 +0000 UTC m=+161.067442484" Jun 03 13:56:47.129019 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.128992 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:56:47.130946 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.130929 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.140498 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.140470 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 13:56:47.141802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.140843 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xwklm\"" Jun 03 13:56:47.141802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.141158 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 13:56:47.141802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.141286 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 13:56:47.141802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.141378 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 13:56:47.141802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.141516 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 13:56:47.156915 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.156886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.157051 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.156948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.157051 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.156978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.157051 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.157030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.157157 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.157055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nk5k\" (UniqueName: \"kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.157278 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.157229 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:56:47.157528 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.157461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.161366 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.161321 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mgst9" podStartSLOduration=0.854236965 podStartE2EDuration="3.16130917s" podCreationTimestamp="2026-06-03 13:56:44 +0000 UTC" firstStartedPulling="2026-06-03 13:56:44.616836249 +0000 UTC m=+158.592185746" lastFinishedPulling="2026-06-03 13:56:46.923908454 +0000 UTC m=+160.899257951" observedRunningTime="2026-06-03 13:56:47.159871512 +0000 UTC m=+161.135221032" watchObservedRunningTime="2026-06-03 13:56:47.16130917 +0000 UTC m=+161.136658686" Jun 03 13:56:47.258413 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258321 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.258413 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258362 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.258413 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258394 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.258694 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258423 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.258694 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258456 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.258694 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.258480 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nk5k\" (UniqueName: \"kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.259269 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.259184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.259269 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.259187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.259269 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.259187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.261062 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.261035 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.261282 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.261266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.271192 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.271164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nk5k\" (UniqueName: \"kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k\") pod \"console-5b9ddbbb9b-d79np\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.443435 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.443390 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:47.579539 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:47.579505 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:56:47.583358 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:47.583322 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83044be1_f581_4435_a2f0_b26f8c52c20e.slice/crio-bcd5bc43c2e67967e9c384c5fc7d13c57f28b040cf82be78a0f88ca87f501370 WatchSource:0}: Error finding container bcd5bc43c2e67967e9c384c5fc7d13c57f28b040cf82be78a0f88ca87f501370: Status 404 returned error can't find the container with id bcd5bc43c2e67967e9c384c5fc7d13c57f28b040cf82be78a0f88ca87f501370 Jun 03 13:56:48.083109 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:48.083072 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9ddbbb9b-d79np" event={"ID":"83044be1-f581-4435-a2f0-b26f8c52c20e","Type":"ContainerStarted","Data":"bcd5bc43c2e67967e9c384c5fc7d13c57f28b040cf82be78a0f88ca87f501370"} Jun 03 13:56:48.871941 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:48.871897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:56:48.872231 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:48.871959 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:56:48.874951 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:48.874928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3159a48e-b426-4194-bd31-02f50ab6e96e-metrics-tls\") pod \"dns-default-84qm2\" (UID: \"3159a48e-b426-4194-bd31-02f50ab6e96e\") " pod="openshift-dns/dns-default-84qm2" Jun 03 13:56:48.875075 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:48.875011 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86f1366b-dee9-41dd-94a7-3c38f10bd5f0-cert\") pod \"ingress-canary-vrkqc\" (UID: \"86f1366b-dee9-41dd-94a7-3c38f10bd5f0\") " pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:56:49.160374 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:49.160292 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zsshc\"" Jun 03 13:56:49.168478 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:49.168453 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84qm2" Jun 03 13:56:49.327734 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:49.327666 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84qm2"] Jun 03 13:56:49.331598 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:49.331566 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3159a48e_b426_4194_bd31_02f50ab6e96e.slice/crio-5a646ca9e3274f1fa5d1d24212fb553602b5ef657b482b7c1c1d217c4f1f3cb5 WatchSource:0}: Error finding container 5a646ca9e3274f1fa5d1d24212fb553602b5ef657b482b7c1c1d217c4f1f3cb5: Status 404 returned error can't find the container with id 5a646ca9e3274f1fa5d1d24212fb553602b5ef657b482b7c1c1d217c4f1f3cb5 Jun 03 13:56:50.091195 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:50.091133 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84qm2" event={"ID":"3159a48e-b426-4194-bd31-02f50ab6e96e","Type":"ContainerStarted","Data":"5a646ca9e3274f1fa5d1d24212fb553602b5ef657b482b7c1c1d217c4f1f3cb5"} Jun 03 13:56:51.666318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.664885 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5"] Jun 03 13:56:51.668591 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.667949 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.671609 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.671583 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 13:56:51.671883 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.671862 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 13:56:51.672435 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.672415 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 13:56:51.672634 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.672618 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 13:56:51.672858 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.672843 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k7fvm\"" Jun 03 13:56:51.691023 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.690981 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5"] Jun 03 13:56:51.694907 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.694887 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zbkl9"] Jun 03 13:56:51.701986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.701959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.702110 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.702024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7fdbb70-c69c-4669-842a-412288c21439-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.702110 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.702074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.702215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.702129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.702215 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.702156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.702313 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.702231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlhx\" (UniqueName: \"kubernetes.io/projected/f7fdbb70-c69c-4669-842a-412288c21439-kube-api-access-9tlhx\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.704915 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.704892 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.707449 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.707304 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 13:56:51.708097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.707888 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vm544\"" Jun 03 13:56:51.708097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.707934 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 13:56:51.708097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.707887 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 13:56:51.803050 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.802986 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7fdbb70-c69c-4669-842a-412288c21439-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803050 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-sys\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-metrics-client-ca\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803114 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5vh7\" (UniqueName: \"kubernetes.io/projected/389e2a92-97a2-4b52-8102-336a5323cb2f-kube-api-access-t5vh7\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803204 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803229 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803277 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-root\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803310 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlhx\" (UniqueName: \"kubernetes.io/projected/f7fdbb70-c69c-4669-842a-412288c21439-kube-api-access-9tlhx\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-tls\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803392 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-wtmp\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7fdbb70-c69c-4669-842a-412288c21439-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-textfile\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.803488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.803622 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:51.803618 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 13:56:51.804072 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:51.803713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls podName:f7fdbb70-c69c-4669-842a-412288c21439 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:52.303662156 +0000 UTC m=+166.279011654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-vkbc5" (UID: "f7fdbb70-c69c-4669-842a-412288c21439") : secret "kube-state-metrics-tls" not found Jun 03 13:56:51.804176 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.804124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.804296 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.804202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7fdbb70-c69c-4669-842a-412288c21439-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.806443 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.806419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.815691 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.814732 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlhx\" (UniqueName: \"kubernetes.io/projected/f7fdbb70-c69c-4669-842a-412288c21439-kube-api-access-9tlhx\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:51.904518 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904481 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-root\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904693 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904562 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-tls\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904693 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904591 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-wtmp\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904693 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904615 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-textfile\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904693 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904640 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904693 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-root\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904667 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-sys\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904719 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-sys\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904748 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-metrics-client-ca\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904805 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5vh7\" (UniqueName: \"kubernetes.io/projected/389e2a92-97a2-4b52-8102-336a5323cb2f-kube-api-access-t5vh7\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-wtmp\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.904956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.904835 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.905245 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.905098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-textfile\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.905830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.905802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.906146 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.906128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/389e2a92-97a2-4b52-8102-336a5323cb2f-metrics-client-ca\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.908735 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.908712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.910928 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.910893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/389e2a92-97a2-4b52-8102-336a5323cb2f-node-exporter-tls\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:51.913967 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:51.913943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5vh7\" (UniqueName: \"kubernetes.io/projected/389e2a92-97a2-4b52-8102-336a5323cb2f-kube-api-access-t5vh7\") pod \"node-exporter-zbkl9\" (UID: \"389e2a92-97a2-4b52-8102-336a5323cb2f\") " pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:52.018252 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.018216 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbkl9" Jun 03 13:56:52.028956 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:52.028921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389e2a92_97a2_4b52_8102_336a5323cb2f.slice/crio-5ada8464c38ccb57d2fb4f1517834405b5bc6ae18036eed6a444813ef42a437e WatchSource:0}: Error finding container 5ada8464c38ccb57d2fb4f1517834405b5bc6ae18036eed6a444813ef42a437e: Status 404 returned error can't find the container with id 5ada8464c38ccb57d2fb4f1517834405b5bc6ae18036eed6a444813ef42a437e Jun 03 13:56:52.098955 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.098604 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9ddbbb9b-d79np" event={"ID":"83044be1-f581-4435-a2f0-b26f8c52c20e","Type":"ContainerStarted","Data":"13b7e901f66c02d2b1d9c546d35a5f4978ebc534621d3ab3fb899c7141577d25"} Jun 03 13:56:52.101153 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.101127 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84qm2" event={"ID":"3159a48e-b426-4194-bd31-02f50ab6e96e","Type":"ContainerStarted","Data":"0de67b47798aa8afee037d0adfdde0b0ca6023edcf5af1212b2220a93fabe319"} Jun 03 13:56:52.101289 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.101158 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84qm2" event={"ID":"3159a48e-b426-4194-bd31-02f50ab6e96e","Type":"ContainerStarted","Data":"22d4e44d923cfe83e9fbd46c0c065811ad86185770e8f248c9ef273c25bb7622"} Jun 03 13:56:52.101289 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.101273 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-84qm2" Jun 03 13:56:52.103479 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.103456 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbkl9" event={"ID":"389e2a92-97a2-4b52-8102-336a5323cb2f","Type":"ContainerStarted","Data":"5ada8464c38ccb57d2fb4f1517834405b5bc6ae18036eed6a444813ef42a437e"} Jun 03 13:56:52.117910 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.117859 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b9ddbbb9b-d79np" podStartSLOduration=1.191210267 podStartE2EDuration="5.117845457s" podCreationTimestamp="2026-06-03 13:56:47 +0000 UTC" firstStartedPulling="2026-06-03 13:56:47.585706341 +0000 UTC m=+161.561055835" lastFinishedPulling="2026-06-03 13:56:51.512341515 +0000 UTC m=+165.487691025" observedRunningTime="2026-06-03 13:56:52.117445037 +0000 UTC m=+166.092794555" watchObservedRunningTime="2026-06-03 13:56:52.117845457 +0000 UTC m=+166.093194976" Jun 03 13:56:52.134691 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.134628 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-84qm2" podStartSLOduration=129.956176899 podStartE2EDuration="2m12.134616135s" podCreationTimestamp="2026-06-03 13:54:40 +0000 UTC" firstStartedPulling="2026-06-03 13:56:49.334063324 +0000 UTC m=+163.309412823" lastFinishedPulling="2026-06-03 13:56:51.512502549 +0000 UTC m=+165.487852059" observedRunningTime="2026-06-03 13:56:52.134077463 +0000 UTC m=+166.109426999" watchObservedRunningTime="2026-06-03 13:56:52.134616135 +0000 UTC m=+166.109965652" Jun 03 13:56:52.309001 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.308407 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:52.309001 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:52.308555 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 13:56:52.309001 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:52.308627 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls podName:f7fdbb70-c69c-4669-842a-412288c21439 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:53.308608785 +0000 UTC m=+167.283958301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-vkbc5" (UID: "f7fdbb70-c69c-4669-842a-412288c21439") : secret "kube-state-metrics-tls" not found Jun 03 13:56:52.746770 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.746572 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:56:52.750522 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.750499 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.753045 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.753022 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 13:56:52.753254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.753237 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 13:56:52.753436 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.753421 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 13:56:52.753609 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.753591 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 13:56:52.753783 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.753768 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 13:56:52.754145 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.754126 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 13:56:52.754317 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.754293 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 13:56:52.754480 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.754463 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 13:56:52.754694 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.754653 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 13:56:52.755613 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.755363 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ft6k9\"" Jun 03 13:56:52.766030 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.765974 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lwk\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.813957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.814489 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.813969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.814489 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.814019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.814489 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.814047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.814489 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.814091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.814489 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.814124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915170 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915132 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915346 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915200 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915346 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915233 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915346 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915269 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915611 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915573 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915781 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915645 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915781 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915715 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915939 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915785 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915939 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915810 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915939 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915835 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lwk\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915939 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915880 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.915939 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915917 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.916255 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.915971 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.916415 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.916392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.916906 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.916648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.917340 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:52.917273 2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 13:56:52.917607 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.917573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.918034 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:52.917709 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls podName:8697a703-3561-4fd4-9acc-f3b604a5bf2d nodeName:}" failed. No retries permitted until 2026-06-03 13:56:53.417665608 +0000 UTC m=+167.393015104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d") : secret "alertmanager-main-tls" not found Jun 03 13:56:52.919644 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.919595 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.919997 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.919976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.921118 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.921095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.921816 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.921773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.922248 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.922224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.922802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.922439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.922802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.922768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.924379 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.924359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:52.933829 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:52.933787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lwk\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:53.320805 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:53.320771 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:53.331217 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:53.331148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7fdbb70-c69c-4669-842a-412288c21439-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vkbc5\" (UID: \"f7fdbb70-c69c-4669-842a-412288c21439\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:53.422236 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:53.422201 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:53.422419 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:53.422376 2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 13:56:53.422486 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:56:53.422446 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls podName:8697a703-3561-4fd4-9acc-f3b604a5bf2d nodeName:}" failed. No retries permitted until 2026-06-03 13:56:54.422425026 +0000 UTC m=+168.397774527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d") : secret "alertmanager-main-tls" not found Jun 03 13:56:53.495285 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:53.495251 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" Jun 03 13:56:53.641329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:53.641260 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5"] Jun 03 13:56:53.644098 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:53.644066 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fdbb70_c69c_4669_842a_412288c21439.slice/crio-cbbc14216ef4d42bfefac8dd081055ccafef1885ec0d57826ce9d4814db030d1 WatchSource:0}: Error finding container cbbc14216ef4d42bfefac8dd081055ccafef1885ec0d57826ce9d4814db030d1: Status 404 returned error can't find the container with id cbbc14216ef4d42bfefac8dd081055ccafef1885ec0d57826ce9d4814db030d1 Jun 03 13:56:54.111427 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.111393 2581 generic.go:358] "Generic (PLEG): container finished" podID="389e2a92-97a2-4b52-8102-336a5323cb2f" containerID="f492b47e6c455c4f892e5753bffd7a9aff3cfda27615926bc5f9597320d8347c" exitCode=0 Jun 03 13:56:54.111905 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.111471 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbkl9" event={"ID":"389e2a92-97a2-4b52-8102-336a5323cb2f","Type":"ContainerDied","Data":"f492b47e6c455c4f892e5753bffd7a9aff3cfda27615926bc5f9597320d8347c"} Jun 03 13:56:54.112736 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.112701 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" event={"ID":"f7fdbb70-c69c-4669-842a-412288c21439","Type":"ContainerStarted","Data":"cbbc14216ef4d42bfefac8dd081055ccafef1885ec0d57826ce9d4814db030d1"} Jun 03 13:56:54.432754 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.432610 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:54.436501 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.436469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:54.569036 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.568522 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:56:54.784906 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:54.784261 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:56:55.120563 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.120493 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbkl9" event={"ID":"389e2a92-97a2-4b52-8102-336a5323cb2f","Type":"ContainerStarted","Data":"331498500ab1333d70737cf48732920533e29d77601cb8ba2e5a2ec46a330aa2"} Jun 03 13:56:55.120563 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.120533 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbkl9" event={"ID":"389e2a92-97a2-4b52-8102-336a5323cb2f","Type":"ContainerStarted","Data":"939ad51c3c53e1f678f30f860fa71d7f60d6d55910ababd7ccf9281ac7dd8caa"} Jun 03 13:56:55.139487 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.139434 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zbkl9" podStartSLOduration=2.887415222 podStartE2EDuration="4.13941704s" podCreationTimestamp="2026-06-03 13:56:51 +0000 UTC" firstStartedPulling="2026-06-03 13:56:52.031109193 +0000 UTC m=+166.006458732" lastFinishedPulling="2026-06-03 13:56:53.283111041 +0000 UTC m=+167.258460550" observedRunningTime="2026-06-03 13:56:55.138109564 +0000 UTC m=+169.113459081" watchObservedRunningTime="2026-06-03 13:56:55.13941704 +0000 UTC m=+169.114766560" Jun 03 13:56:55.733514 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.731510 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77b9bb4474-tc8jh"] Jun 03 13:56:55.734853 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.734825 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.737582 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.737549 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wjqhl\"" Jun 03 13:56:55.738233 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.737977 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 13:56:55.738233 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.737977 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 13:56:55.738233 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.738050 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 13:56:55.739707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.739316 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 13:56:55.739707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.739486 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 13:56:55.739707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.739579 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9eenaiftvs0rv\"" Jun 03 13:56:55.750697 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.750194 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b9bb4474-tc8jh"] Jun 03 13:56:55.851340 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851533 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851533 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851533 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851533 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93900d0-054e-49f9-8300-35227e68300c-metrics-client-ca\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851788 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851788 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-grpc-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.851788 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.851591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ssg\" (UniqueName: \"kubernetes.io/projected/d93900d0-054e-49f9-8300-35227e68300c-kube-api-access-l9ssg\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953089 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953049 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953294 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953112 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953294 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953145 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93900d0-054e-49f9-8300-35227e68300c-metrics-client-ca\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953294 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953196 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953294 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953221 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-grpc-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953294 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953253 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ssg\" (UniqueName: \"kubernetes.io/projected/d93900d0-054e-49f9-8300-35227e68300c-kube-api-access-l9ssg\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953329 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.953511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.953369 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.955295 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.955220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93900d0-054e-49f9-8300-35227e68300c-metrics-client-ca\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.956599 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.956499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.956722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.956633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.956722 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.956636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.956884 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.956857 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-grpc-tls\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.957013 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.956991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.957170 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.957148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93900d0-054e-49f9-8300-35227e68300c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.970127 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.970099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ssg\" (UniqueName: \"kubernetes.io/projected/d93900d0-054e-49f9-8300-35227e68300c-kube-api-access-l9ssg\") pod \"thanos-querier-77b9bb4474-tc8jh\" (UID: \"d93900d0-054e-49f9-8300-35227e68300c\") " pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:55.975367 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.975342 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j"] Jun 03 13:56:55.979161 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.979138 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:55.982704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.981938 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 13:56:55.982704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.982207 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 13:56:55.982704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.982481 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 13:56:55.982880 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.982723 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 13:56:55.982880 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.982798 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dtk2ivsfp4098\"" Jun 03 13:56:55.982880 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.982873 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rk2r5\"" Jun 03 13:56:55.989084 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:55.989031 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j"] Jun 03 13:56:56.054384 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-tls\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054559 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-client-certs\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054559 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42cc99c8-4497-432c-9434-4093a3784f38-audit-log\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-client-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-metrics-server-audit-profiles\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.054830 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.054704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5bv\" (UniqueName: \"kubernetes.io/projected/42cc99c8-4497-432c-9434-4093a3784f38-kube-api-access-2z5bv\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.057203 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.057162 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:56:56.124790 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.124751 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"c6723989cd73409a112cfbe8bec4624d7a1f365b181544afad5e5cde7699882b"} Jun 03 13:56:56.127042 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.127004 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" event={"ID":"f7fdbb70-c69c-4669-842a-412288c21439","Type":"ContainerStarted","Data":"42911f2a380a42add8ab8c2672899b2290a644be478ab7018bd45c7be3dd4398"} Jun 03 13:56:56.127184 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.127043 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" event={"ID":"f7fdbb70-c69c-4669-842a-412288c21439","Type":"ContainerStarted","Data":"c81ff3f018b5d7ecc38733da81a01680045a670b404910fe4a4b1b663aa9f353"} Jun 03 13:56:56.127184 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.127062 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" event={"ID":"f7fdbb70-c69c-4669-842a-412288c21439","Type":"ContainerStarted","Data":"2bf0d004da7ef57cf685f3b135a08cec20166ffb9c65651cacdc50094ef24d1d"} Jun 03 13:56:56.147282 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.147217 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vkbc5" podStartSLOduration=3.613208969 podStartE2EDuration="5.147194051s" podCreationTimestamp="2026-06-03 13:56:51 +0000 UTC" firstStartedPulling="2026-06-03 13:56:53.646076395 +0000 UTC m=+167.621425902" lastFinishedPulling="2026-06-03 13:56:55.180061489 +0000 UTC m=+169.155410984" observedRunningTime="2026-06-03 13:56:56.145591523 +0000 UTC m=+170.120941042" watchObservedRunningTime="2026-06-03 13:56:56.147194051 +0000 UTC m=+170.122543568" Jun 03 13:56:56.155858 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.155823 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-tls\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156031 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.155923 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-client-certs\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156031 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.155956 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42cc99c8-4497-432c-9434-4093a3784f38-audit-log\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156031 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.155986 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156031 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.156020 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-client-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156713 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.156059 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-metrics-server-audit-profiles\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156713 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.156372 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5bv\" (UniqueName: \"kubernetes.io/projected/42cc99c8-4497-432c-9434-4093a3784f38-kube-api-access-2z5bv\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156713 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.156410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/42cc99c8-4497-432c-9434-4093a3784f38-audit-log\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.156955 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.156850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.157147 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.157093 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/42cc99c8-4497-432c-9434-4093a3784f38-metrics-server-audit-profiles\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.159395 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.159358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-client-ca-bundle\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.159791 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.159766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-client-certs\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.164053 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.164029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/42cc99c8-4497-432c-9434-4093a3784f38-secret-metrics-server-tls\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.167542 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.167496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5bv\" (UniqueName: \"kubernetes.io/projected/42cc99c8-4497-432c-9434-4093a3784f38-kube-api-access-2z5bv\") pod \"metrics-server-7f4ddd7b67-w4c5j\" (UID: \"42cc99c8-4497-432c-9434-4093a3784f38\") " pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.292233 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.292158 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:56:56.480609 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.480364 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b9bb4474-tc8jh"] Jun 03 13:56:56.483750 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:56.483719 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93900d0_054e_49f9_8300_35227e68300c.slice/crio-1a89f61f64abde3ae53c744e14008df419de9a5d408b0f804d17177410c657a4 WatchSource:0}: Error finding container 1a89f61f64abde3ae53c744e14008df419de9a5d408b0f804d17177410c657a4: Status 404 returned error can't find the container with id 1a89f61f64abde3ae53c744e14008df419de9a5d408b0f804d17177410c657a4 Jun 03 13:56:56.672890 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.672847 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j"] Jun 03 13:56:56.676635 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:56.676606 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cc99c8_4497_432c_9434_4093a3784f38.slice/crio-ba8a6c851aa7815a87040b372e88cdeb830fa7ac47174c5806b45f90fa7d2686 WatchSource:0}: Error finding container ba8a6c851aa7815a87040b372e88cdeb830fa7ac47174c5806b45f90fa7d2686: Status 404 returned error can't find the container with id ba8a6c851aa7815a87040b372e88cdeb830fa7ac47174c5806b45f90fa7d2686 Jun 03 13:56:56.886527 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.884720 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85f7494fc6-5mrk7"] Jun 03 13:56:56.888695 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.888644 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.890961 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.890929 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mxj25\"" Jun 03 13:56:56.891116 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.890954 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 13:56:56.891225 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.891116 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 13:56:56.891310 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.891079 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 13:56:56.891310 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.891248 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 13:56:56.892042 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.892021 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 13:56:56.904111 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.903744 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 13:56:56.906828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.905045 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85f7494fc6-5mrk7"] Jun 03 13:56:56.964587 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-metrics-client-ca\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964587 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964800 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964800 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnpw4\" (UniqueName: \"kubernetes.io/projected/8155eda0-ff26-4d49-b590-ab3311a532cf-kube-api-access-nnpw4\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964800 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964800 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-serving-certs-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964943 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:56.964943 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:56.964835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-federate-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065514 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-serving-certs-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065576 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065601 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-federate-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065646 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-metrics-client-ca\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065739 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065769 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065799 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnpw4\" (UniqueName: \"kubernetes.io/projected/8155eda0-ff26-4d49-b590-ab3311a532cf-kube-api-access-nnpw4\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.065838 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.066580 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.066365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-serving-certs-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.067446 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.067387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.067947 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.067924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155eda0-ff26-4d49-b590-ab3311a532cf-metrics-client-ca\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.069109 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.069061 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.069571 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.069549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-secret-telemeter-client\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.069772 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.069708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-federate-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.071018 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.070997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8155eda0-ff26-4d49-b590-ab3311a532cf-telemeter-client-tls\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.075707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.075124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnpw4\" (UniqueName: \"kubernetes.io/projected/8155eda0-ff26-4d49-b590-ab3311a532cf-kube-api-access-nnpw4\") pod \"telemeter-client-85f7494fc6-5mrk7\" (UID: \"8155eda0-ff26-4d49-b590-ab3311a532cf\") " pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.131576 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.131519 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" event={"ID":"42cc99c8-4497-432c-9434-4093a3784f38","Type":"ContainerStarted","Data":"ba8a6c851aa7815a87040b372e88cdeb830fa7ac47174c5806b45f90fa7d2686"} Jun 03 13:56:57.133034 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.132991 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"1a89f61f64abde3ae53c744e14008df419de9a5d408b0f804d17177410c657a4"} Jun 03 13:56:57.134834 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.134464 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef" exitCode=0 Jun 03 13:56:57.134834 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.134704 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef"} Jun 03 13:56:57.202432 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.202398 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" Jun 03 13:56:57.374833 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.374789 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85f7494fc6-5mrk7"] Jun 03 13:56:57.378706 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:56:57.378647 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8155eda0_ff26_4d49_b590_ab3311a532cf.slice/crio-743099a2da02936aaae9f6032564764f54135a5fc93e7a10e3d8035e361f36f4 WatchSource:0}: Error finding container 743099a2da02936aaae9f6032564764f54135a5fc93e7a10e3d8035e361f36f4: Status 404 returned error can't find the container with id 743099a2da02936aaae9f6032564764f54135a5fc93e7a10e3d8035e361f36f4 Jun 03 13:56:57.445659 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.444457 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:57.445659 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.445410 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:57.451871 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.451838 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:57.615788 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.615753 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:56:57.618253 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.618228 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gxcmr\"" Jun 03 13:56:57.626949 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.626474 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrkqc" Jun 03 13:56:57.904525 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.904192 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:56:57.907763 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.907732 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.910267 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910238 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 13:56:57.910411 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910299 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 13:56:57.910411 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910389 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 13:56:57.910574 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910558 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 13:56:57.910574 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910565 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 13:56:57.910828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910789 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 13:56:57.910936 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.910908 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 13:56:57.913855 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.913109 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 13:56:57.913855 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.913115 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 13:56:57.913855 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.913550 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6q6ml\"" Jun 03 13:56:57.913855 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.913703 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 13:56:57.913855 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.913816 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 13:56:57.914166 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.914062 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7m2eljnpsu8gg\"" Jun 03 13:56:57.919176 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.919155 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 13:56:57.926407 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.926380 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:56:57.976652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976857 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976857 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976952 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976952 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.976952 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.976943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977065 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977116 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977116 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mv5\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977327 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977370 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977370 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:57.977453 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:57.977404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078527 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078488 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078539 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078574 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078609 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078636 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078664 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.078745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078730 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078763 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078788 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078814 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078852 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078879 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078909 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078931 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078948 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.078968 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mv5\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.079011 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079048 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.079045 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079744 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.079442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.079744 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.079445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.080324 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.079993 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.081188 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.080549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.081188 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.080862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.082568 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.082245 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.082895 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.082871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.083755 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.083403 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.084330 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.083977 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.086022 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.085990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.086022 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.085991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.086336 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.086315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.086417 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.086377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.086662 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.086623 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.087015 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.086980 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.087089 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.087024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.087412 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.087389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.092221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.092201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mv5\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5\") pod \"prometheus-k8s-0\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:58.139380 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.139344 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" event={"ID":"8155eda0-ff26-4d49-b590-ab3311a532cf","Type":"ContainerStarted","Data":"743099a2da02936aaae9f6032564764f54135a5fc93e7a10e3d8035e361f36f4"} Jun 03 13:56:58.144462 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.144436 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:56:58.221981 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:58.221893 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:56:59.615299 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:56:59.615259 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:57:02.109638 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:02.109603 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-84qm2" Jun 03 13:57:06.261054 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:06.260965 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:57:06.281865 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:06.281800 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrkqc"] Jun 03 13:57:06.874803 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:57:06.869720 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f1366b_dee9_41dd_94a7_3c38f10bd5f0.slice/crio-b1774dde618d9f0580b8a368b0b43b0a9e9147d582bcc9dceacc79d65c3918e4 WatchSource:0}: Error finding container b1774dde618d9f0580b8a368b0b43b0a9e9147d582bcc9dceacc79d65c3918e4: Status 404 returned error can't find the container with id b1774dde618d9f0580b8a368b0b43b0a9e9147d582bcc9dceacc79d65c3918e4 Jun 03 13:57:06.874803 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:57:06.871099 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a66ad66_22b6_40bb_bf08_4892f61ab61f.slice/crio-52a3958f12dc517e373e023378f5e801cac01c45a23d610057a291e3413c1239 WatchSource:0}: Error finding container 52a3958f12dc517e373e023378f5e801cac01c45a23d610057a291e3413c1239: Status 404 returned error can't find the container with id 52a3958f12dc517e373e023378f5e801cac01c45a23d610057a291e3413c1239 Jun 03 13:57:07.107057 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.107013 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:57:07.187030 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.184860 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-hgrmq" event={"ID":"48760028-2210-41f8-8614-b1bc71497e1b","Type":"ContainerStarted","Data":"113f7d0a7bbcea7045b64820f12e08608089a6a9c818bed7f32697053534554c"} Jun 03 13:57:07.187030 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.185190 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:57:07.189195 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.189139 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" event={"ID":"42cc99c8-4497-432c-9434-4093a3784f38","Type":"ContainerStarted","Data":"f7d0959e3347d58c4dcd74131c5a20183b9386955c3872fb5f552c1071c2fe51"} Jun 03 13:57:07.191361 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.191253 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"71bfe430a793d12684957aa80f98cb5f6ef91d995db97316b9b8b06ea3debd9f"} Jun 03 13:57:07.191361 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.191286 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"d0af6e74ddaa777b624d2a84bf742c98c506570d7c085f968d520ed2b3247eea"} Jun 03 13:57:07.191361 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.191305 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"62d1fc2b380b9a8ef82fa48fd4bad3b3a08bcd06cb8d6454d1730cfed2e87ac5"} Jun 03 13:57:07.195835 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.193322 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" event={"ID":"8155eda0-ff26-4d49-b590-ab3311a532cf","Type":"ContainerStarted","Data":"af1cb1465d4dceeb2ff1a753fecbc47654a12350f2808529ce512c2d8c79afa7"} Jun 03 13:57:07.195835 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.195178 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="ec874790c0c2fd455d8026e98f81d6db80c68f76de75d233cad8819027bbf121" exitCode=0 Jun 03 13:57:07.195835 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.195326 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"ec874790c0c2fd455d8026e98f81d6db80c68f76de75d233cad8819027bbf121"} Jun 03 13:57:07.195835 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.195352 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"52a3958f12dc517e373e023378f5e801cac01c45a23d610057a291e3413c1239"} Jun 03 13:57:07.197104 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.197082 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-hgrmq" Jun 03 13:57:07.198199 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.198146 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrkqc" event={"ID":"86f1366b-dee9-41dd-94a7-3c38f10bd5f0","Type":"ContainerStarted","Data":"b1774dde618d9f0580b8a368b0b43b0a9e9147d582bcc9dceacc79d65c3918e4"} Jun 03 13:57:07.201658 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.201590 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1"} Jun 03 13:57:07.201658 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.201614 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9"} Jun 03 13:57:07.201658 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.201630 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6"} Jun 03 13:57:07.208002 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:07.207952 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-hgrmq" podStartSLOduration=1.798881859 podStartE2EDuration="23.207938235s" podCreationTimestamp="2026-06-03 13:56:44 +0000 UTC" firstStartedPulling="2026-06-03 13:56:44.661632644 +0000 UTC m=+158.636982141" lastFinishedPulling="2026-06-03 13:57:06.070689017 +0000 UTC m=+180.046038517" observedRunningTime="2026-06-03 13:57:07.205181774 +0000 UTC m=+181.180531291" watchObservedRunningTime="2026-06-03 13:57:07.207938235 +0000 UTC m=+181.183287752" Jun 03 13:57:08.210714 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.210648 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" event={"ID":"8155eda0-ff26-4d49-b590-ab3311a532cf","Type":"ContainerStarted","Data":"b3a05576d4bae73044238c37fb2496cab30cfcd9e095c65fafaa48e6b6d22dfc"} Jun 03 13:57:08.211247 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.210722 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" event={"ID":"8155eda0-ff26-4d49-b590-ab3311a532cf","Type":"ContainerStarted","Data":"990e3204eebc041734ac7ebfec2711a84e3341a0fdd1fdc7f012c5d80cea76aa"} Jun 03 13:57:08.216707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.216289 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63"} Jun 03 13:57:08.216707 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.216323 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9"} Jun 03 13:57:08.237724 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.236738 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" podStartSLOduration=3.843515967 podStartE2EDuration="13.236714186s" podCreationTimestamp="2026-06-03 13:56:55 +0000 UTC" firstStartedPulling="2026-06-03 13:56:56.67885876 +0000 UTC m=+170.654208260" lastFinishedPulling="2026-06-03 13:57:06.072056983 +0000 UTC m=+180.047406479" observedRunningTime="2026-06-03 13:57:07.283468932 +0000 UTC m=+181.258818449" watchObservedRunningTime="2026-06-03 13:57:08.236714186 +0000 UTC m=+182.212063709" Jun 03 13:57:08.238202 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:08.238160 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85f7494fc6-5mrk7" podStartSLOduration=2.650366757 podStartE2EDuration="12.238147186s" podCreationTimestamp="2026-06-03 13:56:56 +0000 UTC" firstStartedPulling="2026-06-03 13:56:57.381215269 +0000 UTC m=+171.356564773" lastFinishedPulling="2026-06-03 13:57:06.968995692 +0000 UTC m=+180.944345202" observedRunningTime="2026-06-03 13:57:08.234859461 +0000 UTC m=+182.210208980" watchObservedRunningTime="2026-06-03 13:57:08.238147186 +0000 UTC m=+182.213496704" Jun 03 13:57:12.239615 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.239573 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"11ec439b2acf6102193660cc62b381fe214d819cfa4159ebceeba117add18685"} Jun 03 13:57:12.240076 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.239625 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"c59095aa9ea6bd02aa2924b0cc2def18d36e894d343327f98a82bd0030769faf"} Jun 03 13:57:12.240076 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.239642 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" event={"ID":"d93900d0-054e-49f9-8300-35227e68300c","Type":"ContainerStarted","Data":"289563e5d20a4776308fdbce6a681d6dcaf25d01ac77fac13c6b095751f65c34"} Jun 03 13:57:12.240631 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.240589 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:57:12.245558 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.245528 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"99bcc88e798d6b4c81d2a8b70f206772de25982f5a9dfceb1a7aef96ac643520"} Jun 03 13:57:12.245732 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.245564 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"e34d54a600162455ae721197b55f507d37c42956d805a1551b2c2c295c176655"} Jun 03 13:57:12.245732 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.245574 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"4cc282308484beee1626bcf9995ff04b6484817c4c083517ae191c2722ef0936"} Jun 03 13:57:12.245732 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.245604 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"beeefbe15b5e9a71fab54d5dd81dd09f7c67fd00c377ccdb5def99b3932ce833"} Jun 03 13:57:12.245732 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.245619 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"6922a1935d55ee8e418af6be6330cbdc2d4040f34e9eab2b443b3ad9b50452fe"} Jun 03 13:57:12.247093 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.247069 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" Jun 03 13:57:12.247748 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.247722 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrkqc" event={"ID":"86f1366b-dee9-41dd-94a7-3c38f10bd5f0","Type":"ContainerStarted","Data":"4feaea1a8a509df867588bebfb0a8d0005c9bed36db1af5b4927fba68c8df7e9"} Jun 03 13:57:12.251758 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.251726 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerStarted","Data":"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94"} Jun 03 13:57:12.263628 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.261944 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77b9bb4474-tc8jh" podStartSLOduration=4.998138086 podStartE2EDuration="17.261926813s" podCreationTimestamp="2026-06-03 13:56:55 +0000 UTC" firstStartedPulling="2026-06-03 13:56:56.486393993 +0000 UTC m=+170.461743493" lastFinishedPulling="2026-06-03 13:57:08.750182721 +0000 UTC m=+182.725532220" observedRunningTime="2026-06-03 13:57:12.261557211 +0000 UTC m=+186.236906729" watchObservedRunningTime="2026-06-03 13:57:12.261926813 +0000 UTC m=+186.237276331" Jun 03 13:57:12.277573 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.277515 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vrkqc" podStartSLOduration=147.757133996 podStartE2EDuration="2m32.277499335s" podCreationTimestamp="2026-06-03 13:54:40 +0000 UTC" firstStartedPulling="2026-06-03 13:57:06.872995681 +0000 UTC m=+180.848345179" lastFinishedPulling="2026-06-03 13:57:11.393361009 +0000 UTC m=+185.368710518" observedRunningTime="2026-06-03 13:57:12.276790605 +0000 UTC m=+186.252140123" watchObservedRunningTime="2026-06-03 13:57:12.277499335 +0000 UTC m=+186.252848858" Jun 03 13:57:12.330653 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:12.330591 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.724870062 podStartE2EDuration="20.33057361s" podCreationTimestamp="2026-06-03 13:56:52 +0000 UTC" firstStartedPulling="2026-06-03 13:56:55.147396409 +0000 UTC m=+169.122745911" lastFinishedPulling="2026-06-03 13:57:08.753099961 +0000 UTC m=+182.728449459" observedRunningTime="2026-06-03 13:57:12.326555984 +0000 UTC m=+186.301905514" watchObservedRunningTime="2026-06-03 13:57:12.33057361 +0000 UTC m=+186.305923183" Jun 03 13:57:13.260454 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:13.260404 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerStarted","Data":"a2bcfed6671dfb3c07b69e60b709ae23d42def868b680b6b1414d5acc675b296"} Jun 03 13:57:13.289184 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:13.288966 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.080007209 podStartE2EDuration="16.288945749s" podCreationTimestamp="2026-06-03 13:56:57 +0000 UTC" firstStartedPulling="2026-06-03 13:57:07.197183701 +0000 UTC m=+181.172533210" lastFinishedPulling="2026-06-03 13:57:11.406122248 +0000 UTC m=+185.381471750" observedRunningTime="2026-06-03 13:57:13.287743726 +0000 UTC m=+187.263093245" watchObservedRunningTime="2026-06-03 13:57:13.288945749 +0000 UTC m=+187.264295268" Jun 03 13:57:16.293278 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:16.293241 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:57:16.293768 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:16.293297 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:57:18.222960 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:18.222921 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:57:25.299172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:25.299141 2581 generic.go:358] "Generic (PLEG): container finished" podID="ef320e45-577f-423d-81b8-dc66cd0dc66e" containerID="f2b919cea1376c6efad5216fc22b58e424a0f8fbe2597492ccbae9080b15f9e7" exitCode=0 Jun 03 13:57:25.299652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:25.299185 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9kwns" event={"ID":"ef320e45-577f-423d-81b8-dc66cd0dc66e","Type":"ContainerDied","Data":"f2b919cea1376c6efad5216fc22b58e424a0f8fbe2597492ccbae9080b15f9e7"} Jun 03 13:57:25.299893 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:25.299874 2581 scope.go:117] "RemoveContainer" containerID="f2b919cea1376c6efad5216fc22b58e424a0f8fbe2597492ccbae9080b15f9e7" Jun 03 13:57:26.305776 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:26.305744 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9kwns" event={"ID":"ef320e45-577f-423d-81b8-dc66cd0dc66e","Type":"ContainerStarted","Data":"40fe646299a72ce4a78cd546d7c982897f7cc423300b48193a97ae31bab352d7"} Jun 03 13:57:30.320402 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:30.320361 2581 generic.go:358] "Generic (PLEG): container finished" podID="bb03a9e9-364d-4ed3-8cca-b95560ac708e" containerID="347bf5c1d852870e5d88c3ac156de8cd40efc14414bea80a5538b1cbd074dd1b" exitCode=0 Jun 03 13:57:30.320803 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:30.320433 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" event={"ID":"bb03a9e9-364d-4ed3-8cca-b95560ac708e","Type":"ContainerDied","Data":"347bf5c1d852870e5d88c3ac156de8cd40efc14414bea80a5538b1cbd074dd1b"} Jun 03 13:57:30.320803 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:30.320752 2581 scope.go:117] "RemoveContainer" containerID="347bf5c1d852870e5d88c3ac156de8cd40efc14414bea80a5538b1cbd074dd1b" Jun 03 13:57:31.325500 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:31.325463 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9qgg5" event={"ID":"bb03a9e9-364d-4ed3-8cca-b95560ac708e","Type":"ContainerStarted","Data":"e21383a495f194518b41a4a1890333d050e13501ac0858cb2321f92ab2b71d83"} Jun 03 13:57:32.134596 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.134531 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b9ddbbb9b-d79np" podUID="83044be1-f581-4435-a2f0-b26f8c52c20e" containerName="console" containerID="cri-o://13b7e901f66c02d2b1d9c546d35a5f4978ebc534621d3ab3fb899c7141577d25" gracePeriod=15 Jun 03 13:57:32.330994 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.330970 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9ddbbb9b-d79np_83044be1-f581-4435-a2f0-b26f8c52c20e/console/0.log" Jun 03 13:57:32.331424 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.331008 2581 generic.go:358] "Generic (PLEG): container finished" podID="83044be1-f581-4435-a2f0-b26f8c52c20e" containerID="13b7e901f66c02d2b1d9c546d35a5f4978ebc534621d3ab3fb899c7141577d25" exitCode=2 Jun 03 13:57:32.331424 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.331045 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9ddbbb9b-d79np" event={"ID":"83044be1-f581-4435-a2f0-b26f8c52c20e","Type":"ContainerDied","Data":"13b7e901f66c02d2b1d9c546d35a5f4978ebc534621d3ab3fb899c7141577d25"} Jun 03 13:57:32.407577 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.407553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9ddbbb9b-d79np_83044be1-f581-4435-a2f0-b26f8c52c20e/console/0.log" Jun 03 13:57:32.407711 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.407631 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:57:32.514350 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514312 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514363 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514386 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514422 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514494 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514465 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nk5k\" (UniqueName: \"kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514709 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514514 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config\") pod \"83044be1-f581-4435-a2f0-b26f8c52c20e\" (UID: \"83044be1-f581-4435-a2f0-b26f8c52c20e\") " Jun 03 13:57:32.514935 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514915 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config" (OuterVolumeSpecName: "console-config") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:32.515009 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.514910 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:32.515064 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.515029 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca" (OuterVolumeSpecName: "service-ca") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:32.517008 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.516969 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:32.517121 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.517033 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k" (OuterVolumeSpecName: "kube-api-access-6nk5k") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "kube-api-access-6nk5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:57:32.517121 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.517065 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83044be1-f581-4435-a2f0-b26f8c52c20e" (UID: "83044be1-f581-4435-a2f0-b26f8c52c20e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:32.615745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615708 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-oauth-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:32.615745 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615740 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-oauth-serving-cert\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:32.615968 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615757 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-console-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:32.615968 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615770 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83044be1-f581-4435-a2f0-b26f8c52c20e-service-ca\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:32.615968 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615781 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83044be1-f581-4435-a2f0-b26f8c52c20e-console-serving-cert\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:32.615968 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:32.615800 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nk5k\" (UniqueName: \"kubernetes.io/projected/83044be1-f581-4435-a2f0-b26f8c52c20e-kube-api-access-6nk5k\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:57:33.336138 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.336112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9ddbbb9b-d79np_83044be1-f581-4435-a2f0-b26f8c52c20e/console/0.log" Jun 03 13:57:33.336581 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.336177 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9ddbbb9b-d79np" event={"ID":"83044be1-f581-4435-a2f0-b26f8c52c20e","Type":"ContainerDied","Data":"bcd5bc43c2e67967e9c384c5fc7d13c57f28b040cf82be78a0f88ca87f501370"} Jun 03 13:57:33.336581 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.336218 2581 scope.go:117] "RemoveContainer" containerID="13b7e901f66c02d2b1d9c546d35a5f4978ebc534621d3ab3fb899c7141577d25" Jun 03 13:57:33.336581 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.336221 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9ddbbb9b-d79np" Jun 03 13:57:33.352551 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.352525 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:57:33.356575 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:33.356551 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b9ddbbb9b-d79np"] Jun 03 13:57:34.620101 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:34.620071 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83044be1-f581-4435-a2f0-b26f8c52c20e" path="/var/lib/kubelet/pods/83044be1-f581-4435-a2f0-b26f8c52c20e/volumes" Jun 03 13:57:36.298652 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:36.298624 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:57:36.302704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:36.302652 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f4ddd7b67-w4c5j" Jun 03 13:57:58.222709 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:58.222658 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:57:58.243143 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:58.243119 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:57:58.441567 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:57:58.441543 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:12.038307 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038271 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:12.038854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038666 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="alertmanager" containerID="cri-o://e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" gracePeriod=120 Jun 03 13:58:12.038854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038755 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-metric" containerID="cri-o://844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" gracePeriod=120 Jun 03 13:58:12.038854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038789 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-web" containerID="cri-o://a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" gracePeriod=120 Jun 03 13:58:12.038854 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038836 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="config-reloader" containerID="cri-o://9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" gracePeriod=120 Jun 03 13:58:12.039104 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.038849 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy" containerID="cri-o://4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" gracePeriod=120 Jun 03 13:58:12.039712 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.039009 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="prom-label-proxy" containerID="cri-o://eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" gracePeriod=120 Jun 03 13:58:12.470665 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470627 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" exitCode=0 Jun 03 13:58:12.470665 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470653 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" exitCode=0 Jun 03 13:58:12.470665 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470662 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" exitCode=0 Jun 03 13:58:12.470665 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470684 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" exitCode=0 Jun 03 13:58:12.470945 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470708 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94"} Jun 03 13:58:12.470945 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470745 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9"} Jun 03 13:58:12.470945 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470757 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9"} Jun 03 13:58:12.470945 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:12.470766 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6"} Jun 03 13:58:13.268998 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.268975 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.386181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386096 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386147 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386178 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386195 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386211 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386232 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386440 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386263 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386738 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386644 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:58:13.386738 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386719 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386897 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386792 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386897 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386823 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.386897 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386853 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.387034 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386902 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.387034 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.386934 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8lwk\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk\") pod \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\" (UID: \"8697a703-3561-4fd4-9acc-f3b604a5bf2d\") " Jun 03 13:58:13.387393 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.387247 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-main-db\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.389573 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.389282 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.389697 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.389637 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:13.389697 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.389642 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.389880 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.389665 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume" (OuterVolumeSpecName: "config-volume") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.390098 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.390026 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:13.390098 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.390090 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:13.390511 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.390483 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.390735 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.390708 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk" (OuterVolumeSpecName: "kube-api-access-r8lwk") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "kube-api-access-r8lwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:13.391667 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.391642 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out" (OuterVolumeSpecName: "config-out") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:58:13.391799 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.391779 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.394986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.394936 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.402097 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.402074 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config" (OuterVolumeSpecName: "web-config") pod "8697a703-3561-4fd4-9acc-f3b604a5bf2d" (UID: "8697a703-3561-4fd4-9acc-f3b604a5bf2d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:13.476974 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.476911 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" exitCode=0 Jun 03 13:58:13.476974 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.476975 2581 generic.go:358] "Generic (PLEG): container finished" podID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerID="a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" exitCode=0 Jun 03 13:58:13.477221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.476987 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63"} Jun 03 13:58:13.477221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.477022 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.477221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.477038 2581 scope.go:117] "RemoveContainer" containerID="eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" Jun 03 13:58:13.477221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.477028 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1"} Jun 03 13:58:13.477221 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.477162 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8697a703-3561-4fd4-9acc-f3b604a5bf2d","Type":"ContainerDied","Data":"c6723989cd73409a112cfbe8bec4624d7a1f365b181544afad5e5cde7699882b"} Jun 03 13:58:13.485129 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.485109 2581 scope.go:117] "RemoveContainer" containerID="844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" Jun 03 13:58:13.488529 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488510 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-metrics-client-ca\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488533 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488542 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488580 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-out\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488589 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8lwk\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-kube-api-access-r8lwk\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488597 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-web-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488606 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488612 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488615 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-config-volume\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488891 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488624 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-cluster-tls-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488891 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488633 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8697a703-3561-4fd4-9acc-f3b604a5bf2d-secret-alertmanager-main-tls\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488891 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488641 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8697a703-3561-4fd4-9acc-f3b604a5bf2d-tls-assets\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.488891 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.488665 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8697a703-3561-4fd4-9acc-f3b604a5bf2d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:13.492345 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.492329 2581 scope.go:117] "RemoveContainer" containerID="4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" Jun 03 13:58:13.499465 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.499431 2581 scope.go:117] "RemoveContainer" containerID="a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" Jun 03 13:58:13.501025 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.501004 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:13.506747 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.506706 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:13.506805 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.506767 2581 scope.go:117] "RemoveContainer" containerID="9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" Jun 03 13:58:13.513844 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.513822 2581 scope.go:117] "RemoveContainer" containerID="e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" Jun 03 13:58:13.521580 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.521561 2581 scope.go:117] "RemoveContainer" containerID="5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef" Jun 03 13:58:13.528520 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.528501 2581 scope.go:117] "RemoveContainer" containerID="eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" Jun 03 13:58:13.528802 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.528782 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94\": container with ID starting with eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94 not found: ID does not exist" containerID="eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" Jun 03 13:58:13.528872 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.528813 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94"} err="failed to get container status \"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94\": rpc error: code = NotFound desc = could not find container \"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94\": container with ID starting with eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94 not found: ID does not exist" Jun 03 13:58:13.528872 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.528856 2581 scope.go:117] "RemoveContainer" containerID="844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" Jun 03 13:58:13.529119 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.529101 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63\": container with ID starting with 844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63 not found: ID does not exist" containerID="844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" Jun 03 13:58:13.529185 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529127 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63"} err="failed to get container status \"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63\": rpc error: code = NotFound desc = could not find container \"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63\": container with ID starting with 844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63 not found: ID does not exist" Jun 03 13:58:13.529185 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529151 2581 scope.go:117] "RemoveContainer" containerID="4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" Jun 03 13:58:13.529386 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.529360 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9\": container with ID starting with 4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9 not found: ID does not exist" containerID="4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" Jun 03 13:58:13.529429 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529383 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9"} err="failed to get container status \"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9\": rpc error: code = NotFound desc = could not find container \"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9\": container with ID starting with 4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9 not found: ID does not exist" Jun 03 13:58:13.529429 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529400 2581 scope.go:117] "RemoveContainer" containerID="a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" Jun 03 13:58:13.529639 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.529622 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1\": container with ID starting with a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1 not found: ID does not exist" containerID="a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" Jun 03 13:58:13.529704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529653 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1"} err="failed to get container status \"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1\": rpc error: code = NotFound desc = could not find container \"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1\": container with ID starting with a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1 not found: ID does not exist" Jun 03 13:58:13.529704 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529690 2581 scope.go:117] "RemoveContainer" containerID="9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" Jun 03 13:58:13.529968 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.529951 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9\": container with ID starting with 9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9 not found: ID does not exist" containerID="9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" Jun 03 13:58:13.530083 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529975 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9"} err="failed to get container status \"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9\": rpc error: code = NotFound desc = could not find container \"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9\": container with ID starting with 9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9 not found: ID does not exist" Jun 03 13:58:13.530083 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.529997 2581 scope.go:117] "RemoveContainer" containerID="e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" Jun 03 13:58:13.530201 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.530186 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6\": container with ID starting with e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6 not found: ID does not exist" containerID="e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" Jun 03 13:58:13.530235 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530205 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6"} err="failed to get container status \"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6\": rpc error: code = NotFound desc = could not find container \"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6\": container with ID starting with e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6 not found: ID does not exist" Jun 03 13:58:13.530235 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530218 2581 scope.go:117] "RemoveContainer" containerID="5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef" Jun 03 13:58:13.530423 ip-10-0-136-17 kubenswrapper[2581]: E0603 13:58:13.530407 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef\": container with ID starting with 5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef not found: ID does not exist" containerID="5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef" Jun 03 13:58:13.530463 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530429 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef"} err="failed to get container status \"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef\": rpc error: code = NotFound desc = could not find container \"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef\": container with ID starting with 5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef not found: ID does not exist" Jun 03 13:58:13.530463 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530443 2581 scope.go:117] "RemoveContainer" containerID="eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94" Jun 03 13:58:13.530643 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530624 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94"} err="failed to get container status \"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94\": rpc error: code = NotFound desc = could not find container \"eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94\": container with ID starting with eac45e79ae8353ca8493b80f2401cf90533dba326e9415269ec088302f6d2f94 not found: ID does not exist" Jun 03 13:58:13.530643 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530642 2581 scope.go:117] "RemoveContainer" containerID="844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63" Jun 03 13:58:13.530920 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530901 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63"} err="failed to get container status \"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63\": rpc error: code = NotFound desc = could not find container \"844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63\": container with ID starting with 844b49f7e7e10463fa5263ad573275e409e259707e0e52d03007849461a73e63 not found: ID does not exist" Jun 03 13:58:13.530973 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.530921 2581 scope.go:117] "RemoveContainer" containerID="4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9" Jun 03 13:58:13.531310 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531287 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9"} err="failed to get container status \"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9\": rpc error: code = NotFound desc = could not find container \"4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9\": container with ID starting with 4460849c2fb68f8b3898c6122d089697b570602ab7ecb14e41bd42d7cc346ab9 not found: ID does not exist" Jun 03 13:58:13.531391 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531311 2581 scope.go:117] "RemoveContainer" containerID="a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1" Jun 03 13:58:13.531607 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531585 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1"} err="failed to get container status \"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1\": rpc error: code = NotFound desc = could not find container \"a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1\": container with ID starting with a4c70bfb75d863c96c2aec51163e059b7cfb81f1e848b285d2e98f3b40cc1bc1 not found: ID does not exist" Jun 03 13:58:13.531685 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531610 2581 scope.go:117] "RemoveContainer" containerID="9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9" Jun 03 13:58:13.531944 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531916 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9"} err="failed to get container status \"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9\": rpc error: code = NotFound desc = could not find container \"9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9\": container with ID starting with 9edf41aa8a913857b2587d91b8da0da651540640e580bcce384fd6b9584597c9 not found: ID does not exist" Jun 03 13:58:13.531944 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.531942 2581 scope.go:117] "RemoveContainer" containerID="e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6" Jun 03 13:58:13.532186 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.532168 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6"} err="failed to get container status \"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6\": rpc error: code = NotFound desc = could not find container \"e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6\": container with ID starting with e70ecca7f5f912b16a808152534df2a09e6e77c2481ded526e74ee08015d98b6 not found: ID does not exist" Jun 03 13:58:13.532186 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.532186 2581 scope.go:117] "RemoveContainer" containerID="5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef" Jun 03 13:58:13.532387 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.532369 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef"} err="failed to get container status \"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef\": rpc error: code = NotFound desc = could not find container \"5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef\": container with ID starting with 5ce9c90ecaab81d695be0ca8647ecb190f80d8e30705e8ed752c6ce380d567ef not found: ID does not exist" Jun 03 13:58:13.540957 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.540935 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:13.541280 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541267 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="config-reloader" Jun 03 13:58:13.541329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541282 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="config-reloader" Jun 03 13:58:13.541329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541295 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="prom-label-proxy" Jun 03 13:58:13.541329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541302 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="prom-label-proxy" Jun 03 13:58:13.541329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541318 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83044be1-f581-4435-a2f0-b26f8c52c20e" containerName="console" Jun 03 13:58:13.541329 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541324 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="83044be1-f581-4435-a2f0-b26f8c52c20e" containerName="console" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541332 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="alertmanager" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541337 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="alertmanager" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541343 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-metric" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541348 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-metric" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541355 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="init-config-reloader" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541361 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="init-config-reloader" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541373 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541380 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541392 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-web" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541397 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-web" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541445 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="config-reloader" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541452 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-metric" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541464 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="83044be1-f581-4435-a2f0-b26f8c52c20e" containerName="console" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541471 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="alertmanager" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541478 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541485 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="prom-label-proxy" Jun 03 13:58:13.541517 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.541492 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" containerName="kube-rbac-proxy-web" Jun 03 13:58:13.545327 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.545301 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.547791 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.547774 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 13:58:13.548081 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548051 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 13:58:13.548179 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548083 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 13:58:13.548179 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548168 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 13:58:13.548401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548212 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 13:58:13.548401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548293 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 13:58:13.548401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548303 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 13:58:13.548651 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548637 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 13:58:13.548765 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.548747 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ft6k9\"" Jun 03 13:58:13.555735 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.555717 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 13:58:13.564045 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.564022 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:13.589771 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.589890 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.589890 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.589890 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vbn5\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-kube-api-access-7vbn5\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.589890 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-config-volume\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590041 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590041 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590041 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.589960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590041 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.590015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-web-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.590046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.590074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-config-out\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.590106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.590172 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.590123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691060 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.690973 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691060 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691011 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691060 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691034 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vbn5\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-kube-api-access-7vbn5\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691060 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691058 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-config-volume\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691074 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691118 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691136 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691159 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-web-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691188 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691226 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-config-out\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691290 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691314 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.691373 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691363 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.692008 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.691984 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.692180 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.692151 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.692401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.692376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/862850a7-169c-4cba-82b4-10d0932d861f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.694696 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.694657 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-config-volume\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.694927 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.694909 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/862850a7-169c-4cba-82b4-10d0932d861f-config-out\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695027 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.694999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695087 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.695049 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695141 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.695058 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695141 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.695132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695365 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.695349 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.695468 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.695445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.696094 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.696079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/862850a7-169c-4cba-82b4-10d0932d861f-web-config\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.700332 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.700315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vbn5\" (UniqueName: \"kubernetes.io/projected/862850a7-169c-4cba-82b4-10d0932d861f-kube-api-access-7vbn5\") pod \"alertmanager-main-0\" (UID: \"862850a7-169c-4cba-82b4-10d0932d861f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.855176 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.855140 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 13:58:13.994765 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:13.994662 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 13:58:13.998545 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:58:13.998517 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862850a7_169c_4cba_82b4_10d0932d861f.slice/crio-0bab531b8813a166b211b46c70cec47af49d0cab451408d033db578d4c6e32fd WatchSource:0}: Error finding container 0bab531b8813a166b211b46c70cec47af49d0cab451408d033db578d4c6e32fd: Status 404 returned error can't find the container with id 0bab531b8813a166b211b46c70cec47af49d0cab451408d033db578d4c6e32fd Jun 03 13:58:14.481911 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:14.481872 2581 generic.go:358] "Generic (PLEG): container finished" podID="862850a7-169c-4cba-82b4-10d0932d861f" containerID="1c5851700d59c57e0ec25cd993f580eae6fb9a7aa5984876fc5f849fcd97e58d" exitCode=0 Jun 03 13:58:14.482254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:14.481916 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerDied","Data":"1c5851700d59c57e0ec25cd993f580eae6fb9a7aa5984876fc5f849fcd97e58d"} Jun 03 13:58:14.482254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:14.481948 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"0bab531b8813a166b211b46c70cec47af49d0cab451408d033db578d4c6e32fd"} Jun 03 13:58:14.619943 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:14.619919 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8697a703-3561-4fd4-9acc-f3b604a5bf2d" path="/var/lib/kubelet/pods/8697a703-3561-4fd4-9acc-f3b604a5bf2d/volumes" Jun 03 13:58:15.487426 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487387 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"48c8d48684d495dd5ce37e0b22222987bf1cbda1eb89fe9a7948d1b14431caf2"} Jun 03 13:58:15.487426 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487422 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"a76062387cf93688b0aa090b78b7084acac13470d28362884d4d60f9baa9ce20"} Jun 03 13:58:15.487426 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487433 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"eac91526bfb1b9045411183b16bf37f4577da709ca516c9cd381e05fae8ee8ae"} Jun 03 13:58:15.487908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487441 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"efb862c834f5db8008c54ece01f36335832eef2847bd1e564c6d87cad7989a46"} Jun 03 13:58:15.487908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487449 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"80be9fdd29def78e47c4c9a6f258e62635574ae30bac737e63d1b7b94cd25eb1"} Jun 03 13:58:15.487908 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.487457 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"862850a7-169c-4cba-82b4-10d0932d861f","Type":"ContainerStarted","Data":"cb7029d2dcfde875cc0007b779996c089cba7e4c0641af67f0e3ae10f8d544ee"} Jun 03 13:58:15.518088 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:15.518024 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.518007202 podStartE2EDuration="2.518007202s" podCreationTimestamp="2026-06-03 13:58:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:58:15.515942087 +0000 UTC m=+249.491291603" watchObservedRunningTime="2026-06-03 13:58:15.518007202 +0000 UTC m=+249.493356718" Jun 03 13:58:16.308353 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308311 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:16.308827 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308790 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="prometheus" containerID="cri-o://6922a1935d55ee8e418af6be6330cbdc2d4040f34e9eab2b443b3ad9b50452fe" gracePeriod=600 Jun 03 13:58:16.308827 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308798 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy" containerID="cri-o://99bcc88e798d6b4c81d2a8b70f206772de25982f5a9dfceb1a7aef96ac643520" gracePeriod=600 Jun 03 13:58:16.309035 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308842 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="config-reloader" containerID="cri-o://beeefbe15b5e9a71fab54d5dd81dd09f7c67fd00c377ccdb5def99b3932ce833" gracePeriod=600 Jun 03 13:58:16.309035 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308851 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a2bcfed6671dfb3c07b69e60b709ae23d42def868b680b6b1414d5acc675b296" gracePeriod=600 Jun 03 13:58:16.309035 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308837 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-web" containerID="cri-o://e34d54a600162455ae721197b55f507d37c42956d805a1551b2c2c295c176655" gracePeriod=600 Jun 03 13:58:16.309035 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.308824 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="thanos-sidecar" containerID="cri-o://4cc282308484beee1626bcf9995ff04b6484817c4c083517ae191c2722ef0936" gracePeriod=600 Jun 03 13:58:16.495419 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495375 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="a2bcfed6671dfb3c07b69e60b709ae23d42def868b680b6b1414d5acc675b296" exitCode=0 Jun 03 13:58:16.495419 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495410 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="99bcc88e798d6b4c81d2a8b70f206772de25982f5a9dfceb1a7aef96ac643520" exitCode=0 Jun 03 13:58:16.495419 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495419 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="e34d54a600162455ae721197b55f507d37c42956d805a1551b2c2c295c176655" exitCode=0 Jun 03 13:58:16.495419 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495427 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="4cc282308484beee1626bcf9995ff04b6484817c4c083517ae191c2722ef0936" exitCode=0 Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495420 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"a2bcfed6671dfb3c07b69e60b709ae23d42def868b680b6b1414d5acc675b296"} Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495435 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="beeefbe15b5e9a71fab54d5dd81dd09f7c67fd00c377ccdb5def99b3932ce833" exitCode=0 Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495443 2581 generic.go:358] "Generic (PLEG): container finished" podID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerID="6922a1935d55ee8e418af6be6330cbdc2d4040f34e9eab2b443b3ad9b50452fe" exitCode=0 Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495471 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"99bcc88e798d6b4c81d2a8b70f206772de25982f5a9dfceb1a7aef96ac643520"} Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495487 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"e34d54a600162455ae721197b55f507d37c42956d805a1551b2c2c295c176655"} Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495500 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"4cc282308484beee1626bcf9995ff04b6484817c4c083517ae191c2722ef0936"} Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495513 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"beeefbe15b5e9a71fab54d5dd81dd09f7c67fd00c377ccdb5def99b3932ce833"} Jun 03 13:58:16.495940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.495526 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"6922a1935d55ee8e418af6be6330cbdc2d4040f34e9eab2b443b3ad9b50452fe"} Jun 03 13:58:16.554602 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.554581 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:16.626767 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626657 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626767 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626746 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9mv5\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626786 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626809 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626837 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626861 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626884 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626936 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.626986 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626967 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.626992 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627017 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627068 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627111 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627160 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627194 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627259 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627283 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627318 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627309 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0\") pod \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\" (UID: \"9a66ad66-22b6-40bb-bf08-4892f61ab61f\") " Jun 03 13:58:16.627754 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627726 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:16.627876 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.627855 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-metrics-client-ca\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.629308 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.628272 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:58:16.629308 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.629177 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:16.629929 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.629815 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:16.630027 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.629942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.630426 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.630398 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:16.630929 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.630900 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.632179 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.632151 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:16.632262 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.632226 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out" (OuterVolumeSpecName: "config-out") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:58:16.632382 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.632345 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5" (OuterVolumeSpecName: "kube-api-access-s9mv5") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "kube-api-access-s9mv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:16.632828 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.632795 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:16.633001 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.632966 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config" (OuterVolumeSpecName: "config") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.633090 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.633065 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.633140 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.633088 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.633424 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.633405 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.633540 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.633521 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.634154 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.634136 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.644115 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.644087 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config" (OuterVolumeSpecName: "web-config") pod "9a66ad66-22b6-40bb-bf08-4892f61ab61f" (UID: "9a66ad66-22b6-40bb-bf08-4892f61ab61f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:16.729057 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729015 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9mv5\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-kube-api-access-s9mv5\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729057 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729051 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config-out\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729057 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729064 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-db\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729074 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729084 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-web-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729092 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-kube-rbac-proxy\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729101 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729110 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729119 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-grpc-tls\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729127 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a66ad66-22b6-40bb-bf08-4892f61ab61f-tls-assets\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729136 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729145 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-metrics-client-certs\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729154 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729164 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729173 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729181 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a66ad66-22b6-40bb-bf08-4892f61ab61f-config\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:16.729284 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:16.729189 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a66ad66-22b6-40bb-bf08-4892f61ab61f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 13:58:17.501404 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.501366 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a66ad66-22b6-40bb-bf08-4892f61ab61f","Type":"ContainerDied","Data":"52a3958f12dc517e373e023378f5e801cac01c45a23d610057a291e3413c1239"} Jun 03 13:58:17.501821 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.501425 2581 scope.go:117] "RemoveContainer" containerID="a2bcfed6671dfb3c07b69e60b709ae23d42def868b680b6b1414d5acc675b296" Jun 03 13:58:17.501821 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.501470 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.509423 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.509401 2581 scope.go:117] "RemoveContainer" containerID="99bcc88e798d6b4c81d2a8b70f206772de25982f5a9dfceb1a7aef96ac643520" Jun 03 13:58:17.517308 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.517287 2581 scope.go:117] "RemoveContainer" containerID="e34d54a600162455ae721197b55f507d37c42956d805a1551b2c2c295c176655" Jun 03 13:58:17.531175 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.525038 2581 scope.go:117] "RemoveContainer" containerID="4cc282308484beee1626bcf9995ff04b6484817c4c083517ae191c2722ef0936" Jun 03 13:58:17.531175 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.530840 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:17.531319 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.531299 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:17.538742 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.538722 2581 scope.go:117] "RemoveContainer" containerID="beeefbe15b5e9a71fab54d5dd81dd09f7c67fd00c377ccdb5def99b3932ce833" Jun 03 13:58:17.545778 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.545757 2581 scope.go:117] "RemoveContainer" containerID="6922a1935d55ee8e418af6be6330cbdc2d4040f34e9eab2b443b3ad9b50452fe" Jun 03 13:58:17.553063 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.553045 2581 scope.go:117] "RemoveContainer" containerID="ec874790c0c2fd455d8026e98f81d6db80c68f76de75d233cad8819027bbf121" Jun 03 13:58:17.558516 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.558493 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:17.559032 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559014 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="thanos-sidecar" Jun 03 13:58:17.559075 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559037 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="thanos-sidecar" Jun 03 13:58:17.559075 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559055 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="init-config-reloader" Jun 03 13:58:17.559075 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559065 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="init-config-reloader" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559079 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-thanos" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559090 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-thanos" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559103 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="config-reloader" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559112 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="config-reloader" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559133 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="prometheus" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559141 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="prometheus" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559151 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-web" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559160 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-web" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559172 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy" Jun 03 13:58:17.559182 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559181 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559272 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-thanos" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559286 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="config-reloader" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559301 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="prometheus" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559310 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559321 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="kube-rbac-proxy-web" Jun 03 13:58:17.559452 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.559332 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" containerName="thanos-sidecar" Jun 03 13:58:17.563515 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.563499 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.566076 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.566060 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 13:58:17.566181 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.566165 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 13:58:17.567031 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.567013 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 13:58:17.567113 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.567051 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6q6ml\"" Jun 03 13:58:17.567340 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.567325 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 13:58:17.568807 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.568789 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7m2eljnpsu8gg\"" Jun 03 13:58:17.569131 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.569108 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 13:58:17.569208 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.569115 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 13:58:17.569428 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.569414 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 13:58:17.569721 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.569699 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 13:58:17.569831 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.569784 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 13:58:17.571889 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.571835 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 13:58:17.572893 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.572872 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 13:58:17.575504 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.575485 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 13:58:17.579130 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.579109 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:17.637586 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637586 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637811 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637811 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637811 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637811 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldpgm\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-kube-api-access-ldpgm\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637811 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.637956 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.638124 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.637995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.638124 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.638027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.638124 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.638046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.638124 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.638064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.638124 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.638082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739051 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739009 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739051 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739050 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739084 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739113 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739263 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739225 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739394 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739274 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldpgm\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-kube-api-access-ldpgm\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739394 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739313 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739394 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739344 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739394 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739373 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739564 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739428 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739564 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739486 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739564 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739524 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.739564 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739554 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739592 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739635 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739751 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739785 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.739826 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.740159 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.740253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.740999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.741433 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.741095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.742213 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.742191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.743266 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.742727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.743401 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.743176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.743513 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.743210 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.743993 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.743942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.744409 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.744380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.744751 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.744728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.744909 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.744883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.745121 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.745102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.745249 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.745229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.745314 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.745294 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.745457 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.745441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.745917 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.745899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.748906 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.748885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldpgm\" (UniqueName: \"kubernetes.io/projected/2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1-kube-api-access-ldpgm\") pod \"prometheus-k8s-0\" (UID: \"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:17.873047 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:17.872966 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:18.011375 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.011343 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 13:58:18.014177 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:58:18.014143 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5f6e96_c0b7_43df_a6e9_ca3d9a575cd1.slice/crio-a4e1aa3e2320d1c8171dafaf891bcfdbe9e82eea8d71ca2f2bf7246aef0bb755 WatchSource:0}: Error finding container a4e1aa3e2320d1c8171dafaf891bcfdbe9e82eea8d71ca2f2bf7246aef0bb755: Status 404 returned error can't find the container with id a4e1aa3e2320d1c8171dafaf891bcfdbe9e82eea8d71ca2f2bf7246aef0bb755 Jun 03 13:58:18.346417 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.346365 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:58:18.348878 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.348855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32714fb-178b-4bd9-9745-e6b897cce2a4-metrics-certs\") pod \"network-metrics-daemon-t6mtg\" (UID: \"b32714fb-178b-4bd9-9745-e6b897cce2a4\") " pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:58:18.505481 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.505439 2581 generic.go:358] "Generic (PLEG): container finished" podID="2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1" containerID="4176ee0525b967af0e3f89a2e071ca38b2685586a18d50563472dcbaf92cc2e4" exitCode=0 Jun 03 13:58:18.505964 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.505525 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerDied","Data":"4176ee0525b967af0e3f89a2e071ca38b2685586a18d50563472dcbaf92cc2e4"} Jun 03 13:58:18.505964 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.505568 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"a4e1aa3e2320d1c8171dafaf891bcfdbe9e82eea8d71ca2f2bf7246aef0bb755"} Jun 03 13:58:18.518189 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.518164 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj8sj\"" Jun 03 13:58:18.526265 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.526242 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6mtg" Jun 03 13:58:18.622809 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.622770 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a66ad66-22b6-40bb-bf08-4892f61ab61f" path="/var/lib/kubelet/pods/9a66ad66-22b6-40bb-bf08-4892f61ab61f/volumes" Jun 03 13:58:18.668951 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:18.668920 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6mtg"] Jun 03 13:58:18.672010 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:58:18.671977 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32714fb_178b_4bd9_9745_e6b897cce2a4.slice/crio-fdf873e9285d73ee7bcc502ac21149bc127deb2a7008d0fc44b022e7a19bc7fa WatchSource:0}: Error finding container fdf873e9285d73ee7bcc502ac21149bc127deb2a7008d0fc44b022e7a19bc7fa: Status 404 returned error can't find the container with id fdf873e9285d73ee7bcc502ac21149bc127deb2a7008d0fc44b022e7a19bc7fa Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514440 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"2cd9d898a1b327742a4640729c4e4a773b1eda07af698ce907b8ecd8a54473c9"} Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514488 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"74cd40c286153c9c4f3433b074359f0e220ecf0e63749455f45a49445e331b6f"} Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514503 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"8d41fcfde2b76333d8b486a53bc4211cec53fb48423a78be7ec8eed210bfe974"} Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514516 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"e887d6acaed174848bd8856926ab29a7a605359487d2324868e209441824dd6e"} Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514531 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"45098a426dbb5cf47991ce5070784793c357ebc28eb1bcaa2f888bd717299406"} Jun 03 13:58:19.514569 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.514546 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1","Type":"ContainerStarted","Data":"f357234b6793534c1491db5d3dac04208268fad0d3b776f6c0fa089ee47faf2b"} Jun 03 13:58:19.515940 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:19.515914 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6mtg" event={"ID":"b32714fb-178b-4bd9-9745-e6b897cce2a4","Type":"ContainerStarted","Data":"fdf873e9285d73ee7bcc502ac21149bc127deb2a7008d0fc44b022e7a19bc7fa"} Jun 03 13:58:20.521019 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:20.520983 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6mtg" event={"ID":"b32714fb-178b-4bd9-9745-e6b897cce2a4","Type":"ContainerStarted","Data":"85750667626d53807269959a7503116b81fd52321ec23e23fe560e37cc19b6e8"} Jun 03 13:58:20.521019 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:20.521022 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6mtg" event={"ID":"b32714fb-178b-4bd9-9745-e6b897cce2a4","Type":"ContainerStarted","Data":"072b5229e4203631dd2570f418391400b5c124ce7da64a45e5e3fe2688d20235"} Jun 03 13:58:20.536104 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:20.536015 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.535999891 podStartE2EDuration="3.535999891s" podCreationTimestamp="2026-06-03 13:58:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:58:19.555785441 +0000 UTC m=+253.531134960" watchObservedRunningTime="2026-06-03 13:58:20.535999891 +0000 UTC m=+254.511349412" Jun 03 13:58:20.536290 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:20.536248 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t6mtg" podStartSLOduration=253.54811895 podStartE2EDuration="4m14.536242191s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:58:18.675748707 +0000 UTC m=+252.651098217" lastFinishedPulling="2026-06-03 13:58:19.663871963 +0000 UTC m=+253.639221458" observedRunningTime="2026-06-03 13:58:20.535656237 +0000 UTC m=+254.511005755" watchObservedRunningTime="2026-06-03 13:58:20.536242191 +0000 UTC m=+254.511591702" Jun 03 13:58:22.873362 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:22.873326 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:58:43.918790 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.918757 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6jc4r"] Jun 03 13:58:43.921925 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.921907 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:43.924653 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.924634 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 13:58:43.931183 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.931160 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6jc4r"] Jun 03 13:58:43.975103 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.975065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-dbus\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:43.975265 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.975111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-original-pull-secret\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:43.975265 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:43.975176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-kubelet-config\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.076394 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.076351 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-dbus\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.076556 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.076397 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-original-pull-secret\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.076556 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.076513 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-kubelet-config\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.076556 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.076532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-dbus\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.076723 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.076617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-kubelet-config\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.078802 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.078777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bef0a79-0bb2-4b79-a001-a4932d2b7d9a-original-pull-secret\") pod \"global-pull-secret-syncer-6jc4r\" (UID: \"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a\") " pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.232946 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.232857 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jc4r" Jun 03 13:58:44.375232 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.375201 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6jc4r"] Jun 03 13:58:44.376104 ip-10-0-136-17 kubenswrapper[2581]: W0603 13:58:44.376068 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bef0a79_0bb2_4b79_a001_a4932d2b7d9a.slice/crio-2625e8ac697e5a5f88f2bcc23438c81273f1264464450d5b7c2694aaf9a268f5 WatchSource:0}: Error finding container 2625e8ac697e5a5f88f2bcc23438c81273f1264464450d5b7c2694aaf9a268f5: Status 404 returned error can't find the container with id 2625e8ac697e5a5f88f2bcc23438c81273f1264464450d5b7c2694aaf9a268f5 Jun 03 13:58:44.599083 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:44.599047 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6jc4r" event={"ID":"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a","Type":"ContainerStarted","Data":"2625e8ac697e5a5f88f2bcc23438c81273f1264464450d5b7c2694aaf9a268f5"} Jun 03 13:58:48.619522 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:48.619434 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6jc4r" event={"ID":"8bef0a79-0bb2-4b79-a001-a4932d2b7d9a","Type":"ContainerStarted","Data":"5ab0bc850aeb745d6873801a6277ccde703d0bc3c0d00424bac447cbde7ef3ca"} Jun 03 13:58:48.633109 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:58:48.633068 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6jc4r" podStartSLOduration=1.656127699 podStartE2EDuration="5.63305424s" podCreationTimestamp="2026-06-03 13:58:43 +0000 UTC" firstStartedPulling="2026-06-03 13:58:44.377879233 +0000 UTC m=+278.353228743" lastFinishedPulling="2026-06-03 13:58:48.354805786 +0000 UTC m=+282.330155284" observedRunningTime="2026-06-03 13:58:48.63114873 +0000 UTC m=+282.606498247" watchObservedRunningTime="2026-06-03 13:58:48.63305424 +0000 UTC m=+282.608403756" Jun 03 13:59:06.510254 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:06.510225 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 13:59:06.510619 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:06.510329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 13:59:06.516999 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:06.516976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:59:06.517136 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:06.517118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 13:59:06.523786 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:06.523770 2581 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 13:59:17.873546 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:17.873506 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:59:17.889665 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:17.889637 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 13:59:18.731005 ip-10-0-136-17 kubenswrapper[2581]: I0603 13:59:18.730977 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 14:00:40.752797 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.752763 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp"] Jun 03 14:00:40.755126 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.755105 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:40.760046 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760029 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 14:00:40.760046 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760025 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 14:00:40.760880 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760860 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g87bd\"" Jun 03 14:00:40.760880 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760872 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 14:00:40.761021 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760892 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:00:40.761021 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.760988 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 14:00:40.778809 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.778788 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp"] Jun 03 14:00:40.902648 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.902610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:40.902840 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.902660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65w4l\" (UniqueName: \"kubernetes.io/projected/c2c918d3-e768-4aed-b0fa-a22848359223-kube-api-access-65w4l\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:40.902840 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.902798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2c918d3-e768-4aed-b0fa-a22848359223-manager-config\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:40.902913 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:40.902869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.004136 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.004044 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2c918d3-e768-4aed-b0fa-a22848359223-manager-config\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.004136 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.004115 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.004365 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.004173 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.004365 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.004211 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65w4l\" (UniqueName: \"kubernetes.io/projected/c2c918d3-e768-4aed-b0fa-a22848359223-kube-api-access-65w4l\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.004749 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.004719 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2c918d3-e768-4aed-b0fa-a22848359223-manager-config\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.006730 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.006689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.006730 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.006724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2c918d3-e768-4aed-b0fa-a22848359223-cert\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.013522 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.013497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65w4l\" (UniqueName: \"kubernetes.io/projected/c2c918d3-e768-4aed-b0fa-a22848359223-kube-api-access-65w4l\") pod \"lws-controller-manager-6557d5d46d-p7nlp\" (UID: \"c2c918d3-e768-4aed-b0fa-a22848359223\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.064427 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.064399 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:41.217915 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.217792 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp"] Jun 03 14:00:41.225379 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:00:41.225348 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c918d3_e768_4aed_b0fa_a22848359223.slice/crio-6519777fa6276ae58aa2f92019e50b096b5623e2cf0793fb1634de695b6419ec WatchSource:0}: Error finding container 6519777fa6276ae58aa2f92019e50b096b5623e2cf0793fb1634de695b6419ec: Status 404 returned error can't find the container with id 6519777fa6276ae58aa2f92019e50b096b5623e2cf0793fb1634de695b6419ec Jun 03 14:00:41.226972 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.226956 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:00:41.980767 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:41.980727 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" event={"ID":"c2c918d3-e768-4aed-b0fa-a22848359223","Type":"ContainerStarted","Data":"6519777fa6276ae58aa2f92019e50b096b5623e2cf0793fb1634de695b6419ec"} Jun 03 14:00:44.993254 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:44.993213 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" event={"ID":"c2c918d3-e768-4aed-b0fa-a22848359223","Type":"ContainerStarted","Data":"68dda5341987b3b3adca1e8b7130dd80f776e1ab2ebe319ffe6a1b2563fb279a"} Jun 03 14:00:44.993629 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:44.993278 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:00:45.010060 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:45.010002 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" podStartSLOduration=2.138742314 podStartE2EDuration="5.009984293s" podCreationTimestamp="2026-06-03 14:00:40 +0000 UTC" firstStartedPulling="2026-06-03 14:00:41.2271114 +0000 UTC m=+395.202460896" lastFinishedPulling="2026-06-03 14:00:44.098353366 +0000 UTC m=+398.073702875" observedRunningTime="2026-06-03 14:00:45.009023466 +0000 UTC m=+398.984372983" watchObservedRunningTime="2026-06-03 14:00:45.009984293 +0000 UTC m=+398.985333811" Jun 03 14:00:48.134472 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.134436 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm"] Jun 03 14:00:48.137111 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.137095 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.143145 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.143122 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 14:00:48.143462 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.143440 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 14:00:48.143731 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.143707 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 14:00:48.143988 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.143968 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t5bnl\"" Jun 03 14:00:48.144461 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.143997 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 14:00:48.153366 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.153344 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm"] Jun 03 14:00:48.265747 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.265718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wm2s\" (UniqueName: \"kubernetes.io/projected/b3953289-1176-44d5-9160-8f0268a70ec1-kube-api-access-6wm2s\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.265909 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.265753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.265909 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.265788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.265909 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.265853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.265909 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.265874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.366526 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366490 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wm2s\" (UniqueName: \"kubernetes.io/projected/b3953289-1176-44d5-9160-8f0268a70ec1-kube-api-access-6wm2s\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.366732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366530 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.366732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366569 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.366732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366605 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.366732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366637 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.367008 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.366986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.369158 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.369128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3953289-1176-44d5-9160-8f0268a70ec1-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.369283 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.369265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.369335 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.369313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3953289-1176-44d5-9160-8f0268a70ec1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.378493 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.378470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wm2s\" (UniqueName: \"kubernetes.io/projected/b3953289-1176-44d5-9160-8f0268a70ec1-kube-api-access-6wm2s\") pod \"opendatahub-operator-controller-manager-7c68786f4b-cj5tm\" (UID: \"b3953289-1176-44d5-9160-8f0268a70ec1\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.448339 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.448263 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:48.583312 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:48.583285 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm"] Jun 03 14:00:48.585071 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:00:48.585044 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3953289_1176_44d5_9160_8f0268a70ec1.slice/crio-1fdade794c7cb25de501d54f1d91ae3908e5e63eb07f79a357ade87a96d27b35 WatchSource:0}: Error finding container 1fdade794c7cb25de501d54f1d91ae3908e5e63eb07f79a357ade87a96d27b35: Status 404 returned error can't find the container with id 1fdade794c7cb25de501d54f1d91ae3908e5e63eb07f79a357ade87a96d27b35 Jun 03 14:00:49.005732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:49.005693 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" event={"ID":"b3953289-1176-44d5-9160-8f0268a70ec1","Type":"ContainerStarted","Data":"1fdade794c7cb25de501d54f1d91ae3908e5e63eb07f79a357ade87a96d27b35"} Jun 03 14:00:52.018237 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:52.018197 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" event={"ID":"b3953289-1176-44d5-9160-8f0268a70ec1","Type":"ContainerStarted","Data":"4ea281363e4e4f91ec686e430bff8d66aed37f90f89560f01b54640f4d0652a7"} Jun 03 14:00:53.022655 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:53.022561 2581 generic.go:358] "Generic (PLEG): container finished" podID="b3953289-1176-44d5-9160-8f0268a70ec1" containerID="4ea281363e4e4f91ec686e430bff8d66aed37f90f89560f01b54640f4d0652a7" exitCode=0 Jun 03 14:00:53.023041 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:53.022655 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" event={"ID":"b3953289-1176-44d5-9160-8f0268a70ec1","Type":"ContainerDied","Data":"4ea281363e4e4f91ec686e430bff8d66aed37f90f89560f01b54640f4d0652a7"} Jun 03 14:00:54.028463 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:54.028425 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" event={"ID":"b3953289-1176-44d5-9160-8f0268a70ec1","Type":"ContainerStarted","Data":"7fc6045bdb5690998d1bfe502549b946838cde374d7e8639e19cdb0da8ef8104"} Jun 03 14:00:54.028892 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:54.028547 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:00:54.051543 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:54.051496 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" podStartSLOduration=1.326040347 podStartE2EDuration="6.051482769s" podCreationTimestamp="2026-06-03 14:00:48 +0000 UTC" firstStartedPulling="2026-06-03 14:00:48.586831482 +0000 UTC m=+402.562180978" lastFinishedPulling="2026-06-03 14:00:53.312273903 +0000 UTC m=+407.287623400" observedRunningTime="2026-06-03 14:00:54.049933193 +0000 UTC m=+408.025282711" watchObservedRunningTime="2026-06-03 14:00:54.051482769 +0000 UTC m=+408.026832286" Jun 03 14:00:55.998314 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:00:55.998279 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-p7nlp" Jun 03 14:01:05.034597 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:05.034565 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-cj5tm" Jun 03 14:01:17.924354 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.924258 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-655d7d459-hvs7v"] Jun 03 14:01:17.927842 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.927820 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:17.933925 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.933897 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pwhgt\"" Jun 03 14:01:17.934070 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.933946 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 14:01:17.934129 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.934079 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 14:01:17.934715 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.934202 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 14:01:17.934715 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.934209 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 14:01:17.945170 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:17.943789 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655d7d459-hvs7v"] Jun 03 14:01:18.043096 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.043051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d44e31-00a4-4b4a-8646-b5643f4da84a-tls-certs\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.043279 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.043138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d44e31-00a4-4b4a-8646-b5643f4da84a-tmp\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.043279 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.043179 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kznlf\" (UniqueName: \"kubernetes.io/projected/67d44e31-00a4-4b4a-8646-b5643f4da84a-kube-api-access-kznlf\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.144049 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.144002 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kznlf\" (UniqueName: \"kubernetes.io/projected/67d44e31-00a4-4b4a-8646-b5643f4da84a-kube-api-access-kznlf\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.144251 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.144122 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d44e31-00a4-4b4a-8646-b5643f4da84a-tls-certs\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.144251 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.144203 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d44e31-00a4-4b4a-8646-b5643f4da84a-tmp\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.146860 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.146828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d44e31-00a4-4b4a-8646-b5643f4da84a-tmp\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.146978 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.146842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d44e31-00a4-4b4a-8646-b5643f4da84a-tls-certs\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.176633 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.176556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kznlf\" (UniqueName: \"kubernetes.io/projected/67d44e31-00a4-4b4a-8646-b5643f4da84a-kube-api-access-kznlf\") pod \"kube-auth-proxy-655d7d459-hvs7v\" (UID: \"67d44e31-00a4-4b4a-8646-b5643f4da84a\") " pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.240553 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.240517 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" Jun 03 14:01:18.375800 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:18.375776 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655d7d459-hvs7v"] Jun 03 14:01:18.378082 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:01:18.378047 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d44e31_00a4_4b4a_8646_b5643f4da84a.slice/crio-039b73cbf2168d9a384d20392d638322be74f30a40bef3265efe9ebfffdb57a5 WatchSource:0}: Error finding container 039b73cbf2168d9a384d20392d638322be74f30a40bef3265efe9ebfffdb57a5: Status 404 returned error can't find the container with id 039b73cbf2168d9a384d20392d638322be74f30a40bef3265efe9ebfffdb57a5 Jun 03 14:01:19.119712 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:19.119649 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" event={"ID":"67d44e31-00a4-4b4a-8646-b5643f4da84a","Type":"ContainerStarted","Data":"039b73cbf2168d9a384d20392d638322be74f30a40bef3265efe9ebfffdb57a5"} Jun 03 14:01:22.131903 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:22.131860 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" event={"ID":"67d44e31-00a4-4b4a-8646-b5643f4da84a","Type":"ContainerStarted","Data":"6cfa330995d9ad592ab66f0029bb6e7123530cc79dada43e838665320c58beed"} Jun 03 14:01:22.149629 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:01:22.149582 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-655d7d459-hvs7v" podStartSLOduration=2.150464328 podStartE2EDuration="5.149569923s" podCreationTimestamp="2026-06-03 14:01:17 +0000 UTC" firstStartedPulling="2026-06-03 14:01:18.379718677 +0000 UTC m=+432.355068172" lastFinishedPulling="2026-06-03 14:01:21.378824258 +0000 UTC m=+435.354173767" observedRunningTime="2026-06-03 14:01:22.148557043 +0000 UTC m=+436.123906559" watchObservedRunningTime="2026-06-03 14:01:22.149569923 +0000 UTC m=+436.124919441" Jun 03 14:02:50.048420 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.048334 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz"] Jun 03 14:02:50.051737 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.051716 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:50.054301 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.054278 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-45bh4\"" Jun 03 14:02:50.054695 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.054664 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 14:02:50.055131 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.055117 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 14:02:50.074619 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.074588 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz"] Jun 03 14:02:50.195349 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.195311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmwnf\" (UniqueName: \"kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf\") pod \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" (UID: \"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:50.296397 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.296355 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmwnf\" (UniqueName: \"kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf\") pod \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" (UID: \"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:50.313121 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.313051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmwnf\" (UniqueName: \"kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf\") pod \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" (UID: \"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:50.362213 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.362176 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:50.500271 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:50.500241 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz"] Jun 03 14:02:50.501983 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:02:50.501956 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e5b5b8_113b_46ff_9820_f82b0ad8a0f5.slice/crio-99ec20a017dc8753b9d62c29ce8e9ecc81070605693a8f88dfd9dcbd39ae0168 WatchSource:0}: Error finding container 99ec20a017dc8753b9d62c29ce8e9ecc81070605693a8f88dfd9dcbd39ae0168: Status 404 returned error can't find the container with id 99ec20a017dc8753b9d62c29ce8e9ecc81070605693a8f88dfd9dcbd39ae0168 Jun 03 14:02:51.438413 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:51.438361 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" event={"ID":"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5","Type":"ContainerStarted","Data":"99ec20a017dc8753b9d62c29ce8e9ecc81070605693a8f88dfd9dcbd39ae0168"} Jun 03 14:02:53.447945 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:53.447893 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" event={"ID":"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5","Type":"ContainerStarted","Data":"ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0"} Jun 03 14:02:53.448310 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:53.448007 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:02:53.466023 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:02:53.465972 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" podStartSLOduration=1.014509983 podStartE2EDuration="3.465956688s" podCreationTimestamp="2026-06-03 14:02:50 +0000 UTC" firstStartedPulling="2026-06-03 14:02:50.503893995 +0000 UTC m=+524.479243490" lastFinishedPulling="2026-06-03 14:02:52.955340699 +0000 UTC m=+526.930690195" observedRunningTime="2026-06-03 14:02:53.463819504 +0000 UTC m=+527.439169020" watchObservedRunningTime="2026-06-03 14:02:53.465956688 +0000 UTC m=+527.441306205" Jun 03 14:03:04.453752 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:04.453723 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:03:14.005094 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.005064 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:14.009339 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.009310 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz"] Jun 03 14:03:14.009548 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.009527 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.009619 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.009529 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" containerName="manager" containerID="cri-o://ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0" gracePeriod=2 Jun 03 14:03:14.011977 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.011959 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzlkl\"" Jun 03 14:03:14.016314 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.016231 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz"] Jun 03 14:03:14.022809 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.022778 2581 status_manager.go:895] "Failed to get status for pod" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" err="pods \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" is forbidden: User \"system:node:ip-10-0-136-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-17.ec2.internal' and this object" Jun 03 14:03:14.029395 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.029370 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:14.113265 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.113235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bq9x\" (UniqueName: \"kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.113426 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.113303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.214434 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.214397 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.214601 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.214518 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bq9x\" (UniqueName: \"kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.214809 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.214786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.227260 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.227235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bq9x\" (UniqueName: \"kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x\") pod \"kuadrant-operator-controller-manager-84b657d985-268d8\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.245308 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.245291 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:03:14.249147 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.249122 2581 status_manager.go:895] "Failed to get status for pod" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" err="pods \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" is forbidden: User \"system:node:ip-10-0-136-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-17.ec2.internal' and this object" Jun 03 14:03:14.315460 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.315429 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmwnf\" (UniqueName: \"kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf\") pod \"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5\" (UID: \"80e5b5b8-113b-46ff-9820-f82b0ad8a0f5\") " Jun 03 14:03:14.317841 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.317809 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf" (OuterVolumeSpecName: "kube-api-access-tmwnf") pod "80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" (UID: "80e5b5b8-113b-46ff-9820-f82b0ad8a0f5"). InnerVolumeSpecName "kube-api-access-tmwnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:03:14.383073 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.383034 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:14.416825 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.416797 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmwnf\" (UniqueName: \"kubernetes.io/projected/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5-kube-api-access-tmwnf\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:03:14.521442 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.521404 2581 generic.go:358] "Generic (PLEG): container finished" podID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" containerID="ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0" exitCode=0 Jun 03 14:03:14.521617 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.521453 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" Jun 03 14:03:14.521617 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.521489 2581 scope.go:117] "RemoveContainer" containerID="ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0" Jun 03 14:03:14.523898 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.523868 2581 status_manager.go:895] "Failed to get status for pod" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" err="pods \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" is forbidden: User \"system:node:ip-10-0-136-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-17.ec2.internal' and this object" Jun 03 14:03:14.531486 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.531401 2581 scope.go:117] "RemoveContainer" containerID="ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0" Jun 03 14:03:14.532103 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:03:14.531950 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0\": container with ID starting with ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0 not found: ID does not exist" containerID="ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0" Jun 03 14:03:14.532103 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.531992 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0"} err="failed to get container status \"ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0\": rpc error: code = NotFound desc = could not find container \"ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0\": container with ID starting with ece9bda8a1467e230180dd63dee421ca12834112b5b40cd3b52b82fb668c37b0 not found: ID does not exist" Jun 03 14:03:14.533523 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.533504 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:14.534061 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.534038 2581 status_manager.go:895] "Failed to get status for pod" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6h6nz" err="pods \"limitador-operator-controller-manager-85c4996f8c-6h6nz\" is forbidden: User \"system:node:ip-10-0-136-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-17.ec2.internal' and this object" Jun 03 14:03:14.536067 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:03:14.536036 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcd9e7d_384e_4b41_87b7_0e5ba4ef1027.slice/crio-a867fd5297b782f43071a6130f97a6ba1de16972ab107d63788a72a4395a25ec WatchSource:0}: Error finding container a867fd5297b782f43071a6130f97a6ba1de16972ab107d63788a72a4395a25ec: Status 404 returned error can't find the container with id a867fd5297b782f43071a6130f97a6ba1de16972ab107d63788a72a4395a25ec Jun 03 14:03:14.620206 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:14.620130 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" path="/var/lib/kubelet/pods/80e5b5b8-113b-46ff-9820-f82b0ad8a0f5/volumes" Jun 03 14:03:15.529420 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:15.529378 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" event={"ID":"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027","Type":"ContainerStarted","Data":"a867fd5297b782f43071a6130f97a6ba1de16972ab107d63788a72a4395a25ec"} Jun 03 14:03:18.543221 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:18.543171 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" event={"ID":"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027","Type":"ContainerStarted","Data":"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d"} Jun 03 14:03:18.543615 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:18.543301 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:18.564640 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:18.564587 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" podStartSLOduration=1.764180965 podStartE2EDuration="5.564574126s" podCreationTimestamp="2026-06-03 14:03:13 +0000 UTC" firstStartedPulling="2026-06-03 14:03:14.538332271 +0000 UTC m=+548.513681767" lastFinishedPulling="2026-06-03 14:03:18.33872543 +0000 UTC m=+552.314074928" observedRunningTime="2026-06-03 14:03:18.561509698 +0000 UTC m=+552.536859215" watchObservedRunningTime="2026-06-03 14:03:18.564574126 +0000 UTC m=+552.539923642" Jun 03 14:03:29.548790 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.548756 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:29.875953 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.875910 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st"] Jun 03 14:03:29.876296 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.876283 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" containerName="manager" Jun 03 14:03:29.876338 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.876297 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" containerName="manager" Jun 03 14:03:29.876371 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.876362 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="80e5b5b8-113b-46ff-9820-f82b0ad8a0f5" containerName="manager" Jun 03 14:03:29.882409 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.882388 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:29.906421 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.906394 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st"] Jun 03 14:03:29.960965 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.960923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2r6p\" (UniqueName: \"kubernetes.io/projected/f0fd8376-6824-4fe4-b920-028ed53af4b6-kube-api-access-s2r6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:29.961147 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:29.960991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0fd8376-6824-4fe4-b920-028ed53af4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.062159 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.062055 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0fd8376-6824-4fe4-b920-028ed53af4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.062322 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.062198 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2r6p\" (UniqueName: \"kubernetes.io/projected/f0fd8376-6824-4fe4-b920-028ed53af4b6-kube-api-access-s2r6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.062595 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.062573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0fd8376-6824-4fe4-b920-028ed53af4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.080259 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.080231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2r6p\" (UniqueName: \"kubernetes.io/projected/f0fd8376-6824-4fe4-b920-028ed53af4b6-kube-api-access-s2r6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5z7st\" (UID: \"f0fd8376-6824-4fe4-b920-028ed53af4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.192342 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.192299 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.330765 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.330624 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st"] Jun 03 14:03:30.334734 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:03:30.334705 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fd8376_6824_4fe4_b920_028ed53af4b6.slice/crio-42fa3fa0d96ab1f61ae91576b968f39ce64a2ea28d4e480d6d24be078ba54ea0 WatchSource:0}: Error finding container 42fa3fa0d96ab1f61ae91576b968f39ce64a2ea28d4e480d6d24be078ba54ea0: Status 404 returned error can't find the container with id 42fa3fa0d96ab1f61ae91576b968f39ce64a2ea28d4e480d6d24be078ba54ea0 Jun 03 14:03:30.584738 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.584639 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" event={"ID":"f0fd8376-6824-4fe4-b920-028ed53af4b6","Type":"ContainerStarted","Data":"f01d0b2ed6aa8ee4ffc9cf3cdb4cb3e91ceab55aefe56114295380a510996d46"} Jun 03 14:03:30.584738 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.584708 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" event={"ID":"f0fd8376-6824-4fe4-b920-028ed53af4b6","Type":"ContainerStarted","Data":"42fa3fa0d96ab1f61ae91576b968f39ce64a2ea28d4e480d6d24be078ba54ea0"} Jun 03 14:03:30.585112 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.584834 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:30.610302 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:30.610250 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" podStartSLOduration=1.610235802 podStartE2EDuration="1.610235802s" podCreationTimestamp="2026-06-03 14:03:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:03:30.607872849 +0000 UTC m=+564.583222366" watchObservedRunningTime="2026-06-03 14:03:30.610235802 +0000 UTC m=+564.585585319" Jun 03 14:03:41.591102 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:41.591069 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5z7st" Jun 03 14:03:41.641248 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:41.641213 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:41.641516 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:41.641473 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" podUID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" containerName="manager" containerID="cri-o://f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d" gracePeriod=10 Jun 03 14:03:41.892973 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:41.892946 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:42.075942 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.075902 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bq9x\" (UniqueName: \"kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x\") pod \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " Jun 03 14:03:42.076137 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.076032 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume\") pod \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\" (UID: \"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027\") " Jun 03 14:03:42.076502 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.076479 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" (UID: "ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:03:42.078317 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.078292 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x" (OuterVolumeSpecName: "kube-api-access-8bq9x") pod "ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" (UID: "ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027"). InnerVolumeSpecName "kube-api-access-8bq9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:03:42.177408 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.177325 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-extensions-socket-volume\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:03:42.177408 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.177352 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bq9x\" (UniqueName: \"kubernetes.io/projected/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027-kube-api-access-8bq9x\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:03:42.628882 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.628843 2581 generic.go:358] "Generic (PLEG): container finished" podID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" containerID="f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d" exitCode=0 Jun 03 14:03:42.629291 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.628917 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" event={"ID":"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027","Type":"ContainerDied","Data":"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d"} Jun 03 14:03:42.629291 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.628943 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" Jun 03 14:03:42.629291 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.628950 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8" event={"ID":"ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027","Type":"ContainerDied","Data":"a867fd5297b782f43071a6130f97a6ba1de16972ab107d63788a72a4395a25ec"} Jun 03 14:03:42.629291 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.628969 2581 scope.go:117] "RemoveContainer" containerID="f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d" Jun 03 14:03:42.637873 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.637852 2581 scope.go:117] "RemoveContainer" containerID="f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d" Jun 03 14:03:42.638195 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:03:42.638171 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d\": container with ID starting with f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d not found: ID does not exist" containerID="f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d" Jun 03 14:03:42.638255 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.638208 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d"} err="failed to get container status \"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d\": rpc error: code = NotFound desc = could not find container \"f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d\": container with ID starting with f2ac58c7d6a96d486ef9644c6cf58e7434fd675caf21be8e6d1cecbaa029c09d not found: ID does not exist" Jun 03 14:03:42.662067 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.662040 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:42.676034 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:42.676010 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-268d8"] Jun 03 14:03:44.620707 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:03:44.620656 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" path="/var/lib/kubelet/pods/ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027/volumes" Jun 03 14:04:01.278497 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.278456 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:01.278995 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.278900 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" containerName="manager" Jun 03 14:04:01.278995 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.278938 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" containerName="manager" Jun 03 14:04:01.279077 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.279008 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddcd9e7d-384e-4b41-87b7-0e5ba4ef1027" containerName="manager" Jun 03 14:04:01.282103 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.282085 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.284800 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.284775 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 14:04:01.284932 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.284806 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mbjwr\"" Jun 03 14:04:01.292950 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.292926 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:01.351324 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.351289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsfhm\" (UniqueName: \"kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.351569 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.351545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.365575 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.365540 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:01.452955 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.452914 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.453165 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.453004 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsfhm\" (UniqueName: \"kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.453620 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.453591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.461387 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.461348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsfhm\" (UniqueName: \"kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm\") pod \"limitador-limitador-7d549b5b-5r7z2\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.592801 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.592767 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:01.726505 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:01.726479 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:01.729059 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:04:01.729027 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39d6572_2745_4eb7_9c5a_9f6f85e4dcb8.slice/crio-6a7a9c9957d8342420500d8f48d87de55dceecc91da7cd2309e942f754d781c5 WatchSource:0}: Error finding container 6a7a9c9957d8342420500d8f48d87de55dceecc91da7cd2309e942f754d781c5: Status 404 returned error can't find the container with id 6a7a9c9957d8342420500d8f48d87de55dceecc91da7cd2309e942f754d781c5 Jun 03 14:04:02.115881 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.115851 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:02.120815 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.120796 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:02.123220 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.123202 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gjbmw\"" Jun 03 14:04:02.128522 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.128483 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:02.158746 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.158706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwx82\" (UniqueName: \"kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82\") pod \"authorino-f99f4b5cd-4lq5k\" (UID: \"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d\") " pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:02.260173 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.260142 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwx82\" (UniqueName: \"kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82\") pod \"authorino-f99f4b5cd-4lq5k\" (UID: \"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d\") " pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:02.269386 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.269359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwx82\" (UniqueName: \"kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82\") pod \"authorino-f99f4b5cd-4lq5k\" (UID: \"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d\") " pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:02.451764 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.451668 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:02.630200 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.630166 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:02.633698 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:04:02.633647 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod553dfaa4_5bb8_42bc_ab86_4ccb3288ac1d.slice/crio-98f8c0f2b92eb3324738cc9dc11c7d6adca8b2528df4177698237242cc496f5a WatchSource:0}: Error finding container 98f8c0f2b92eb3324738cc9dc11c7d6adca8b2528df4177698237242cc496f5a: Status 404 returned error can't find the container with id 98f8c0f2b92eb3324738cc9dc11c7d6adca8b2528df4177698237242cc496f5a Jun 03 14:04:02.699863 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.699801 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" event={"ID":"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d","Type":"ContainerStarted","Data":"98f8c0f2b92eb3324738cc9dc11c7d6adca8b2528df4177698237242cc496f5a"} Jun 03 14:04:02.703534 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:02.703460 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" event={"ID":"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8","Type":"ContainerStarted","Data":"6a7a9c9957d8342420500d8f48d87de55dceecc91da7cd2309e942f754d781c5"} Jun 03 14:04:05.718459 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:05.718422 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" event={"ID":"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8","Type":"ContainerStarted","Data":"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565"} Jun 03 14:04:05.718949 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:05.718554 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:05.738546 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:05.738487 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" podStartSLOduration=1.82720458 podStartE2EDuration="4.738468758s" podCreationTimestamp="2026-06-03 14:04:01 +0000 UTC" firstStartedPulling="2026-06-03 14:04:01.730972803 +0000 UTC m=+595.706322313" lastFinishedPulling="2026-06-03 14:04:04.642236993 +0000 UTC m=+598.617586491" observedRunningTime="2026-06-03 14:04:05.737358194 +0000 UTC m=+599.712707711" watchObservedRunningTime="2026-06-03 14:04:05.738468758 +0000 UTC m=+599.713818276" Jun 03 14:04:06.735610 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:06.735581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:04:06.736074 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:06.735581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:04:06.738509 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:06.738482 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:04:06.738685 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:06.738577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:04:07.557080 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:07.557043 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:07.726297 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:07.726255 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" event={"ID":"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d","Type":"ContainerStarted","Data":"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c"} Jun 03 14:04:07.741572 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:07.741512 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" podStartSLOduration=1.6038182920000001 podStartE2EDuration="5.741494968s" podCreationTimestamp="2026-06-03 14:04:02 +0000 UTC" firstStartedPulling="2026-06-03 14:04:02.63550215 +0000 UTC m=+596.610851649" lastFinishedPulling="2026-06-03 14:04:06.773178829 +0000 UTC m=+600.748528325" observedRunningTime="2026-06-03 14:04:07.73961594 +0000 UTC m=+601.714965467" watchObservedRunningTime="2026-06-03 14:04:07.741494968 +0000 UTC m=+601.716844485" Jun 03 14:04:08.735872 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:08.735809 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" podUID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" containerName="authorino" containerID="cri-o://65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c" gracePeriod=30 Jun 03 14:04:08.981628 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:08.981602 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:09.028220 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.028151 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwx82\" (UniqueName: \"kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82\") pod \"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d\" (UID: \"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d\") " Jun 03 14:04:09.030272 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.030249 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82" (OuterVolumeSpecName: "kube-api-access-lwx82") pod "553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" (UID: "553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d"). InnerVolumeSpecName "kube-api-access-lwx82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:04:09.129124 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.129080 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwx82\" (UniqueName: \"kubernetes.io/projected/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d-kube-api-access-lwx82\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:04:09.740408 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.740369 2581 generic.go:358] "Generic (PLEG): container finished" podID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" containerID="65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c" exitCode=0 Jun 03 14:04:09.740552 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.740425 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" Jun 03 14:04:09.740552 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.740441 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" event={"ID":"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d","Type":"ContainerDied","Data":"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c"} Jun 03 14:04:09.740552 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.740488 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-4lq5k" event={"ID":"553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d","Type":"ContainerDied","Data":"98f8c0f2b92eb3324738cc9dc11c7d6adca8b2528df4177698237242cc496f5a"} Jun 03 14:04:09.740552 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.740510 2581 scope.go:117] "RemoveContainer" containerID="65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c" Jun 03 14:04:09.749925 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.749900 2581 scope.go:117] "RemoveContainer" containerID="65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c" Jun 03 14:04:09.750190 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:04:09.750170 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c\": container with ID starting with 65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c not found: ID does not exist" containerID="65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c" Jun 03 14:04:09.750244 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.750200 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c"} err="failed to get container status \"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c\": rpc error: code = NotFound desc = could not find container \"65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c\": container with ID starting with 65dc8debadc800d68963147016ba9d2c9858a493cf22f7cd3096b2555aa63a9c not found: ID does not exist" Jun 03 14:04:09.761934 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.761906 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:09.765242 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:09.765219 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-4lq5k"] Jun 03 14:04:10.620546 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:10.620512 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" path="/var/lib/kubelet/pods/553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d/volumes" Jun 03 14:04:16.723416 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:16.723382 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:18.570239 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:18.570205 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:18.572269 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:18.570448 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" podUID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" containerName="limitador" containerID="cri-o://1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565" gracePeriod=30 Jun 03 14:04:19.117585 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.117559 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:19.222783 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.222695 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file\") pod \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " Jun 03 14:04:19.222933 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.222802 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsfhm\" (UniqueName: \"kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm\") pod \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\" (UID: \"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8\") " Jun 03 14:04:19.223064 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.223042 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file" (OuterVolumeSpecName: "config-file") pod "c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" (UID: "c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:04:19.225023 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.225001 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm" (OuterVolumeSpecName: "kube-api-access-vsfhm") pod "c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" (UID: "c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8"). InnerVolumeSpecName "kube-api-access-vsfhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:04:19.323697 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.323641 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-config-file\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:04:19.323697 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.323700 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsfhm\" (UniqueName: \"kubernetes.io/projected/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8-kube-api-access-vsfhm\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:04:19.780164 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.780125 2581 generic.go:358] "Generic (PLEG): container finished" podID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" containerID="1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565" exitCode=0 Jun 03 14:04:19.780696 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.780202 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" Jun 03 14:04:19.780696 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.780210 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" event={"ID":"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8","Type":"ContainerDied","Data":"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565"} Jun 03 14:04:19.780696 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.780247 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5r7z2" event={"ID":"c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8","Type":"ContainerDied","Data":"6a7a9c9957d8342420500d8f48d87de55dceecc91da7cd2309e942f754d781c5"} Jun 03 14:04:19.780696 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.780263 2581 scope.go:117] "RemoveContainer" containerID="1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565" Jun 03 14:04:19.788718 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.788694 2581 scope.go:117] "RemoveContainer" containerID="1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565" Jun 03 14:04:19.788982 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:04:19.788966 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565\": container with ID starting with 1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565 not found: ID does not exist" containerID="1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565" Jun 03 14:04:19.789044 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.788991 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565"} err="failed to get container status \"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565\": rpc error: code = NotFound desc = could not find container \"1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565\": container with ID starting with 1cb1037cdfdeb07e75a8ccc28666de5eb384c5fad7d117959717b45c86566565 not found: ID does not exist" Jun 03 14:04:19.802460 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.802431 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:19.805899 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:19.805871 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5r7z2"] Jun 03 14:04:20.620175 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:20.620142 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" path="/var/lib/kubelet/pods/c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8/volumes" Jun 03 14:04:21.960321 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.960284 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qxwz4"] Jun 03 14:04:21.960882 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.960866 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" containerName="limitador" Jun 03 14:04:21.960936 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.960885 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" containerName="limitador" Jun 03 14:04:21.960936 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.960932 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" containerName="authorino" Jun 03 14:04:21.961002 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.960941 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" containerName="authorino" Jun 03 14:04:21.961034 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.961014 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="553dfaa4-5bb8-42bc-ab86-4ccb3288ac1d" containerName="authorino" Jun 03 14:04:21.961034 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.961030 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="c39d6572-2745-4eb7-9c5a-9f6f85e4dcb8" containerName="limitador" Jun 03 14:04:21.964858 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.964829 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:21.967873 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.967852 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 14:04:21.969806 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.969784 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5gbsr\"" Jun 03 14:04:21.980379 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:21.980351 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qxwz4"] Jun 03 14:04:22.048728 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.048661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-data\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.048728 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.048728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wl8\" (UniqueName: \"kubernetes.io/projected/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-kube-api-access-c7wl8\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.149919 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.149887 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-data\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.149919 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.149924 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wl8\" (UniqueName: \"kubernetes.io/projected/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-kube-api-access-c7wl8\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.150317 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.150291 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-data\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.160825 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.160794 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wl8\" (UniqueName: \"kubernetes.io/projected/84fcb413-60a2-4f6f-a6c4-9d80b8b44351-kube-api-access-c7wl8\") pod \"postgres-68c4fbbd6f-qxwz4\" (UID: \"84fcb413-60a2-4f6f-a6c4-9d80b8b44351\") " pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.277884 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.277780 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:22.424403 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.424367 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qxwz4"] Jun 03 14:04:22.427549 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:04:22.427517 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fcb413_60a2_4f6f_a6c4_9d80b8b44351.slice/crio-9275f6dcbd042a07dfdd554f9858d7a2596100d054429e5687bd627b9a268306 WatchSource:0}: Error finding container 9275f6dcbd042a07dfdd554f9858d7a2596100d054429e5687bd627b9a268306: Status 404 returned error can't find the container with id 9275f6dcbd042a07dfdd554f9858d7a2596100d054429e5687bd627b9a268306 Jun 03 14:04:22.792324 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:22.792291 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" event={"ID":"84fcb413-60a2-4f6f-a6c4-9d80b8b44351","Type":"ContainerStarted","Data":"9275f6dcbd042a07dfdd554f9858d7a2596100d054429e5687bd627b9a268306"} Jun 03 14:04:28.817804 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:28.817754 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" event={"ID":"84fcb413-60a2-4f6f-a6c4-9d80b8b44351","Type":"ContainerStarted","Data":"44bd542660976b0a1bc28bbc866da977f6f64f5e9c57fa29ded494947a12b867"} Jun 03 14:04:28.818258 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:28.817843 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:04:28.838317 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:28.838270 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" podStartSLOduration=2.4554208 podStartE2EDuration="7.838256384s" podCreationTimestamp="2026-06-03 14:04:21 +0000 UTC" firstStartedPulling="2026-06-03 14:04:22.428924692 +0000 UTC m=+616.404274190" lastFinishedPulling="2026-06-03 14:04:27.811760265 +0000 UTC m=+621.787109774" observedRunningTime="2026-06-03 14:04:28.836036549 +0000 UTC m=+622.811386068" watchObservedRunningTime="2026-06-03 14:04:28.838256384 +0000 UTC m=+622.813605901" Jun 03 14:04:34.852701 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:04:34.852658 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-qxwz4" Jun 03 14:05:05.484134 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.484094 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:05:05.487395 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.487371 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:05.490074 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.490048 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 14:05:05.490303 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.490048 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 14:05:05.490940 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.490820 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xchpd\"" Jun 03 14:05:05.490940 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.490826 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 14:05:05.497487 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.496838 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:05:05.654971 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.654913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49kx\" (UniqueName: \"kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx\") pod \"maas-keycloak-0\" (UID: \"75f48ddd-9ac5-4630-8dbd-14910402f380\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:05.755895 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.755811 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c49kx\" (UniqueName: \"kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx\") pod \"maas-keycloak-0\" (UID: \"75f48ddd-9ac5-4630-8dbd-14910402f380\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:05.765071 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.765037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49kx\" (UniqueName: \"kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx\") pod \"maas-keycloak-0\" (UID: \"75f48ddd-9ac5-4630-8dbd-14910402f380\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:05.802068 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.801980 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:05.937962 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.937938 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:05:05.940402 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:05:05.940374 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f48ddd_9ac5_4630_8dbd_14910402f380.slice/crio-901f66867f9247bfeccb096bd5cbc5d797ce8830c79ff74a51cc845067ee4beb WatchSource:0}: Error finding container 901f66867f9247bfeccb096bd5cbc5d797ce8830c79ff74a51cc845067ee4beb: Status 404 returned error can't find the container with id 901f66867f9247bfeccb096bd5cbc5d797ce8830c79ff74a51cc845067ee4beb Jun 03 14:05:05.950549 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:05.950523 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"75f48ddd-9ac5-4630-8dbd-14910402f380","Type":"ContainerStarted","Data":"901f66867f9247bfeccb096bd5cbc5d797ce8830c79ff74a51cc845067ee4beb"} Jun 03 14:05:11.540356 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:11.540330 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 14:05:11.979318 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:11.979267 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"75f48ddd-9ac5-4630-8dbd-14910402f380","Type":"ContainerStarted","Data":"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01"} Jun 03 14:05:12.005761 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:12.005697 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.409964405 podStartE2EDuration="7.005657813s" podCreationTimestamp="2026-06-03 14:05:05 +0000 UTC" firstStartedPulling="2026-06-03 14:05:05.941703249 +0000 UTC m=+659.917052744" lastFinishedPulling="2026-06-03 14:05:11.537396653 +0000 UTC m=+665.512746152" observedRunningTime="2026-06-03 14:05:12.003464235 +0000 UTC m=+665.978813755" watchObservedRunningTime="2026-06-03 14:05:12.005657813 +0000 UTC m=+665.981007333" Jun 03 14:05:12.803114 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:12.803072 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:12.804847 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:12.804783 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:13.802556 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:13.802503 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:14.802588 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:14.802536 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:15.802750 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:15.802702 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:15.803482 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:15.803447 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:16.803134 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:16.803076 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:17.802852 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:17.802803 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:18.802721 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:18.802645 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:19.802710 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:19.802639 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:20.803147 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:20.803097 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:21.803439 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:21.803387 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:22.802719 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:22.802646 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:23.802640 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:23.802595 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 03 14:05:24.914043 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:24.913988 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:24.930581 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:24.930515 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 14:05:34.920146 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:34.920107 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 14:05:36.217151 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.217117 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:05:36.224812 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.224783 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.227713 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.227659 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gjbmw\"" Jun 03 14:05:36.227947 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.227924 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:05:36.228391 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.228370 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 14:05:36.377693 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.377629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lph59\" (UniqueName: \"kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.377866 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.377765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.479036 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.478944 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lph59\" (UniqueName: \"kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.479187 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.479041 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.481654 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.481634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.487560 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.487533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lph59\" (UniqueName: \"kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59\") pod \"authorino-9b66bc4b9-pzthm\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.541395 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.541350 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:05:36.677405 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:36.677379 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:05:36.680481 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:05:36.680444 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb507a19_145b_491e_9258_21a3bd5cfb8c.slice/crio-82671082e26fa2fa50898f7343fdbd0c220a8fa112f7e3e2c5dd7f5ecbffa61b WatchSource:0}: Error finding container 82671082e26fa2fa50898f7343fdbd0c220a8fa112f7e3e2c5dd7f5ecbffa61b: Status 404 returned error can't find the container with id 82671082e26fa2fa50898f7343fdbd0c220a8fa112f7e3e2c5dd7f5ecbffa61b Jun 03 14:05:37.096495 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:37.096453 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" event={"ID":"bb507a19-145b-491e-9258-21a3bd5cfb8c","Type":"ContainerStarted","Data":"82671082e26fa2fa50898f7343fdbd0c220a8fa112f7e3e2c5dd7f5ecbffa61b"} Jun 03 14:05:38.101783 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:38.101745 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" event={"ID":"bb507a19-145b-491e-9258-21a3bd5cfb8c","Type":"ContainerStarted","Data":"7cb12fb391e259c117f34d999ff3dd2f5df408d6646b0bfceaca88bca431515f"} Jun 03 14:05:38.118498 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:38.118442 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" podStartSLOduration=1.377351133 podStartE2EDuration="2.118426753s" podCreationTimestamp="2026-06-03 14:05:36 +0000 UTC" firstStartedPulling="2026-06-03 14:05:36.681708428 +0000 UTC m=+690.657057922" lastFinishedPulling="2026-06-03 14:05:37.422784045 +0000 UTC m=+691.398133542" observedRunningTime="2026-06-03 14:05:38.118207032 +0000 UTC m=+692.093556550" watchObservedRunningTime="2026-06-03 14:05:38.118426753 +0000 UTC m=+692.093776270" Jun 03 14:05:41.294182 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.294146 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:41.296977 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.296959 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:41.299430 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.299400 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vlkxs\"" Jun 03 14:05:41.299798 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.299773 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 14:05:41.308701 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.308657 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:41.423082 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.423044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmv5\" (UniqueName: \"kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5\") pod \"maas-controller-65f54bd96d-v5pch\" (UID: \"70ee083e-13bd-45b2-b387-a7bd0346ab1d\") " pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:41.446380 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.446341 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78cfc4d7c9-l2qpt"] Jun 03 14:05:41.448900 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.448879 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:41.458498 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.458473 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78cfc4d7c9-l2qpt"] Jun 03 14:05:41.524542 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.524505 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmv5\" (UniqueName: \"kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5\") pod \"maas-controller-65f54bd96d-v5pch\" (UID: \"70ee083e-13bd-45b2-b387-a7bd0346ab1d\") " pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:41.524542 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.524547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7kxv\" (UniqueName: \"kubernetes.io/projected/9d056d84-bd36-4926-b542-b0e8a28c0fbc-kube-api-access-k7kxv\") pod \"maas-controller-78cfc4d7c9-l2qpt\" (UID: \"9d056d84-bd36-4926-b542-b0e8a28c0fbc\") " pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:41.533730 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.533702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmv5\" (UniqueName: \"kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5\") pod \"maas-controller-65f54bd96d-v5pch\" (UID: \"70ee083e-13bd-45b2-b387-a7bd0346ab1d\") " pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:41.610291 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.610254 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:41.625600 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.625572 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7kxv\" (UniqueName: \"kubernetes.io/projected/9d056d84-bd36-4926-b542-b0e8a28c0fbc-kube-api-access-k7kxv\") pod \"maas-controller-78cfc4d7c9-l2qpt\" (UID: \"9d056d84-bd36-4926-b542-b0e8a28c0fbc\") " pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:41.634921 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.634891 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7kxv\" (UniqueName: \"kubernetes.io/projected/9d056d84-bd36-4926-b542-b0e8a28c0fbc-kube-api-access-k7kxv\") pod \"maas-controller-78cfc4d7c9-l2qpt\" (UID: \"9d056d84-bd36-4926-b542-b0e8a28c0fbc\") " pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:41.744422 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.744393 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:41.747276 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:05:41.747243 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ee083e_13bd_45b2_b387_a7bd0346ab1d.slice/crio-6b1367f68c10e613507ab908b27b30d25e77df461fcd443c8d468a956ef68075 WatchSource:0}: Error finding container 6b1367f68c10e613507ab908b27b30d25e77df461fcd443c8d468a956ef68075: Status 404 returned error can't find the container with id 6b1367f68c10e613507ab908b27b30d25e77df461fcd443c8d468a956ef68075 Jun 03 14:05:41.748647 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.748630 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:05:41.760591 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.760562 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:41.894561 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:41.894537 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78cfc4d7c9-l2qpt"] Jun 03 14:05:41.896761 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:05:41.896732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d056d84_bd36_4926_b542_b0e8a28c0fbc.slice/crio-dfacdfc4227efd4acc9b5bdb9ca2a647e31068bc8ee174aa1f6e334eb129edb1 WatchSource:0}: Error finding container dfacdfc4227efd4acc9b5bdb9ca2a647e31068bc8ee174aa1f6e334eb129edb1: Status 404 returned error can't find the container with id dfacdfc4227efd4acc9b5bdb9ca2a647e31068bc8ee174aa1f6e334eb129edb1 Jun 03 14:05:42.115146 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:42.115112 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f54bd96d-v5pch" event={"ID":"70ee083e-13bd-45b2-b387-a7bd0346ab1d","Type":"ContainerStarted","Data":"6b1367f68c10e613507ab908b27b30d25e77df461fcd443c8d468a956ef68075"} Jun 03 14:05:42.116093 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:42.116073 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" event={"ID":"9d056d84-bd36-4926-b542-b0e8a28c0fbc","Type":"ContainerStarted","Data":"dfacdfc4227efd4acc9b5bdb9ca2a647e31068bc8ee174aa1f6e334eb129edb1"} Jun 03 14:05:45.129859 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.129818 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f54bd96d-v5pch" event={"ID":"70ee083e-13bd-45b2-b387-a7bd0346ab1d","Type":"ContainerStarted","Data":"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5"} Jun 03 14:05:45.130301 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.129951 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:45.131200 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.131174 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" event={"ID":"9d056d84-bd36-4926-b542-b0e8a28c0fbc","Type":"ContainerStarted","Data":"bde7cdf2bb781d2e2c44cc8d2c5ccdad4d0b55aac045cc0f20a170eb5758be87"} Jun 03 14:05:45.131293 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.131277 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:45.153251 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.153201 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-65f54bd96d-v5pch" podStartSLOduration=1.3238083330000001 podStartE2EDuration="4.153184726s" podCreationTimestamp="2026-06-03 14:05:41 +0000 UTC" firstStartedPulling="2026-06-03 14:05:41.748775231 +0000 UTC m=+695.724124725" lastFinishedPulling="2026-06-03 14:05:44.578151623 +0000 UTC m=+698.553501118" observedRunningTime="2026-06-03 14:05:45.150973818 +0000 UTC m=+699.126323336" watchObservedRunningTime="2026-06-03 14:05:45.153184726 +0000 UTC m=+699.128534245" Jun 03 14:05:45.169869 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:45.169815 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" podStartSLOduration=1.4847645329999999 podStartE2EDuration="4.169796573s" podCreationTimestamp="2026-06-03 14:05:41 +0000 UTC" firstStartedPulling="2026-06-03 14:05:41.898138118 +0000 UTC m=+695.873487617" lastFinishedPulling="2026-06-03 14:05:44.583170159 +0000 UTC m=+698.558519657" observedRunningTime="2026-06-03 14:05:45.167886525 +0000 UTC m=+699.143236043" watchObservedRunningTime="2026-06-03 14:05:45.169796573 +0000 UTC m=+699.145146086" Jun 03 14:05:56.144371 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.144334 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:56.144799 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.144519 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78cfc4d7c9-l2qpt" Jun 03 14:05:56.241409 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.241367 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:56.241648 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.241621 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-65f54bd96d-v5pch" podUID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" containerName="manager" containerID="cri-o://8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5" gracePeriod=30 Jun 03 14:05:56.491179 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.491155 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:56.565406 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.565368 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmv5\" (UniqueName: \"kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5\") pod \"70ee083e-13bd-45b2-b387-a7bd0346ab1d\" (UID: \"70ee083e-13bd-45b2-b387-a7bd0346ab1d\") " Jun 03 14:05:56.567686 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.567653 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5" (OuterVolumeSpecName: "kube-api-access-xnmv5") pod "70ee083e-13bd-45b2-b387-a7bd0346ab1d" (UID: "70ee083e-13bd-45b2-b387-a7bd0346ab1d"). InnerVolumeSpecName "kube-api-access-xnmv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:05:56.672866 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:56.667500 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmv5\" (UniqueName: \"kubernetes.io/projected/70ee083e-13bd-45b2-b387-a7bd0346ab1d-kube-api-access-xnmv5\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:05:57.176153 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.176109 2581 generic.go:358] "Generic (PLEG): container finished" podID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" containerID="8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5" exitCode=0 Jun 03 14:05:57.176556 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.176197 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f54bd96d-v5pch" event={"ID":"70ee083e-13bd-45b2-b387-a7bd0346ab1d","Type":"ContainerDied","Data":"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5"} Jun 03 14:05:57.176556 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.176210 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f54bd96d-v5pch" Jun 03 14:05:57.176556 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.176242 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f54bd96d-v5pch" event={"ID":"70ee083e-13bd-45b2-b387-a7bd0346ab1d","Type":"ContainerDied","Data":"6b1367f68c10e613507ab908b27b30d25e77df461fcd443c8d468a956ef68075"} Jun 03 14:05:57.176556 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.176264 2581 scope.go:117] "RemoveContainer" containerID="8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5" Jun 03 14:05:57.184797 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.184778 2581 scope.go:117] "RemoveContainer" containerID="8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5" Jun 03 14:05:57.185085 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:05:57.185054 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5\": container with ID starting with 8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5 not found: ID does not exist" containerID="8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5" Jun 03 14:05:57.185187 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.185092 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5"} err="failed to get container status \"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5\": rpc error: code = NotFound desc = could not find container \"8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5\": container with ID starting with 8c7b2d9d99aa6292c23b63d4f8712962198ccea865ec05e0f1fa0044809c5bf5 not found: ID does not exist" Jun 03 14:05:57.200596 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.200561 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:57.208803 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:57.208771 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65f54bd96d-v5pch"] Jun 03 14:05:58.620494 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:05:58.620461 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" path="/var/lib/kubelet/pods/70ee083e-13bd-45b2-b387-a7bd0346ab1d/volumes" Jun 03 14:06:15.911057 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.911024 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8654649b48-2vh76"] Jun 03 14:06:15.911627 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.911456 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" containerName="manager" Jun 03 14:06:15.911627 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.911469 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" containerName="manager" Jun 03 14:06:15.911627 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.911562 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="70ee083e-13bd-45b2-b387-a7bd0346ab1d" containerName="manager" Jun 03 14:06:15.916157 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.916134 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:15.922114 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.922042 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 14:06:15.945082 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:15.945047 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8654649b48-2vh76"] Jun 03 14:06:16.036963 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.036926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-maas-api-tls\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.037144 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.036980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkss4\" (UniqueName: \"kubernetes.io/projected/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-kube-api-access-kkss4\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.138279 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.138241 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-maas-api-tls\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.138500 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.138296 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkss4\" (UniqueName: \"kubernetes.io/projected/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-kube-api-access-kkss4\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.140974 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.140947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-maas-api-tls\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.147463 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.147441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkss4\" (UniqueName: \"kubernetes.io/projected/79a6aef8-4063-4459-8c4b-c3a4cc62f34d-kube-api-access-kkss4\") pod \"maas-api-8654649b48-2vh76\" (UID: \"79a6aef8-4063-4459-8c4b-c3a4cc62f34d\") " pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.227506 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.227417 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:16.372504 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.372469 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8654649b48-2vh76"] Jun 03 14:06:16.374635 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:06:16.374604 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a6aef8_4063_4459_8c4b_c3a4cc62f34d.slice/crio-8e7ebd3113f96a2d02c1c1415e4f2be9b769fb1e834d690d74a4ad925e556cfc WatchSource:0}: Error finding container 8e7ebd3113f96a2d02c1c1415e4f2be9b769fb1e834d690d74a4ad925e556cfc: Status 404 returned error can't find the container with id 8e7ebd3113f96a2d02c1c1415e4f2be9b769fb1e834d690d74a4ad925e556cfc Jun 03 14:06:16.527635 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.527545 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-b2q5w"] Jun 03 14:06:16.532541 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.532517 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:16.534883 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.534851 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 14:06:16.534883 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.534877 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hzrrd\"" Jun 03 14:06:16.545130 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.545103 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-b2q5w"] Jun 03 14:06:16.643199 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.643163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtkt\" (UniqueName: \"kubernetes.io/projected/204f544c-25e8-4008-861b-bfa3563bed3a-kube-api-access-ljtkt\") pod \"payload-processing-58b6c8fdc7-b2q5w\" (UID: \"204f544c-25e8-4008-861b-bfa3563bed3a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:16.744617 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.744576 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtkt\" (UniqueName: \"kubernetes.io/projected/204f544c-25e8-4008-861b-bfa3563bed3a-kube-api-access-ljtkt\") pod \"payload-processing-58b6c8fdc7-b2q5w\" (UID: \"204f544c-25e8-4008-861b-bfa3563bed3a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:16.757986 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.757962 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtkt\" (UniqueName: \"kubernetes.io/projected/204f544c-25e8-4008-861b-bfa3563bed3a-kube-api-access-ljtkt\") pod \"payload-processing-58b6c8fdc7-b2q5w\" (UID: \"204f544c-25e8-4008-861b-bfa3563bed3a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:16.843982 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.843945 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:16.985913 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:16.985878 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-b2q5w"] Jun 03 14:06:16.988880 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:06:16.988848 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f544c_25e8_4008_861b_bfa3563bed3a.slice/crio-2885ca5c0cd671855497a2760b74b5c9395b003dd4cf0ac4d4c8e47dc4be7480 WatchSource:0}: Error finding container 2885ca5c0cd671855497a2760b74b5c9395b003dd4cf0ac4d4c8e47dc4be7480: Status 404 returned error can't find the container with id 2885ca5c0cd671855497a2760b74b5c9395b003dd4cf0ac4d4c8e47dc4be7480 Jun 03 14:06:17.255626 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:17.255531 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" event={"ID":"204f544c-25e8-4008-861b-bfa3563bed3a","Type":"ContainerStarted","Data":"2885ca5c0cd671855497a2760b74b5c9395b003dd4cf0ac4d4c8e47dc4be7480"} Jun 03 14:06:17.256692 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:17.256636 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8654649b48-2vh76" event={"ID":"79a6aef8-4063-4459-8c4b-c3a4cc62f34d","Type":"ContainerStarted","Data":"8e7ebd3113f96a2d02c1c1415e4f2be9b769fb1e834d690d74a4ad925e556cfc"} Jun 03 14:06:19.267876 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:19.267824 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8654649b48-2vh76" event={"ID":"79a6aef8-4063-4459-8c4b-c3a4cc62f34d","Type":"ContainerStarted","Data":"e41e1c0c959b2757fe4b86810c2a4d79ae6d667570fc440ae6932bbaa66dabfc"} Jun 03 14:06:19.268350 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:19.268139 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:19.289866 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:19.289814 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-8654649b48-2vh76" podStartSLOduration=2.422331313 podStartE2EDuration="4.289799053s" podCreationTimestamp="2026-06-03 14:06:15 +0000 UTC" firstStartedPulling="2026-06-03 14:06:16.376006192 +0000 UTC m=+730.351355686" lastFinishedPulling="2026-06-03 14:06:18.243473912 +0000 UTC m=+732.218823426" observedRunningTime="2026-06-03 14:06:19.28716173 +0000 UTC m=+733.262511248" watchObservedRunningTime="2026-06-03 14:06:19.289799053 +0000 UTC m=+733.265148571" Jun 03 14:06:20.273381 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:20.273340 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" event={"ID":"204f544c-25e8-4008-861b-bfa3563bed3a","Type":"ContainerStarted","Data":"11370c2376fa7899d384e782a9666e2db002bd71595c63f5ddc96569faf0daa4"} Jun 03 14:06:20.273801 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:20.273414 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:20.295050 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:20.295006 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" podStartSLOduration=1.919847705 podStartE2EDuration="4.294991375s" podCreationTimestamp="2026-06-03 14:06:16 +0000 UTC" firstStartedPulling="2026-06-03 14:06:16.991090778 +0000 UTC m=+730.966440273" lastFinishedPulling="2026-06-03 14:06:19.366234444 +0000 UTC m=+733.341583943" observedRunningTime="2026-06-03 14:06:20.292715707 +0000 UTC m=+734.268065225" watchObservedRunningTime="2026-06-03 14:06:20.294991375 +0000 UTC m=+734.270340892" Jun 03 14:06:25.279137 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:25.279063 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8654649b48-2vh76" Jun 03 14:06:27.064395 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:27.064358 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:27.064928 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:27.064608 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" containerID="cri-o://1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01" gracePeriod=30 Jun 03 14:06:28.706923 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:28.706899 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:28.868045 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:28.868002 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c49kx\" (UniqueName: \"kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx\") pod \"75f48ddd-9ac5-4630-8dbd-14910402f380\" (UID: \"75f48ddd-9ac5-4630-8dbd-14910402f380\") " Jun 03 14:06:28.870336 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:28.870310 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx" (OuterVolumeSpecName: "kube-api-access-c49kx") pod "75f48ddd-9ac5-4630-8dbd-14910402f380" (UID: "75f48ddd-9ac5-4630-8dbd-14910402f380"). InnerVolumeSpecName "kube-api-access-c49kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:06:28.968668 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:28.968626 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c49kx\" (UniqueName: \"kubernetes.io/projected/75f48ddd-9ac5-4630-8dbd-14910402f380-kube-api-access-c49kx\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:06:29.308212 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.308174 2581 generic.go:358] "Generic (PLEG): container finished" podID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerID="1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01" exitCode=143 Jun 03 14:06:29.308368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.308229 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.308368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.308262 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"75f48ddd-9ac5-4630-8dbd-14910402f380","Type":"ContainerDied","Data":"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01"} Jun 03 14:06:29.308368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.308303 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"75f48ddd-9ac5-4630-8dbd-14910402f380","Type":"ContainerDied","Data":"901f66867f9247bfeccb096bd5cbc5d797ce8830c79ff74a51cc845067ee4beb"} Jun 03 14:06:29.308368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.308321 2581 scope.go:117] "RemoveContainer" containerID="1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01" Jun 03 14:06:29.318301 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.318284 2581 scope.go:117] "RemoveContainer" containerID="1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01" Jun 03 14:06:29.318552 ip-10-0-136-17 kubenswrapper[2581]: E0603 14:06:29.318533 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01\": container with ID starting with 1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01 not found: ID does not exist" containerID="1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01" Jun 03 14:06:29.318601 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.318559 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01"} err="failed to get container status \"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01\": rpc error: code = NotFound desc = could not find container \"1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01\": container with ID starting with 1e5b8be6e6fd41515b0785ac676c5a4f866ef0aa51fb413d8f20f4c39eca8c01 not found: ID does not exist" Jun 03 14:06:29.331229 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.331205 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:29.335913 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.335887 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:29.359615 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.359592 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:29.360004 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.359990 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" Jun 03 14:06:29.360052 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.360005 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" Jun 03 14:06:29.360111 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.360103 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" containerName="keycloak" Jun 03 14:06:29.362809 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.362792 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.365353 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.365330 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 14:06:29.365462 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.365330 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 14:06:29.365462 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.365336 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 14:06:29.365563 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.365338 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 14:06:29.365837 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.365822 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xchpd\"" Jun 03 14:06:29.373952 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.373929 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:29.472577 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.472546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d21c73c0-cf39-4207-be85-20e86d0079b0-test-realms\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.472577 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.472582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtr2k\" (UniqueName: \"kubernetes.io/projected/d21c73c0-cf39-4207-be85-20e86d0079b0-kube-api-access-xtr2k\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.573785 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.573698 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d21c73c0-cf39-4207-be85-20e86d0079b0-test-realms\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.573785 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.573740 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtr2k\" (UniqueName: \"kubernetes.io/projected/d21c73c0-cf39-4207-be85-20e86d0079b0-kube-api-access-xtr2k\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.574450 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.574430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d21c73c0-cf39-4207-be85-20e86d0079b0-test-realms\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.582817 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.582796 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtr2k\" (UniqueName: \"kubernetes.io/projected/d21c73c0-cf39-4207-be85-20e86d0079b0-kube-api-access-xtr2k\") pod \"maas-keycloak-0\" (UID: \"d21c73c0-cf39-4207-be85-20e86d0079b0\") " pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.672717 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.672666 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:29.810372 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:29.810347 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 14:06:29.812761 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:06:29.812732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21c73c0_cf39_4207_be85_20e86d0079b0.slice/crio-fc7c9937cd2dbaa6ddd98b9852876a69dce9dd0b75c45daefe99ffce50a36bdc WatchSource:0}: Error finding container fc7c9937cd2dbaa6ddd98b9852876a69dce9dd0b75c45daefe99ffce50a36bdc: Status 404 returned error can't find the container with id fc7c9937cd2dbaa6ddd98b9852876a69dce9dd0b75c45daefe99ffce50a36bdc Jun 03 14:06:30.313692 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.313632 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d21c73c0-cf39-4207-be85-20e86d0079b0","Type":"ContainerStarted","Data":"259a63f06eb2c2af6d44405d91d97c695d04d4e243aa4ea95a461829ff1edbf3"} Jun 03 14:06:30.313692 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.313698 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d21c73c0-cf39-4207-be85-20e86d0079b0","Type":"ContainerStarted","Data":"fc7c9937cd2dbaa6ddd98b9852876a69dce9dd0b75c45daefe99ffce50a36bdc"} Jun 03 14:06:30.334890 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.334820 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.951557058 podStartE2EDuration="1.334798147s" podCreationTimestamp="2026-06-03 14:06:29 +0000 UTC" firstStartedPulling="2026-06-03 14:06:29.814055515 +0000 UTC m=+743.789405010" lastFinishedPulling="2026-06-03 14:06:30.197296604 +0000 UTC m=+744.172646099" observedRunningTime="2026-06-03 14:06:30.331706551 +0000 UTC m=+744.307056067" watchObservedRunningTime="2026-06-03 14:06:30.334798147 +0000 UTC m=+744.310147665" Jun 03 14:06:30.622546 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.622498 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f48ddd-9ac5-4630-8dbd-14910402f380" path="/var/lib/kubelet/pods/75f48ddd-9ac5-4630-8dbd-14910402f380/volumes" Jun 03 14:06:30.672956 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.672915 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:30.674371 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:30.674333 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:31.280555 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:31.280519 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-b2q5w" Jun 03 14:06:31.674018 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:31.673966 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:32.673360 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:32.673290 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:33.673909 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:33.673859 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:34.673739 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:34.673667 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:35.673359 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:35.673300 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:36.674094 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:36.674034 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:37.673830 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:37.673771 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:38.673462 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:38.673410 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:39.673039 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:39.673001 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:39.673391 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:39.673356 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:40.673906 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:40.673855 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:41.674168 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:41.674103 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:42.673545 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:42.673498 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 03 14:06:43.783392 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:43.783348 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 14:06:43.799560 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:43.799512 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d21c73c0-cf39-4207-be85-20e86d0079b0" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 14:06:53.789081 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:06:53.789038 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 14:07:06.237938 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.237899 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:07:06.238345 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.238135 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" podUID="bb507a19-145b-491e-9258-21a3bd5cfb8c" containerName="authorino" containerID="cri-o://7cb12fb391e259c117f34d999ff3dd2f5df408d6646b0bfceaca88bca431515f" gracePeriod=30 Jun 03 14:07:06.467053 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.467017 2581 generic.go:358] "Generic (PLEG): container finished" podID="bb507a19-145b-491e-9258-21a3bd5cfb8c" containerID="7cb12fb391e259c117f34d999ff3dd2f5df408d6646b0bfceaca88bca431515f" exitCode=0 Jun 03 14:07:06.467225 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.467070 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" event={"ID":"bb507a19-145b-491e-9258-21a3bd5cfb8c","Type":"ContainerDied","Data":"7cb12fb391e259c117f34d999ff3dd2f5df408d6646b0bfceaca88bca431515f"} Jun 03 14:07:06.490577 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.490510 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:07:06.567531 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.567502 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lph59\" (UniqueName: \"kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59\") pod \"bb507a19-145b-491e-9258-21a3bd5cfb8c\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " Jun 03 14:07:06.567730 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.567543 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert\") pod \"bb507a19-145b-491e-9258-21a3bd5cfb8c\" (UID: \"bb507a19-145b-491e-9258-21a3bd5cfb8c\") " Jun 03 14:07:06.569835 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.569806 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59" (OuterVolumeSpecName: "kube-api-access-lph59") pod "bb507a19-145b-491e-9258-21a3bd5cfb8c" (UID: "bb507a19-145b-491e-9258-21a3bd5cfb8c"). InnerVolumeSpecName "kube-api-access-lph59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:07:06.578779 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.578743 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bb507a19-145b-491e-9258-21a3bd5cfb8c" (UID: "bb507a19-145b-491e-9258-21a3bd5cfb8c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:07:06.668770 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.668735 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lph59\" (UniqueName: \"kubernetes.io/projected/bb507a19-145b-491e-9258-21a3bd5cfb8c-kube-api-access-lph59\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:07:06.668770 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:06.668767 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb507a19-145b-491e-9258-21a3bd5cfb8c-tls-cert\") on node \"ip-10-0-136-17.ec2.internal\" DevicePath \"\"" Jun 03 14:07:07.472440 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:07.472408 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" Jun 03 14:07:07.472915 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:07.472412 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b66bc4b9-pzthm" event={"ID":"bb507a19-145b-491e-9258-21a3bd5cfb8c","Type":"ContainerDied","Data":"82671082e26fa2fa50898f7343fdbd0c220a8fa112f7e3e2c5dd7f5ecbffa61b"} Jun 03 14:07:07.472915 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:07.472542 2581 scope.go:117] "RemoveContainer" containerID="7cb12fb391e259c117f34d999ff3dd2f5df408d6646b0bfceaca88bca431515f" Jun 03 14:07:07.489842 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:07.489807 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:07:07.494394 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:07.494365 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9b66bc4b9-pzthm"] Jun 03 14:07:08.620633 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:08.620589 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb507a19-145b-491e-9258-21a3bd5cfb8c" path="/var/lib/kubelet/pods/bb507a19-145b-491e-9258-21a3bd5cfb8c/volumes" Jun 03 14:07:29.827090 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.826999 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct"] Jun 03 14:07:29.827637 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.827425 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb507a19-145b-491e-9258-21a3bd5cfb8c" containerName="authorino" Jun 03 14:07:29.827637 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.827437 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb507a19-145b-491e-9258-21a3bd5cfb8c" containerName="authorino" Jun 03 14:07:29.827637 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.827510 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb507a19-145b-491e-9258-21a3bd5cfb8c" containerName="authorino" Jun 03 14:07:29.830933 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.830912 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.834762 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.834736 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 14:07:29.834879 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.834736 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 14:07:29.834879 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.834813 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-64tsr\"" Jun 03 14:07:29.834995 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.834975 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 14:07:29.850035 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.850005 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct"] Jun 03 14:07:29.884560 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.884748 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.884748 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.884748 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.884748 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.884748 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.884744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhf9f\" (UniqueName: \"kubernetes.io/projected/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kube-api-access-dhf9f\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986173 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986131 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986379 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986188 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986379 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986322 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986379 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986377 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986555 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986420 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986555 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986496 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhf9f\" (UniqueName: \"kubernetes.io/projected/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kube-api-access-dhf9f\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986659 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986757 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986657 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.986855 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.986837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.988838 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.988812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.989002 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.988987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:29.996021 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:29.995995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhf9f\" (UniqueName: \"kubernetes.io/projected/1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1-kube-api-access-dhf9f\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct\" (UID: \"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:30.144152 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:30.144058 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" Jun 03 14:07:30.288811 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:30.288778 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct"] Jun 03 14:07:30.291219 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:07:30.291190 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f62a1e9_eeb6_4877_9d30_a4dd4d5a1bf1.slice/crio-f8b713f53d4411d71c6aeb3ef28b2dee002cd0a4d11357fbf70bf6b37403bded WatchSource:0}: Error finding container f8b713f53d4411d71c6aeb3ef28b2dee002cd0a4d11357fbf70bf6b37403bded: Status 404 returned error can't find the container with id f8b713f53d4411d71c6aeb3ef28b2dee002cd0a4d11357fbf70bf6b37403bded Jun 03 14:07:30.557622 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:30.557590 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" event={"ID":"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1","Type":"ContainerStarted","Data":"f8b713f53d4411d71c6aeb3ef28b2dee002cd0a4d11357fbf70bf6b37403bded"} Jun 03 14:07:35.578124 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:35.578085 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct" event={"ID":"1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1","Type":"ContainerStarted","Data":"d42b770e0734174289fdfd31a0f306a9440bf0313b3993b08273a5aeca875e1d"} Jun 03 14:07:44.096480 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.096438 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw"] Jun 03 14:07:44.101273 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.101247 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.103378 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.103357 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 14:07:44.109015 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.108989 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw"] Jun 03 14:07:44.225110 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.225303 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.225303 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqcvn\" (UniqueName: \"kubernetes.io/projected/c116e324-c58b-425e-acd3-74d4642615bd-kube-api-access-xqcvn\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.225303 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c116e324-c58b-425e-acd3-74d4642615bd-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.225416 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.225416 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.225386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326316 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326269 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326518 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326340 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326518 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326518 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326405 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqcvn\" (UniqueName: \"kubernetes.io/projected/c116e324-c58b-425e-acd3-74d4642615bd-kube-api-access-xqcvn\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326518 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326463 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c116e324-c58b-425e-acd3-74d4642615bd-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326766 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326519 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326825 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.326958 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326927 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.327081 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.326929 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.329086 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.329063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c116e324-c58b-425e-acd3-74d4642615bd-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.329298 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.329281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c116e324-c58b-425e-acd3-74d4642615bd-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.337026 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.336992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqcvn\" (UniqueName: \"kubernetes.io/projected/c116e324-c58b-425e-acd3-74d4642615bd-kube-api-access-xqcvn\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw\" (UID: \"c116e324-c58b-425e-acd3-74d4642615bd\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.414209 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.414134 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" Jun 03 14:07:44.554003 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.553976 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw"] Jun 03 14:07:44.556976 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:07:44.556945 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc116e324_c58b_425e_acd3_74d4642615bd.slice/crio-a198de08d4d06714c64a8d2dee24387e6908006a9629bda350fa6c8601bab028 WatchSource:0}: Error finding container a198de08d4d06714c64a8d2dee24387e6908006a9629bda350fa6c8601bab028: Status 404 returned error can't find the container with id a198de08d4d06714c64a8d2dee24387e6908006a9629bda350fa6c8601bab028 Jun 03 14:07:44.612102 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:44.612070 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" event={"ID":"c116e324-c58b-425e-acd3-74d4642615bd","Type":"ContainerStarted","Data":"a198de08d4d06714c64a8d2dee24387e6908006a9629bda350fa6c8601bab028"} Jun 03 14:07:45.617809 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:45.617763 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw" event={"ID":"c116e324-c58b-425e-acd3-74d4642615bd","Type":"ContainerStarted","Data":"f721cedd7fe75a140b9db943dbac621f97f9b02444448c029a134ddeb4cc0a1a"} Jun 03 14:07:56.591363 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.591326 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4"] Jun 03 14:07:56.598034 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.598009 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.600947 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.600923 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 14:07:56.605947 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.605916 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4"] Jun 03 14:07:56.739470 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.739470 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.739707 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.739764 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6rd\" (UniqueName: \"kubernetes.io/projected/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kube-api-access-4t6rd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.739764 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.739866 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.739819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.840654 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840613 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.840858 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840663 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.840858 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840749 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.840858 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840771 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.840858 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840803 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.841068 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.840876 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6rd\" (UniqueName: \"kubernetes.io/projected/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kube-api-access-4t6rd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.841122 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.841089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.841176 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.841119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.841252 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.841234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.843299 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.843248 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.843447 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.843429 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.849486 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.849466 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6rd\" (UniqueName: \"kubernetes.io/projected/bfb9dccd-c79c-41b6-89d1-7fae11ca3151-kube-api-access-4t6rd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4\" (UID: \"bfb9dccd-c79c-41b6-89d1-7fae11ca3151\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:56.911444 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:56.911406 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:07:57.053563 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:57.053538 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4"] Jun 03 14:07:57.055813 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:07:57.055781 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb9dccd_c79c_41b6_89d1_7fae11ca3151.slice/crio-19849ef20df04862ae1d9341af0d7eef783959ecc2f593e72d61b0d992ef03c4 WatchSource:0}: Error finding container 19849ef20df04862ae1d9341af0d7eef783959ecc2f593e72d61b0d992ef03c4: Status 404 returned error can't find the container with id 19849ef20df04862ae1d9341af0d7eef783959ecc2f593e72d61b0d992ef03c4 Jun 03 14:07:57.660057 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:57.660018 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" event={"ID":"bfb9dccd-c79c-41b6-89d1-7fae11ca3151","Type":"ContainerStarted","Data":"4a8fbe844ddf95b7f6db00cf268e916afd38ef7ae15c20d2c7ed068305d0d3bd"} Jun 03 14:07:57.660057 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:57.660062 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" event={"ID":"bfb9dccd-c79c-41b6-89d1-7fae11ca3151","Type":"ContainerStarted","Data":"19849ef20df04862ae1d9341af0d7eef783959ecc2f593e72d61b0d992ef03c4"} Jun 03 14:07:59.667843 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:59.667808 2581 generic.go:358] "Generic (PLEG): container finished" podID="bfb9dccd-c79c-41b6-89d1-7fae11ca3151" containerID="4a8fbe844ddf95b7f6db00cf268e916afd38ef7ae15c20d2c7ed068305d0d3bd" exitCode=0 Jun 03 14:07:59.668211 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:07:59.667876 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" event={"ID":"bfb9dccd-c79c-41b6-89d1-7fae11ca3151","Type":"ContainerDied","Data":"4a8fbe844ddf95b7f6db00cf268e916afd38ef7ae15c20d2c7ed068305d0d3bd"} Jun 03 14:08:01.679368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:01.679329 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" event={"ID":"bfb9dccd-c79c-41b6-89d1-7fae11ca3151","Type":"ContainerStarted","Data":"6e277d5b8eccfcdb1ad9f1b4c237a76e62a31f1ce37f32f608b118bf69e0a2c4"} Jun 03 14:08:01.700454 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:01.700398 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" podStartSLOduration=3.823504304 podStartE2EDuration="5.700382589s" podCreationTimestamp="2026-06-03 14:07:56 +0000 UTC" firstStartedPulling="2026-06-03 14:07:59.668443597 +0000 UTC m=+833.643793092" lastFinishedPulling="2026-06-03 14:08:01.545321883 +0000 UTC m=+835.520671377" observedRunningTime="2026-06-03 14:08:01.698378671 +0000 UTC m=+835.673728188" watchObservedRunningTime="2026-06-03 14:08:01.700382589 +0000 UTC m=+835.675732107" Jun 03 14:08:06.911715 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:06.911684 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:08:06.912057 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:06.911726 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:08:06.924573 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:06.924546 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:08:07.712239 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:07.712208 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4" Jun 03 14:08:45.600113 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.600071 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9"] Jun 03 14:08:45.604423 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.604404 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.606965 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.606940 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 14:08:45.612628 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.612605 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9"] Jun 03 14:08:45.723415 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5l26\" (UniqueName: \"kubernetes.io/projected/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kube-api-access-f5l26\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.723583 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.723583 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2496ae93-dca0-4d7c-830a-f50ee5a52b11-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.723583 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.723583 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.723861 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.723641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.824795 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.824759 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5l26\" (UniqueName: \"kubernetes.io/projected/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kube-api-access-f5l26\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.824981 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.824806 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.824981 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.824923 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2496ae93-dca0-4d7c-830a-f50ee5a52b11-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.824981 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.824957 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.825091 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.824981 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.825091 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.825048 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.825414 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.825390 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.825490 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.825434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.825490 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.825471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.827315 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.827292 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2496ae93-dca0-4d7c-830a-f50ee5a52b11-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.827663 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.827643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2496ae93-dca0-4d7c-830a-f50ee5a52b11-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.833415 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.833391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5l26\" (UniqueName: \"kubernetes.io/projected/2496ae93-dca0-4d7c-830a-f50ee5a52b11-kube-api-access-f5l26\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9\" (UID: \"2496ae93-dca0-4d7c-830a-f50ee5a52b11\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:45.935179 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:45.935068 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" Jun 03 14:08:46.082450 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:46.082277 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9"] Jun 03 14:08:46.084890 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:08:46.084863 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2496ae93_dca0_4d7c_830a_f50ee5a52b11.slice/crio-c20949b9ca8bdcebd70a00bd737b394c300dc438f213a39a95423cbb48d8d95f WatchSource:0}: Error finding container c20949b9ca8bdcebd70a00bd737b394c300dc438f213a39a95423cbb48d8d95f: Status 404 returned error can't find the container with id c20949b9ca8bdcebd70a00bd737b394c300dc438f213a39a95423cbb48d8d95f Jun 03 14:08:46.847056 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:46.847027 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" event={"ID":"2496ae93-dca0-4d7c-830a-f50ee5a52b11","Type":"ContainerStarted","Data":"e484c4138567dcb2972e4f4322c0567b6e3543347597b113dc39cfeea3ef068e"} Jun 03 14:08:46.847056 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:08:46.847060 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9" event={"ID":"2496ae93-dca0-4d7c-830a-f50ee5a52b11","Type":"ContainerStarted","Data":"c20949b9ca8bdcebd70a00bd737b394c300dc438f213a39a95423cbb48d8d95f"} Jun 03 14:09:06.767514 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:09:06.767487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:09:06.769193 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:09:06.769165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:09:06.770615 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:09:06.770597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:09:06.772081 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:09:06.772057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:14:06.807939 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:14:06.807899 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:14:06.810754 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:14:06.810732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:14:06.810993 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:14:06.810978 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:14:06.813642 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:14:06.813620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:15:20.358880 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:20.358842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-gfvt9_2496ae93-dca0-4d7c-830a-f50ee5a52b11/storage-initializer/0.log" Jun 03 14:15:26.143637 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:26.143611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8654649b48-2vh76_79a6aef8-4063-4459-8c4b-c3a4cc62f34d/maas-api/0.log" Jun 03 14:15:26.365307 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:26.365277 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78cfc4d7c9-l2qpt_9d056d84-bd36-4926-b542-b0e8a28c0fbc/manager/0.log" Jun 03 14:15:26.844466 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:26.844434 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-cj5tm_b3953289-1176-44d5-9160-8f0268a70ec1/copy-manifests/0.log" Jun 03 14:15:26.857743 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:26.857717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-cj5tm_b3953289-1176-44d5-9160-8f0268a70ec1/manager/0.log" Jun 03 14:15:27.090878 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:27.090847 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qxwz4_84fcb413-60a2-4f6f-a6c4-9d80b8b44351/postgres/0.log" Jun 03 14:15:28.874382 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:28.874342 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5z7st_f0fd8376-6824-4fe4-b920-028ed53af4b6/manager/0.log" Jun 03 14:15:29.758723 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:29.758669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655d7d459-hvs7v_67d44e31-00a4-4b4a-8646-b5643f4da84a/kube-auth-proxy/0.log" Jun 03 14:15:29.983439 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:29.983410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-b2q5w_204f544c-25e8-4008-861b-bfa3563bed3a/payload-processing/0.log" Jun 03 14:15:30.421470 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:30.421431 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-b57ct_1f62a1e9-eeb6-4877-9d30-a4dd4d5a1bf1/storage-initializer/0.log" Jun 03 14:15:30.536537 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:30.536493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-4pxpw_c116e324-c58b-425e-acd3-74d4642615bd/storage-initializer/0.log" Jun 03 14:15:30.649118 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:30.649088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4_bfb9dccd-c79c-41b6-89d1-7fae11ca3151/storage-initializer/0.log" Jun 03 14:15:30.656951 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:30.656918 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rcjx4_bfb9dccd-c79c-41b6-89d1-7fae11ca3151/main/0.log" Jun 03 14:15:38.615008 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:38.614973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6jc4r_8bef0a79-0bb2-4b79-a001-a4932d2b7d9a/global-pull-secret-syncer/0.log" Jun 03 14:15:38.871275 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:38.871194 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jnf4m_89225f41-81ac-42b0-a03b-d83adeaeb75e/konnectivity-agent/0.log" Jun 03 14:15:39.041456 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:39.041424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-17.ec2.internal_45d28ecc598cce1c956e6a0098a3c5fa/haproxy/0.log" Jun 03 14:15:43.331970 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:43.331935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5z7st_f0fd8376-6824-4fe4-b920-028ed53af4b6/manager/0.log" Jun 03 14:15:44.778561 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.778532 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/alertmanager/0.log" Jun 03 14:15:44.807313 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.807286 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/config-reloader/0.log" Jun 03 14:15:44.837652 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.837621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/kube-rbac-proxy-web/0.log" Jun 03 14:15:44.872554 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.872530 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/kube-rbac-proxy/0.log" Jun 03 14:15:44.913471 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.913444 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/kube-rbac-proxy-metric/0.log" Jun 03 14:15:44.936429 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.936392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/prom-label-proxy/0.log" Jun 03 14:15:44.969851 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:44.969787 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_862850a7-169c-4cba-82b4-10d0932d861f/init-config-reloader/0.log" Jun 03 14:15:45.008369 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.008339 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mwz2c_4a6dbb54-58a6-4864-b315-283a46268f8f/cluster-monitoring-operator/0.log" Jun 03 14:15:45.035262 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.035239 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vkbc5_f7fdbb70-c69c-4669-842a-412288c21439/kube-state-metrics/0.log" Jun 03 14:15:45.056055 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.056025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vkbc5_f7fdbb70-c69c-4669-842a-412288c21439/kube-rbac-proxy-main/0.log" Jun 03 14:15:45.082375 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.082344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vkbc5_f7fdbb70-c69c-4669-842a-412288c21439/kube-rbac-proxy-self/0.log" Jun 03 14:15:45.112770 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.112743 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f4ddd7b67-w4c5j_42cc99c8-4497-432c-9434-4093a3784f38/metrics-server/0.log" Jun 03 14:15:45.380284 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.380255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbkl9_389e2a92-97a2-4b52-8102-336a5323cb2f/node-exporter/0.log" Jun 03 14:15:45.402354 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.402324 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbkl9_389e2a92-97a2-4b52-8102-336a5323cb2f/kube-rbac-proxy/0.log" Jun 03 14:15:45.424643 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.424619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbkl9_389e2a92-97a2-4b52-8102-336a5323cb2f/init-textfile/0.log" Jun 03 14:15:45.547371 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.547345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/prometheus/0.log" Jun 03 14:15:45.571519 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.571494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/config-reloader/0.log" Jun 03 14:15:45.597229 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.597197 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/thanos-sidecar/0.log" Jun 03 14:15:45.623800 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.623775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/kube-rbac-proxy-web/0.log" Jun 03 14:15:45.646824 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.646806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/kube-rbac-proxy/0.log" Jun 03 14:15:45.673493 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.673474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/kube-rbac-proxy-thanos/0.log" Jun 03 14:15:45.739608 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.739585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2f5f6e96-c0b7-43df-a6e9-ca3d9a575cd1/init-config-reloader/0.log" Jun 03 14:15:45.903072 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.902991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-jrnc8_af9bb845-3922-4e05-847c-b2d25079d62f/prometheus-operator-admission-webhook/0.log" Jun 03 14:15:45.953155 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.953130 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f7494fc6-5mrk7_8155eda0-ff26-4d49-b590-ab3311a532cf/telemeter-client/0.log" Jun 03 14:15:45.990304 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:45.990266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f7494fc6-5mrk7_8155eda0-ff26-4d49-b590-ab3311a532cf/reload/0.log" Jun 03 14:15:46.036514 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.036488 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f7494fc6-5mrk7_8155eda0-ff26-4d49-b590-ab3311a532cf/kube-rbac-proxy/0.log" Jun 03 14:15:46.105204 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.105160 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/thanos-query/0.log" Jun 03 14:15:46.137203 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.137165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/kube-rbac-proxy-web/0.log" Jun 03 14:15:46.162286 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.162222 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/kube-rbac-proxy/0.log" Jun 03 14:15:46.190708 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.190664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/prom-label-proxy/0.log" Jun 03 14:15:46.220196 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.220176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/kube-rbac-proxy-rules/0.log" Jun 03 14:15:46.257489 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:46.257464 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b9bb4474-tc8jh_d93900d0-054e-49f9-8300-35227e68300c/kube-rbac-proxy-metrics/0.log" Jun 03 14:15:47.861866 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:47.861838 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/1.log" Jun 03 14:15:47.866695 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:47.866658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-gts7k_7dfc771f-6c4a-43d3-a80f-e053d257e428/console-operator/2.log" Jun 03 14:15:48.095777 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.095738 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp"] Jun 03 14:15:48.098778 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.098755 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.103359 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.103340 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c6tt9\"/\"default-dockercfg-d9dxq\"" Jun 03 14:15:48.104213 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.104179 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6tt9\"/\"kube-root-ca.crt\"" Jun 03 14:15:48.104213 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.104185 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6tt9\"/\"openshift-service-ca.crt\"" Jun 03 14:15:48.108724 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.108701 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp"] Jun 03 14:15:48.191853 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.191756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khzhx\" (UniqueName: \"kubernetes.io/projected/b862a4cd-2526-4809-87a4-6ca2191945d3-kube-api-access-khzhx\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.192013 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.191856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-lib-modules\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.192013 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.191922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-podres\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.192013 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.192003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-proc\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.192114 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.192020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-sys\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293325 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293278 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khzhx\" (UniqueName: \"kubernetes.io/projected/b862a4cd-2526-4809-87a4-6ca2191945d3-kube-api-access-khzhx\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293506 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293364 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-lib-modules\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293506 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293428 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-podres\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293506 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293481 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-proc\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293622 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293509 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-sys\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293622 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-podres\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293622 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-lib-modules\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293622 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293593 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-proc\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.293801 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.293629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b862a4cd-2526-4809-87a4-6ca2191945d3-sys\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.302362 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.302342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khzhx\" (UniqueName: \"kubernetes.io/projected/b862a4cd-2526-4809-87a4-6ca2191945d3-kube-api-access-khzhx\") pod \"perf-node-gather-daemonset-mdtvp\" (UID: \"b862a4cd-2526-4809-87a4-6ca2191945d3\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.398942 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.398891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-hgrmq_48760028-2210-41f8-8614-b1bc71497e1b/download-server/0.log" Jun 03 14:15:48.409574 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.409547 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:48.549605 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.549568 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp"] Jun 03 14:15:48.553342 ip-10-0-136-17 kubenswrapper[2581]: W0603 14:15:48.553308 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb862a4cd_2526_4809_87a4_6ca2191945d3.slice/crio-c1977e81b6ec2715f641820418414aaa42e81e8c15ef77ac84128ee4ccbc0e19 WatchSource:0}: Error finding container c1977e81b6ec2715f641820418414aaa42e81e8c15ef77ac84128ee4ccbc0e19: Status 404 returned error can't find the container with id c1977e81b6ec2715f641820418414aaa42e81e8c15ef77ac84128ee4ccbc0e19 Jun 03 14:15:48.554992 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:48.554974 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:15:49.422572 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.422536 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" event={"ID":"b862a4cd-2526-4809-87a4-6ca2191945d3","Type":"ContainerStarted","Data":"935ad61438a7cb987a456f99444e2810e1682e73d0204ad7cd41e000abe6d3e7"} Jun 03 14:15:49.422572 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.422573 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" event={"ID":"b862a4cd-2526-4809-87a4-6ca2191945d3","Type":"ContainerStarted","Data":"c1977e81b6ec2715f641820418414aaa42e81e8c15ef77ac84128ee4ccbc0e19"} Jun 03 14:15:49.423044 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.422694 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:49.442317 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.442269 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" podStartSLOduration=1.442254816 podStartE2EDuration="1.442254816s" podCreationTimestamp="2026-06-03 14:15:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:15:49.439424606 +0000 UTC m=+1303.414774125" watchObservedRunningTime="2026-06-03 14:15:49.442254816 +0000 UTC m=+1303.417604332" Jun 03 14:15:49.759411 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.759331 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84qm2_3159a48e-b426-4194-bd31-02f50ab6e96e/dns/0.log" Jun 03 14:15:49.781707 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.781660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84qm2_3159a48e-b426-4194-bd31-02f50ab6e96e/kube-rbac-proxy/0.log" Jun 03 14:15:49.878334 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:49.878302 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4dtw_9aea1d61-86dd-4c23-92f8-203e692b9863/dns-node-resolver/0.log" Jun 03 14:15:50.455993 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:50.455957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4fvg_73e87676-1566-46fb-b387-9c6b06a52a03/node-ca/0.log" Jun 03 14:15:51.383294 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:51.383264 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655d7d459-hvs7v_67d44e31-00a4-4b4a-8646-b5643f4da84a/kube-auth-proxy/0.log" Jun 03 14:15:51.433174 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:51.433143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-b2q5w_204f544c-25e8-4008-861b-bfa3563bed3a/payload-processing/0.log" Jun 03 14:15:52.060790 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.060763 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vrkqc_86f1366b-dee9-41dd-94a7-3c38f10bd5f0/serve-healthcheck-canary/0.log" Jun 03 14:15:52.538606 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.538520 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9kwns_ef320e45-577f-423d-81b8-dc66cd0dc66e/insights-operator/0.log" Jun 03 14:15:52.538606 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.538568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9kwns_ef320e45-577f-423d-81b8-dc66cd0dc66e/insights-operator/1.log" Jun 03 14:15:52.816763 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.816668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mgst9_f0a0ba07-30f6-4093-80d2-6ecfb636d94c/kube-rbac-proxy/0.log" Jun 03 14:15:52.839978 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.839954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mgst9_f0a0ba07-30f6-4093-80d2-6ecfb636d94c/exporter/0.log" Jun 03 14:15:52.871106 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:52.871080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mgst9_f0a0ba07-30f6-4093-80d2-6ecfb636d94c/extractor/0.log" Jun 03 14:15:55.036090 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.036057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8654649b48-2vh76_79a6aef8-4063-4459-8c4b-c3a4cc62f34d/maas-api/0.log" Jun 03 14:15:55.092759 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.092729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78cfc4d7c9-l2qpt_9d056d84-bd36-4926-b542-b0e8a28c0fbc/manager/0.log" Jun 03 14:15:55.297606 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.297561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-cj5tm_b3953289-1176-44d5-9160-8f0268a70ec1/manager/0.log" Jun 03 14:15:55.319459 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.319436 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-cj5tm_b3953289-1176-44d5-9160-8f0268a70ec1/copy-manifests/0.log" Jun 03 14:15:55.437578 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.437552 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-mdtvp" Jun 03 14:15:55.439007 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:55.438987 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qxwz4_84fcb413-60a2-4f6f-a6c4-9d80b8b44351/postgres/0.log" Jun 03 14:15:56.876535 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:15:56.876501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6557d5d46d-p7nlp_c2c918d3-e768-4aed-b0fa-a22848359223/manager/0.log" Jun 03 14:16:01.562258 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:01.562220 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-2mbmc_db147461-26cd-48fa-a23c-717e1fed4460/migrator/0.log" Jun 03 14:16:01.585401 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:01.585376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-2mbmc_db147461-26cd-48fa-a23c-717e1fed4460/graceful-termination/0.log" Jun 03 14:16:02.915481 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:02.915450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6ww2v_b6b214cf-e87e-4ee2-b8ab-2b1fd9da08f7/kube-multus/0.log" Jun 03 14:16:03.117201 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.117170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/kube-multus-additional-cni-plugins/0.log" Jun 03 14:16:03.140997 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.140966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/egress-router-binary-copy/0.log" Jun 03 14:16:03.164293 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.164271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/cni-plugins/0.log" Jun 03 14:16:03.186135 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.186067 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/bond-cni-plugin/0.log" Jun 03 14:16:03.209368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.209343 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/routeoverride-cni/0.log" Jun 03 14:16:03.229821 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.229803 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/whereabouts-cni-bincopy/0.log" Jun 03 14:16:03.252948 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.252930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s5grz_680104bf-eb29-42da-953e-6d8ece5116b3/whereabouts-cni/0.log" Jun 03 14:16:03.613732 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.613706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6mtg_b32714fb-178b-4bd9-9745-e6b897cce2a4/network-metrics-daemon/0.log" Jun 03 14:16:03.635146 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:03.635120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6mtg_b32714fb-178b-4bd9-9745-e6b897cce2a4/kube-rbac-proxy/0.log" Jun 03 14:16:04.497179 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.497151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-controller/0.log" Jun 03 14:16:04.515533 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.515486 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/0.log" Jun 03 14:16:04.520950 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.520909 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovn-acl-logging/1.log" Jun 03 14:16:04.540181 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.540161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/kube-rbac-proxy-node/0.log" Jun 03 14:16:04.560368 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.560345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 14:16:04.578789 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.578767 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/northd/0.log" Jun 03 14:16:04.602532 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.602512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/nbdb/0.log" Jun 03 14:16:04.626818 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.626795 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/sbdb/0.log" Jun 03 14:16:04.732569 ip-10-0-136-17 kubenswrapper[2581]: I0603 14:16:04.732539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28r5s_2f4447b7-9003-483b-a82a-b3746d21a042/ovnkube-controller/0.log"