Jul 17 15:09:01.705753 ip-10-0-140-166 systemd[1]: Starting Kubernetes Kubelet... Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.165864 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173753 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173766 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173770 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173773 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173776 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173779 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173782 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.279900 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173785 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.254814 ip-10-0-140-166 systemd[1]: Started Kubernetes Kubelet. Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173787 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173790 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173796 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173799 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173801 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173804 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173808 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173812 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173816 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173819 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173822 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173826 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173829 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173831 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173835 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173838 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173841 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173844 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173846 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.281311 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173849 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173852 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173854 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173857 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173860 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173863 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.173865 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175008 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175034 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175044 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175049 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175059 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175064 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175071 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175075 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175080 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175085 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175095 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175099 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.288989 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175104 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175108 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175113 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175117 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175121 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175126 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175130 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175134 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175138 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175143 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175147 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175156 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175160 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175165 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175169 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175173 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175177 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175181 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175185 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175190 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.290063 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175194 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175200 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175205 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175209 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175218 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175222 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175231 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175238 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175420 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175426 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175429 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175433 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175436 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175439 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175456 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175461 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175465 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175468 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175471 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.291113 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175475 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175478 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175481 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175484 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175487 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175489 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175492 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175495 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175497 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175500 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175503 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175506 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175508 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.175511 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176248 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176256 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176259 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176263 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176266 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176269 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.291946 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176272 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176276 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176279 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176282 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176285 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176288 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176290 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176293 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176295 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176298 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176300 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176304 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176306 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176309 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176314 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176319 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176322 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176324 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176327 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.292651 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176330 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176333 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176335 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176338 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176340 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176343 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176345 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176348 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176352 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176356 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176359 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176362 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176364 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176367 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176370 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176373 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176376 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176381 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176384 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.293438 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176387 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176390 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176392 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176395 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176398 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176401 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176403 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176406 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176409 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176411 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176414 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176416 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176419 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176421 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176424 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176426 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176429 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176431 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176434 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176437 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.294093 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176439 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176442 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176463 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176466 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176469 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176472 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176474 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176477 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176480 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176482 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176485 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176488 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176491 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176494 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176497 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176499 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176502 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176504 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176508 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176510 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.295160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176514 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176516 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176519 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176522 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176525 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176527 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176530 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176532 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176535 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176537 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176540 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176542 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176545 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176547 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176550 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176939 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176944 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176947 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176950 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176953 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.295803 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176955 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176958 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176961 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176963 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176966 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176968 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176971 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176974 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176976 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176979 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176982 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176984 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176991 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176994 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.176998 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177001 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177004 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177007 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177009 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177012 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.555835 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177014 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177017 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177020 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177022 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177025 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177027 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177030 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177033 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177035 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177038 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177040 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177043 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177046 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177048 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177051 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177053 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177056 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177058 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177061 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177063 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.578019 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177066 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177068 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177070 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177073 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177076 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177079 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177083 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177086 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177089 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177091 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177094 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177096 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177099 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177102 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177104 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177114 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177118 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177121 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177124 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.578770 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177127 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177131 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177134 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177137 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177139 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177142 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177144 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177147 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177150 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177153 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177156 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177158 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177160 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177163 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177165 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177167 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177170 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177174 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177176 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.579401 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177181 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177183 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177186 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177189 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177191 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177194 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177196 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177199 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177201 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177204 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177206 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177209 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177211 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177214 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177216 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177219 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177290 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177298 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177305 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177319 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177323 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 15:09:02.580068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177326 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177331 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177335 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177338 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177341 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177345 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177348 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177351 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177354 2575 flags.go:64] FLAG: --cgroup-root="" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177359 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177362 2575 flags.go:64] FLAG: --client-ca-file="" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177366 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177369 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177374 2575 flags.go:64] FLAG: --cluster-domain="" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177377 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177380 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177384 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177387 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177397 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177400 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177403 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177406 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177410 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177413 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 15:09:02.580689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177416 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177419 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177422 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177426 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177429 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177432 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177435 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177438 2575 flags.go:64] FLAG: --enable-server="true" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177441 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177458 2575 flags.go:64] FLAG: --event-burst="100" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177461 2575 flags.go:64] FLAG: --event-qps="50" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177464 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177467 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177470 2575 flags.go:64] FLAG: --eviction-hard="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177474 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177476 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177479 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177484 2575 flags.go:64] FLAG: --eviction-soft="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177486 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177490 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177493 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177496 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177499 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177502 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177505 2575 flags.go:64] FLAG: --feature-gates="" Jul 17 15:09:02.581405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177508 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177511 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177514 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177517 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177520 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177523 2575 flags.go:64] FLAG: --help="false" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177527 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177530 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177547 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177551 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177555 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177558 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177561 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177564 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177567 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177571 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177573 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177577 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177579 2575 flags.go:64] FLAG: --kube-reserved="" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177582 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177585 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177588 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177591 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177593 2575 flags.go:64] FLAG: --lock-file="" Jul 17 15:09:02.582159 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177597 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177600 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177604 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177610 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177613 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177620 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177623 2575 flags.go:64] FLAG: --logging-format="text" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177626 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177629 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177632 2575 flags.go:64] FLAG: --manifest-url="" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177635 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177639 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177642 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177646 2575 flags.go:64] FLAG: --max-pods="110" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177649 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177652 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177655 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177658 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177661 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177664 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177667 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177673 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177676 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177679 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 15:09:02.582972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177682 2575 flags.go:64] FLAG: --pod-cidr="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177686 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177691 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177694 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177697 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177699 2575 flags.go:64] FLAG: --port="10250" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177703 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177705 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-097d81c19dba8534c" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177709 2575 flags.go:64] FLAG: --qos-reserved="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177713 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177717 2575 flags.go:64] FLAG: --register-node="true" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177720 2575 flags.go:64] FLAG: --register-with-taints="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177723 2575 flags.go:64] FLAG: --registry-burst="10" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177726 2575 flags.go:64] FLAG: --registry-qps="5" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177729 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177732 2575 flags.go:64] FLAG: --reserved-memory="" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177736 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177739 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177742 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177745 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177748 2575 flags.go:64] FLAG: --runonce="false" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177750 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177753 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177756 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177759 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 15:09:02.584202 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177762 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177765 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177768 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177771 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177774 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177777 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177780 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177783 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177786 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177789 2575 flags.go:64] FLAG: --system-cgroups="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177791 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177796 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177799 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177802 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177807 2575 flags.go:64] FLAG: --tls-min-version="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177810 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177815 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177819 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177822 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177825 2575 flags.go:64] FLAG: --v="2" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177829 2575 flags.go:64] FLAG: --version="false" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177833 2575 flags.go:64] FLAG: --vmodule="" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177837 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.177840 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.585578 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177957 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177960 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177963 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177966 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177969 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177972 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177975 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177978 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177981 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177984 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177986 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177989 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177992 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177994 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.177997 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178000 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178002 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178004 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178008 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178010 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.587212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178012 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178015 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178017 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178021 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178025 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178028 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178033 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178036 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178039 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178042 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178046 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178049 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178052 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178056 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178058 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178061 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178064 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178066 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178069 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178072 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.588556 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178074 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178077 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178079 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178082 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178084 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178087 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178090 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178092 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178095 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178097 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178100 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178102 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178105 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178109 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178112 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178116 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178120 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178122 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178125 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.745434 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178127 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178130 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178133 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178135 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178138 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178141 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178144 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178147 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178149 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178152 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178154 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178157 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178160 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178162 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178165 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178167 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178170 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178172 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178176 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.746270 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178179 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178182 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178185 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178187 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178190 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178192 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178195 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178197 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178200 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178204 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178208 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178210 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178213 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178215 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178218 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178220 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178223 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178226 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178229 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.747014 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.178239 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.178864 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.186937 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.186954 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.187697 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.187705 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187762 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187767 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187770 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187774 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187777 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187780 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187783 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187786 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187788 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.747754 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187792 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187794 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187798 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187800 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187803 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187806 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187809 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187814 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187817 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187820 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187823 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187825 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187829 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187833 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187836 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187839 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187842 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187844 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187847 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.748453 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187849 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187853 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187856 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187859 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187861 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187864 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187866 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187869 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187872 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187875 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187878 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187880 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187882 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187885 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187890 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187893 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187895 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187898 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187901 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187903 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.749150 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187908 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187911 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187913 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187916 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187919 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187921 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187924 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187926 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187929 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187932 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187934 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187937 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187939 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187942 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187945 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187948 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187951 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187954 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187956 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187958 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.749906 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187961 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187964 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187966 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187969 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187973 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187977 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187981 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187984 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187987 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187990 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187992 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.187995 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188000 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188003 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188006 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188010 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188014 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188017 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188020 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.750621 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188023 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188026 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188028 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188031 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188034 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188036 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188039 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188042 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188045 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188047 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188050 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188053 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.188058 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188191 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188196 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 15:09:02.751344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188199 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188202 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188205 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188208 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188211 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188215 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188218 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188221 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188223 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188226 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188230 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188233 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188235 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188238 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188241 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188243 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188246 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188248 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188251 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188253 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 15:09:02.752046 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188256 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188258 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188261 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188263 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188266 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188269 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188272 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188275 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188277 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188281 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188284 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188287 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188289 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188292 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188294 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188297 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188300 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188303 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188306 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 15:09:02.752737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188309 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188311 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188314 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188319 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188322 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188325 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188328 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188331 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188335 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188338 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188341 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188344 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188347 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188350 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188353 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188355 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188358 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188360 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188363 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 15:09:02.753425 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188365 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188369 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188371 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188374 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188376 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188379 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188381 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188384 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188386 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188389 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188391 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188395 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188398 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188400 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188403 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188405 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188409 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188412 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188414 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188417 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 15:09:02.754140 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188420 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188422 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188425 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188428 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188430 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188433 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188435 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188438 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188440 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188459 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188463 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188467 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188471 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188474 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188477 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188480 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188483 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188485 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 15:09:02.754919 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:02.188488 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.188492 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.188620 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.191303 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.192816 2575 server.go:1019] "Starting client certificate rotation" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.192915 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.192949 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.195401 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.199439 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.213905 2575 log.go:25] "Validated CRI v1 runtime API" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.216297 2575 log.go:25] "Validated CRI v1 image API" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.218362 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 15:09:02.755433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.221128 2575 fs.go:135] Filesystem UUIDs: map[0ca723de-123b-473a-a981-dd8c79def2d2:/dev/nvme0n1p3 4b24a63c-52ea-44d4-b829-6f4d6e3b5a62:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 17 15:09:02.755926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.221145 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.227166 2575 manager.go:216] Machine: {Timestamp:2026-07-17 15:09:02.225338872 +0000 UTC m=+0.387093195 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087733 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23802c91abb4b5d53cada6786ba1f8 SystemUUID:ec23802c-91ab-b4b5-d53c-ada6786ba1f8 BootID:7b9ba1a8-b148-4293-8748-607769c294ea Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:85:7d:9a:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:85:7d:9a:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:68:f7:1b:02:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.227283 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.227382 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.228372 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.228396 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.229225 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.229235 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 15:09:02.756176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.229243 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.229928 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.231370 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.234627 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.234754 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.235595 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.235607 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.235621 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.235631 2575 kubelet.go:398] "Adding apiserver pod source" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.235640 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.236113 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.236131 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.238719 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.241215 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.241240 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.241258 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242628 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242644 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242651 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242658 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242673 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242682 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242691 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242697 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242703 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242709 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242719 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.242724 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.243401 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.243408 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.248811 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.248832 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.248856 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.253050 2575 server.go:1268] "Started kubelet" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.253114 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.253225 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.253629 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.255126 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.257431 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 17 15:09:02.756687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.261248 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.260648 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-166.ec2.internal.18c31c40db23a8c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-166.ec2.internal,UID:ip-10-0-140-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-166.ec2.internal,},FirstTimestamp:2026-07-17 15:09:02.248880328 +0000 UTC m=+0.410634650,LastTimestamp:2026-07-17 15:09:02.248880328 +0000 UTC m=+0.410634650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-166.ec2.internal,}" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.264804 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.264814 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.264946 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.265752 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.265776 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.265879 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.265930 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.265941 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266164 2575 factory.go:55] Registering systemd factory Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266178 2575 factory.go:223] Registration of the systemd container factory successfully Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266389 2575 factory.go:153] Registering CRI-O factory Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266404 2575 factory.go:223] Registration of the crio container factory successfully Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266478 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266501 2575 factory.go:103] Registering Raw factory Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266529 2575 manager.go:1196] Started watching for new ooms in manager Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.266908 2575 manager.go:349] Starting recovery of all containers Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.267444 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.267576 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.279357 2575 manager.go:354] Recovery completed Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.287000 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.290444 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.290492 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.290537 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291127 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291139 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291159 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291195 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291939 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291965 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.291979 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.292716 2575 policy_none.go:49] "None policy: Start" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.292733 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 15:09:02.757878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.292749 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.294181 2575 policy_none.go:47] "Start" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.303272 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8cqg" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.305349 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-166.ec2.internal.18c31c40dd9e46db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-166.ec2.internal,UID:ip-10-0-140-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-166.ec2.internal,},FirstTimestamp:2026-07-17 15:09:02.290470619 +0000 UTC m=+0.452224938,LastTimestamp:2026-07-17 15:09:02.290470619 +0000 UTC m=+0.452224938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-166.ec2.internal,}" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.311090 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8cqg" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.314922 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-166.ec2.internal.18c31c40dd9f22d7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-166.ec2.internal,UID:ip-10-0-140-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-166.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-166.ec2.internal,},FirstTimestamp:2026-07-17 15:09:02.290526935 +0000 UTC m=+0.452281258,LastTimestamp:2026-07-17 15:09:02.290526935 +0000 UTC m=+0.452281258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-166.ec2.internal,}" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341087 2575 manager.go:337] "Starting Device Plugin manager" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.341124 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341135 2575 server.go:87] "Starting device plugin registration server" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341405 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341421 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341605 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341702 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.341739 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.342143 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.342197 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.441107 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.441575 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442559 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442590 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442604 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442632 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442720 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442774 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.442801 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.442850 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 15:09:02.759103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.450377 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.452015 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.452034 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-166.ec2.internal\": node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.521767 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.544508 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal"] Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.544589 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.547253 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.547289 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.547305 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549073 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549188 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549213 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549887 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549889 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549934 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549943 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549914 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.549987 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.551542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.551566 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.552204 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.552231 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.552244 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.570030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fe8286928bc8a8cd15cc674793185cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"0fe8286928bc8a8cd15cc674793185cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.570051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.570071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.585197 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-166.ec2.internal\" not found" node="ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.762356 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.591723 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-166.ec2.internal\" not found" node="ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.622507 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fe8286928bc8a8cd15cc674793185cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"0fe8286928bc8a8cd15cc674793185cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670860 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670866 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fe8286928bc8a8cd15cc674793185cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"0fe8286928bc8a8cd15cc674793185cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.670914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a1060a36ba179dcc035cf78c54d916d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"5a1060a36ba179dcc035cf78c54d916d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.763359 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.724826 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.919941 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.828399 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:02.919941 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.890486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:02.919941 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:02.895642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:03.203577 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:02.928509 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:03.203577 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:03.032846 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:03.203577 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:03.133266 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:03.203577 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.192818 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 15:09:03.203577 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.193014 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 15:09:03.321458 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:03.233349 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:03.321458 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.287360 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 15:09:03.321458 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.316635 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 15:04:02 +0000 UTC" deadline="2028-04-17 08:21:16.103086406 +0000 UTC" Jul 17 15:09:03.321458 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.316680 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15353h12m12.786410054s" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:03.333822 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.347721 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.366244 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.382734 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.384380 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jul 17 15:09:03.531201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.395469 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 15:09:03.774235 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.577258 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 15:09:03.774235 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:03.590326 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1060a36ba179dcc035cf78c54d916d.slice/crio-b96cd086bb90434ba57fc81a981d746c22d3fc6bf4e793ec03e00a3bee43bc28 WatchSource:0}: Error finding container b96cd086bb90434ba57fc81a981d746c22d3fc6bf4e793ec03e00a3bee43bc28: Status 404 returned error can't find the container with id b96cd086bb90434ba57fc81a981d746c22d3fc6bf4e793ec03e00a3bee43bc28 Jul 17 15:09:03.774235 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:03.590890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe8286928bc8a8cd15cc674793185cf.slice/crio-f4e9ba50b74d8d5de6a1c1c5bb94a6b50dd65cfd3e6abcb21b445ed049b28741 WatchSource:0}: Error finding container f4e9ba50b74d8d5de6a1c1c5bb94a6b50dd65cfd3e6abcb21b445ed049b28741: Status 404 returned error can't find the container with id f4e9ba50b74d8d5de6a1c1c5bb94a6b50dd65cfd3e6abcb21b445ed049b28741 Jul 17 15:09:03.774235 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:03.597140 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:09:04.204250 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.179854 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.237393 2575 apiserver.go:52] "Watching apiserver" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.247872 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.249071 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal","openshift-multus/multus-f5h2r","openshift-dns/node-resolver-57xpr","openshift-multus/multus-additional-cni-plugins-df4zc","openshift-multus/network-metrics-daemon-ssq2s","openshift-network-diagnostics/network-check-target-lvwl6","openshift-network-operator/iptables-alerter-sb9zp","openshift-ovn-kubernetes/ovnkube-node-9r4ss","kube-system/global-pull-secret-syncer-s928z","kube-system/konnectivity-agent-swkm7","kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql","openshift-cluster-node-tuning-operator/tuned-p87wz","openshift-image-registry/node-ca-7rbnn"] Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.251076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.253311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.253998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.254112 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.254257 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smslg\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.254304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.256883 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.257165 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b7j7g\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.257657 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.258029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.258048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.259006 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.259074 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261093 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261159 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261093 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hnqwq\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261330 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261617 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rsxrx\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.261853 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.262043 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.262183 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.262224 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.262290 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 15:09:04.314613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.262296 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.263517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.265364 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.265372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.266558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267545 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267583 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267630 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267686 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267585 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.267788 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.268260 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.268331 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.268929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xbs46\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.268951 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.269180 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-64lkz\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.269230 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.269366 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.269443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.269584 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qf7qq\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.270255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.270369 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.271826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.274048 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.274385 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6shsk\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.274735 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.274955 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftzbw\"" Jul 17 15:09:04.407301 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.275164 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.277855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-tuned\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5d6h\" (UniqueName: \"kubernetes.io/projected/1e0561cf-4324-4046-88e8-37a9f2879541-kube-api-access-w5d6h\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-multus-certs\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-etc-kubernetes\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-env-overrides\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-socket-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/351635ae-b06f-4ce7-bf19-76383f02bd0b-kube-api-access-vq44p\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ea79044-bd0d-4114-8820-159fe7c6ecad-host\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-slash\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.409368 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-node-log\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.278701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-conf\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7kfx\" (UniqueName: \"kubernetes.io/projected/9ea79044-bd0d-4114-8820-159fe7c6ecad-kube-api-access-z7kfx\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9629bd88-42c7-468d-906f-b77d1fc6d406-ovn-node-metrics-cert\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-os-release\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-kubelet\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-conf-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-log-socket\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20e45cd6-4c6c-43e1-aec1-97d4db007b95-agent-certs\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-modprobe-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.279581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ea79044-bd0d-4114-8820-159fe7c6ecad-serviceca\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-os-release\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.410267 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-kubelet\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-netns\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-system-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-host\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-system-cni-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qthhk\" (UniqueName: \"kubernetes.io/projected/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-kube-api-access-qthhk\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.280949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d9137a0-b912-45d1-a251-27efee79885c-iptables-alerter-script\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-kubernetes\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-tmp\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-tuning-conf-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-bin\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-run\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-bin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.412133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-systemd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-netd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282073 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.281866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-registration-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-sys-fs\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-ovn\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d9137a0-b912-45d1-a251-27efee79885c-host-slash\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-config\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20e45cd6-4c6c-43e1-aec1-97d4db007b95-konnectivity-ca\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-netns\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282657 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-sys\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-var-lib-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.413238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-script-lib\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-device-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-var-lib-kubelet\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-cnibin\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.282848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-daemon-config\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-socket-dir-parent\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-binary-copy\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cnibin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrw8\" (UniqueName: \"kubernetes.io/projected/4da9f366-7756-4d8c-8668-ec55bb9ab10b-kube-api-access-swrw8\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-lib-modules\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-systemd-units\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.415231 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-etc-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv5p4\" (UniqueName: \"kubernetes.io/projected/9629bd88-42c7-468d-906f-b77d1fc6d406-kube-api-access-lv5p4\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79h68\" (UniqueName: \"kubernetes.io/projected/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kube-api-access-79h68\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cni-binary-copy\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fftz\" (UniqueName: \"kubernetes.io/projected/8d9137a0-b912-45d1-a251-27efee79885c-kube-api-access-5fftz\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-k8s-cni-cncf-io\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-multus\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-hostroot\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283684 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysconfig\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.283740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-systemd\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.315003 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lmhb" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.326668 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lmhb" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.366820 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.383961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cni-binary-copy\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.383987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fftz\" (UniqueName: \"kubernetes.io/projected/8d9137a0-b912-45d1-a251-27efee79885c-kube-api-access-5fftz\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-k8s-cni-cncf-io\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.416190 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-multus\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-hostroot\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysconfig\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-systemd\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-tuned\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-kubelet-config\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5d6h\" (UniqueName: \"kubernetes.io/projected/1e0561cf-4324-4046-88e8-37a9f2879541-kube-api-access-w5d6h\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-multus-certs\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-etc-kubernetes\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-env-overrides\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-socket-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/351635ae-b06f-4ce7-bf19-76383f02bd0b-kube-api-access-vq44p\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.417197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ea79044-bd0d-4114-8820-159fe7c6ecad-host\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-slash\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-node-log\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-conf\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cni-binary-copy\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2472fb3-bf41-492f-ac70-764d612f02c8-hosts-file\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7kfx\" (UniqueName: \"kubernetes.io/projected/9ea79044-bd0d-4114-8820-159fe7c6ecad-kube-api-access-z7kfx\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-k8s-cni-cncf-io\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384778 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-hostroot\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysconfig\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-systemd\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.418220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385142 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-multus\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-node-log\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ea79044-bd0d-4114-8820-159fe7c6ecad-host\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-slash\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385662 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.384732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9629bd88-42c7-468d-906f-b77d1fc6d406-ovn-node-metrics-cert\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-os-release\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-sysctl-conf\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-kubelet\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-conf-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-os-release\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2472fb3-bf41-492f-ac70-764d612f02c8-tmp-dir\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-multus-certs\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-kubelet\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-conf-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-log-socket\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385945 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-log-socket\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20e45cd6-4c6c-43e1-aec1-97d4db007b95-agent-certs\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.385983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-modprobe-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpn98\" (UniqueName: \"kubernetes.io/projected/b2472fb3-bf41-492f-ac70-764d612f02c8-kube-api-access-fpn98\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ea79044-bd0d-4114-8820-159fe7c6ecad-serviceca\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-os-release\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386094 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-socket-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-kubelet\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-netns\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.419899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-system-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386202 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-env-overrides\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-host\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-etc-kubernetes\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-host\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386291 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-modprobe-d\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-system-cni-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-netns\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-kubelet\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qthhk\" (UniqueName: \"kubernetes.io/projected/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-kube-api-access-qthhk\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-os-release\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d9137a0-b912-45d1-a251-27efee79885c-iptables-alerter-script\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-kubernetes\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.386472 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:04.420769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-tmp\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-dbus\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.386595 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:04.886553839 +0000 UTC m=+3.048308155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-kubernetes\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-tuning-conf-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-system-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ea79044-bd0d-4114-8820-159fe7c6ecad-serviceca\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-system-cni-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-bin\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-run\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.386980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-bin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-systemd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.421542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-netd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-registration-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-sys-fs\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-ovn\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d9137a0-b912-45d1-a251-27efee79885c-host-slash\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-config\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20e45cd6-4c6c-43e1-aec1-97d4db007b95-konnectivity-ca\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d9137a0-b912-45d1-a251-27efee79885c-iptables-alerter-script\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387408 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-netd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387439 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-cni-bin\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387440 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-systemd\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-var-lib-cni-bin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-netns\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-sys\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.422237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-tuning-conf-dir\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-var-lib-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-run-ovn\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-script-lib\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-device-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387635 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-registration-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d9137a0-b912-45d1-a251-27efee79885c-host-slash\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-run\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-var-lib-kubelet\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-cnibin\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-daemon-config\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-socket-dir-parent\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-cni-dir\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-binary-copy\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.423048 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387966 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-host-run-netns\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cnibin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.387988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388004 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-sys\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrw8\" (UniqueName: \"kubernetes.io/projected/4da9f366-7756-4d8c-8668-ec55bb9ab10b-kube-api-access-swrw8\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388042 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-var-lib-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-lib-modules\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-systemd-units\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-etc-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv5p4\" (UniqueName: \"kubernetes.io/projected/9629bd88-42c7-468d-906f-b77d1fc6d406-kube-api-access-lv5p4\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79h68\" (UniqueName: \"kubernetes.io/projected/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kube-api-access-79h68\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-config\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.423735 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388549 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-sys-fs\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388604 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76fe6ce-1d50-4583-9d86-546f94a1f15a-device-dir\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388643 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-cni-binary-copy\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-var-lib-kubelet\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e0561cf-4324-4046-88e8-37a9f2879541-cnibin\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-host-run-ovn-kubernetes\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-cnibin\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9629bd88-42c7-468d-906f-b77d1fc6d406-ovnkube-script-lib\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-socket-dir-parent\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389124 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4da9f366-7756-4d8c-8668-ec55bb9ab10b-multus-daemon-config\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.388135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/351635ae-b06f-4ce7-bf19-76383f02bd0b-lib-modules\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-systemd-units\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9629bd88-42c7-468d-906f-b77d1fc6d406-etc-openvswitch\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20e45cd6-4c6c-43e1-aec1-97d4db007b95-konnectivity-ca\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.389599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0561cf-4324-4046-88e8-37a9f2879541-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.424414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.391452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20e45cd6-4c6c-43e1-aec1-97d4db007b95-agent-certs\") pod \"konnectivity-agent-swkm7\" (UID: \"20e45cd6-4c6c-43e1-aec1-97d4db007b95\") " pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.394687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9629bd88-42c7-468d-906f-b77d1fc6d406-ovn-node-metrics-cert\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.395190 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-tmp\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.395637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/351635ae-b06f-4ce7-bf19-76383f02bd0b-etc-tuned\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.395861 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fftz\" (UniqueName: \"kubernetes.io/projected/8d9137a0-b912-45d1-a251-27efee79885c-kube-api-access-5fftz\") pod \"iptables-alerter-sb9zp\" (UID: \"8d9137a0-b912-45d1-a251-27efee79885c\") " pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.396356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7kfx\" (UniqueName: \"kubernetes.io/projected/9ea79044-bd0d-4114-8820-159fe7c6ecad-kube-api-access-z7kfx\") pod \"node-ca-7rbnn\" (UID: \"9ea79044-bd0d-4114-8820-159fe7c6ecad\") " pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.399096 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq44p\" (UniqueName: \"kubernetes.io/projected/351635ae-b06f-4ce7-bf19-76383f02bd0b-kube-api-access-vq44p\") pod \"tuned-p87wz\" (UID: \"351635ae-b06f-4ce7-bf19-76383f02bd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.400453 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qthhk\" (UniqueName: \"kubernetes.io/projected/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-kube-api-access-qthhk\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.402937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5d6h\" (UniqueName: \"kubernetes.io/projected/1e0561cf-4324-4046-88e8-37a9f2879541-kube-api-access-w5d6h\") pod \"multus-additional-cni-plugins-df4zc\" (UID: \"1e0561cf-4324-4046-88e8-37a9f2879541\") " pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.403035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79h68\" (UniqueName: \"kubernetes.io/projected/b76fe6ce-1d50-4583-9d86-546f94a1f15a-kube-api-access-79h68\") pod \"aws-ebs-csi-driver-node-8h4ql\" (UID: \"b76fe6ce-1d50-4583-9d86-546f94a1f15a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.403446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv5p4\" (UniqueName: \"kubernetes.io/projected/9629bd88-42c7-468d-906f-b77d1fc6d406-kube-api-access-lv5p4\") pod \"ovnkube-node-9r4ss\" (UID: \"9629bd88-42c7-468d-906f-b77d1fc6d406\") " pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.425186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.405082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrw8\" (UniqueName: \"kubernetes.io/projected/4da9f366-7756-4d8c-8668-ec55bb9ab10b-kube-api-access-swrw8\") pod \"multus-f5h2r\" (UID: \"4da9f366-7756-4d8c-8668-ec55bb9ab10b\") " pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.450329 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.450261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"5a1060a36ba179dcc035cf78c54d916d","Type":"ContainerStarted","Data":"b96cd086bb90434ba57fc81a981d746c22d3fc6bf4e793ec03e00a3bee43bc28"} Jul 17 15:09:04.452086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.452050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" event={"ID":"0fe8286928bc8a8cd15cc674793185cf","Type":"ContainerStarted","Data":"f4e9ba50b74d8d5de6a1c1c5bb94a6b50dd65cfd3e6abcb21b445ed049b28741"} Jul 17 15:09:04.488521 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:04.488702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2472fb3-bf41-492f-ac70-764d612f02c8-hosts-file\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.488702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2472fb3-bf41-492f-ac70-764d612f02c8-tmp-dir\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.488702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpn98\" (UniqueName: \"kubernetes.io/projected/b2472fb3-bf41-492f-ac70-764d612f02c8-kube-api-access-fpn98\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.488702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-dbus\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.488702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.488987 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-kubelet-config\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.488987 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.488942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-kubelet-config\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.489268 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.489245 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:04.489427 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.489413 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:04.989384466 +0000 UTC m=+3.151138785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:04.492551 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.490707 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2472fb3-bf41-492f-ac70-764d612f02c8-hosts-file\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.492551 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.490796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61eee7cb-47a3-4f54-aeba-96476b4d790b-dbus\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.492551 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.490971 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2472fb3-bf41-492f-ac70-764d612f02c8-tmp-dir\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.498340 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.498314 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:04.498456 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.498345 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:04.498456 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.498361 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:04.498456 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.498429 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:04.998409177 +0000 UTC m=+3.160163501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:04.502963 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.502931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpn98\" (UniqueName: \"kubernetes.io/projected/b2472fb3-bf41-492f-ac70-764d612f02c8-kube-api-access-fpn98\") pod \"node-resolver-57xpr\" (UID: \"b2472fb3-bf41-492f-ac70-764d612f02c8\") " pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.574538 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.574261 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sb9zp" Jul 17 15:09:04.579281 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.579259 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-df4zc" Jul 17 15:09:04.591866 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.591831 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9137a0_b912_45d1_a251_27efee79885c.slice/crio-09e691261b31862ae0e8b56f772b00bb0acd68115c61b151b446a80dd41a3cd6 WatchSource:0}: Error finding container 09e691261b31862ae0e8b56f772b00bb0acd68115c61b151b446a80dd41a3cd6: Status 404 returned error can't find the container with id 09e691261b31862ae0e8b56f772b00bb0acd68115c61b151b446a80dd41a3cd6 Jul 17 15:09:04.644128 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.644091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p87wz" Jul 17 15:09:04.651614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.651582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rbnn" Jul 17 15:09:04.654005 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.653862 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351635ae_b06f_4ce7_bf19_76383f02bd0b.slice/crio-4746d60cf5b9c7bda040e5590071ba2dda6fa8d10f96d79e64f47d7902f830ee WatchSource:0}: Error finding container 4746d60cf5b9c7bda040e5590071ba2dda6fa8d10f96d79e64f47d7902f830ee: Status 404 returned error can't find the container with id 4746d60cf5b9c7bda040e5590071ba2dda6fa8d10f96d79e64f47d7902f830ee Jul 17 15:09:04.660786 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.660757 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea79044_bd0d_4114_8820_159fe7c6ecad.slice/crio-546ddb65b453a2eec3afe36fa0c85d4d7304cdc1f0cddcd65f036fcbb8b8065f WatchSource:0}: Error finding container 546ddb65b453a2eec3afe36fa0c85d4d7304cdc1f0cddcd65f036fcbb8b8065f: Status 404 returned error can't find the container with id 546ddb65b453a2eec3afe36fa0c85d4d7304cdc1f0cddcd65f036fcbb8b8065f Jul 17 15:09:04.661986 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.661958 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:04.670200 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.670177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" Jul 17 15:09:04.671049 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.671016 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9629bd88_42c7_468d_906f_b77d1fc6d406.slice/crio-64b1634dbd4973931716b8a887f3cdd052b52a81ba634c0cbd51d26df6adf321 WatchSource:0}: Error finding container 64b1634dbd4973931716b8a887f3cdd052b52a81ba634c0cbd51d26df6adf321: Status 404 returned error can't find the container with id 64b1634dbd4973931716b8a887f3cdd052b52a81ba634c0cbd51d26df6adf321 Jul 17 15:09:04.679385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.679361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f5h2r" Jul 17 15:09:04.679706 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.679670 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76fe6ce_1d50_4583_9d86_546f94a1f15a.slice/crio-9ed86c3519b47a706af8fe6258a2533198fc38d6f2b9845cf015734a4f226030 WatchSource:0}: Error finding container 9ed86c3519b47a706af8fe6258a2533198fc38d6f2b9845cf015734a4f226030: Status 404 returned error can't find the container with id 9ed86c3519b47a706af8fe6258a2533198fc38d6f2b9845cf015734a4f226030 Jul 17 15:09:04.689028 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.688997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da9f366_7756_4d8c_8668_ec55bb9ab10b.slice/crio-c06f33338920b03ffa78bd830e072c97f5c9b70fad0f63df76014f37bbd6366f WatchSource:0}: Error finding container c06f33338920b03ffa78bd830e072c97f5c9b70fad0f63df76014f37bbd6366f: Status 404 returned error can't find the container with id c06f33338920b03ffa78bd830e072c97f5c9b70fad0f63df76014f37bbd6366f Jul 17 15:09:04.690047 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.690025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:04.697918 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.697879 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57xpr" Jul 17 15:09:04.700725 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.700698 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e45cd6_4c6c_43e1_aec1_97d4db007b95.slice/crio-e31259839190b711313e022832e7a2ae7550a6317c9b7bd8bb1c1e9f081428c9 WatchSource:0}: Error finding container e31259839190b711313e022832e7a2ae7550a6317c9b7bd8bb1c1e9f081428c9: Status 404 returned error can't find the container with id e31259839190b711313e022832e7a2ae7550a6317c9b7bd8bb1c1e9f081428c9 Jul 17 15:09:04.708376 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:04.708347 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2472fb3_bf41_492f_ac70_764d612f02c8.slice/crio-1b254e6d8a00f2e82bc71d6627fdd2a6d518e3975044b0896c1b114d09b4e4d7 WatchSource:0}: Error finding container 1b254e6d8a00f2e82bc71d6627fdd2a6d518e3975044b0896c1b114d09b4e4d7: Status 404 returned error can't find the container with id 1b254e6d8a00f2e82bc71d6627fdd2a6d518e3975044b0896c1b114d09b4e4d7 Jul 17 15:09:04.891990 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.891956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:04.892173 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.892117 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:04.892231 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.892192 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:05.892171902 +0000 UTC m=+4.053926225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:04.992505 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:04.992410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:04.992652 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.992583 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:04.992711 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:04.992654 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:05.992637606 +0000 UTC m=+4.154391912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:05.093637 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.093594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:05.093842 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.093819 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:05.093906 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.093855 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:05.093906 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.093870 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:05.094013 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.093938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:06.093920267 +0000 UTC m=+4.255674591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:05.329739 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.329644 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 15:04:04 +0000 UTC" deadline="2028-04-01 22:27:42.675246142 +0000 UTC" Jul 17 15:09:05.329739 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.329690 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14983h18m37.3455626s" Jul 17 15:09:05.443160 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.443119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:05.443777 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.443272 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:05.469753 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.469710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57xpr" event={"ID":"b2472fb3-bf41-492f-ac70-764d612f02c8","Type":"ContainerStarted","Data":"1b254e6d8a00f2e82bc71d6627fdd2a6d518e3975044b0896c1b114d09b4e4d7"} Jul 17 15:09:05.471962 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.471848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" event={"ID":"b76fe6ce-1d50-4583-9d86-546f94a1f15a","Type":"ContainerStarted","Data":"9ed86c3519b47a706af8fe6258a2533198fc38d6f2b9845cf015734a4f226030"} Jul 17 15:09:05.485650 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.485539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"64b1634dbd4973931716b8a887f3cdd052b52a81ba634c0cbd51d26df6adf321"} Jul 17 15:09:05.487929 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.487842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerStarted","Data":"23a228e5b0d93fc31cb33f698ad11a7290d40bbd4de74413b8e97de9ac8a77fc"} Jul 17 15:09:05.490357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.490265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sb9zp" event={"ID":"8d9137a0-b912-45d1-a251-27efee79885c","Type":"ContainerStarted","Data":"09e691261b31862ae0e8b56f772b00bb0acd68115c61b151b446a80dd41a3cd6"} Jul 17 15:09:05.491958 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.491874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swkm7" event={"ID":"20e45cd6-4c6c-43e1-aec1-97d4db007b95","Type":"ContainerStarted","Data":"e31259839190b711313e022832e7a2ae7550a6317c9b7bd8bb1c1e9f081428c9"} Jul 17 15:09:05.494408 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.494350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f5h2r" event={"ID":"4da9f366-7756-4d8c-8668-ec55bb9ab10b","Type":"ContainerStarted","Data":"c06f33338920b03ffa78bd830e072c97f5c9b70fad0f63df76014f37bbd6366f"} Jul 17 15:09:05.496864 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.496466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rbnn" event={"ID":"9ea79044-bd0d-4114-8820-159fe7c6ecad","Type":"ContainerStarted","Data":"546ddb65b453a2eec3afe36fa0c85d4d7304cdc1f0cddcd65f036fcbb8b8065f"} Jul 17 15:09:05.498373 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.498331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p87wz" event={"ID":"351635ae-b06f-4ce7-bf19-76383f02bd0b","Type":"ContainerStarted","Data":"4746d60cf5b9c7bda040e5590071ba2dda6fa8d10f96d79e64f47d7902f830ee"} Jul 17 15:09:05.900196 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:05.900162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:05.900380 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.900341 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:05.900458 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:05.900412 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:07.900392462 +0000 UTC m=+6.062146785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:06.000620 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.000580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:06.000807 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.000754 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:06.000870 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.000815 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:08.000795891 +0000 UTC m=+6.162550215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:06.101188 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.101154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:06.101369 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.101338 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:06.101369 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.101357 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:06.101369 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.101369 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:06.101544 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.101423 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:08.101406216 +0000 UTC m=+6.263160525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:06.329984 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.329881 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 15:04:04 +0000 UTC" deadline="2028-02-02 22:10:31.417267995 +0000 UTC" Jul 17 15:09:06.329984 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.329935 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13567h1m25.087338122s" Jul 17 15:09:06.446308 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.446274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:06.446882 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.446403 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:06.446882 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:06.446819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:06.446996 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:06.446921 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:07.444523 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:07.443624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:07.444523 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:07.444120 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:07.516074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:07.516031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"5a1060a36ba179dcc035cf78c54d916d","Type":"ContainerStarted","Data":"d8051b5cb254491298fa64b51f491c3514638ad24b5a25910b71ace1b3d755dd"} Jul 17 15:09:07.525378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:07.525346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" event={"ID":"0fe8286928bc8a8cd15cc674793185cf","Type":"ContainerStarted","Data":"3bca5d280d58d7fb84357df772082c80a27dd7dc8eba6045cb382597bcbe2254"} Jul 17 15:09:07.924997 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:07.924956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:07.925187 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:07.925140 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:07.925246 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:07.925202 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:11.925183769 +0000 UTC m=+10.086938079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:08.026257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:08.026218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:08.026533 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.026402 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:08.026533 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.026485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:12.026463803 +0000 UTC m=+10.188218122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:08.127293 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:08.127251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:08.127537 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.127482 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:08.127537 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.127502 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:08.127537 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.127515 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:08.127728 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.127583 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:12.127564677 +0000 UTC m=+10.289318994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:08.445931 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:08.445898 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:08.446093 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.446034 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:08.446460 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:08.446423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:08.446587 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:08.446557 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:09.444238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:09.444203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:09.444750 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:09.444339 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:10.446844 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:10.446665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:10.446844 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:10.446703 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:10.446844 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:10.446807 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:10.447361 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:10.446931 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:10.533780 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:10.533745 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a1060a36ba179dcc035cf78c54d916d" containerID="d8051b5cb254491298fa64b51f491c3514638ad24b5a25910b71ace1b3d755dd" exitCode=0 Jul 17 15:09:10.533981 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:10.533789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"5a1060a36ba179dcc035cf78c54d916d","Type":"ContainerDied","Data":"d8051b5cb254491298fa64b51f491c3514638ad24b5a25910b71ace1b3d755dd"} Jul 17 15:09:10.555497 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:10.555422 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" podStartSLOduration=7.555403995 podStartE2EDuration="7.555403995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:07.559383576 +0000 UTC m=+5.721137904" watchObservedRunningTime="2026-07-17 15:09:10.555403995 +0000 UTC m=+8.717158321" Jul 17 15:09:11.444221 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:11.443673 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:11.444221 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:11.443813 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:11.960667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:11.960633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:11.961122 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:11.960809 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:11.961122 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:11.960884 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:19.960862876 +0000 UTC m=+18.122617181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:12.061274 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:12.061234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:12.061463 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.061390 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:12.061863 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.061516 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:20.061474739 +0000 UTC m=+18.223229057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:12.161895 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:12.161857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:12.162050 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.162011 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:12.162050 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.162030 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:12.162050 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.162042 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:12.162225 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.162097 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:20.16207803 +0000 UTC m=+18.323832342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:12.444133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:12.443977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:12.444133 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.444097 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:12.444348 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:12.444165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:12.444348 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:12.444286 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:13.443372 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:13.443321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:13.443833 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:13.443471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:14.443981 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:14.443943 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:14.444483 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:14.443998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:14.444483 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:14.444104 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:14.444483 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:14.444206 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:15.443847 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:15.443809 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:15.444006 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:15.443926 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:16.445679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:16.445651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:16.446060 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:16.445693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:16.446060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:16.445773 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:16.446060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:16.445848 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:17.443686 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:17.443650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:17.443857 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:17.443787 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:18.443342 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:18.443300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:18.443797 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:18.443307 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:18.443797 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:18.443435 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:18.443797 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:18.443528 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:19.443382 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:19.443300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:19.443845 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:19.443421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:20.020672 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:20.020629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:20.020847 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.020773 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:20.020847 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.020837 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:36.020816019 +0000 UTC m=+34.182570325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:20.121740 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:20.121695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:20.121918 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.121849 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:20.121918 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.121917 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:09:36.121900581 +0000 UTC m=+34.283654887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:20.222666 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:20.222626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:20.222849 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.222815 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:20.222849 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.222838 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:20.222849 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.222851 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:20.222997 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.222916 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:09:36.222896865 +0000 UTC m=+34.384651182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:20.443503 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:20.443415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:20.443905 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.443556 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:20.443905 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:20.443615 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:20.443905 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:20.443746 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:21.443249 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:21.443215 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:21.443421 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:21.443342 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:22.444531 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:22.444490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:22.444987 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:22.444590 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:22.444987 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:22.444639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:22.444987 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:22.444765 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:23.443917 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:23.443879 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:23.444073 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:23.443988 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:24.443872 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.443534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:24.444698 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.443535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:24.444698 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:24.443981 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:24.444698 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:24.444050 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:24.562089 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.562018 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57xpr" event={"ID":"b2472fb3-bf41-492f-ac70-764d612f02c8","Type":"ContainerStarted","Data":"1dd500e000be98616757869a740ec05bb438b1956336eaada99765962393a39d"} Jul 17 15:09:24.563583 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.563562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" event={"ID":"b76fe6ce-1d50-4583-9d86-546f94a1f15a","Type":"ContainerStarted","Data":"dd1294226fbdc327d275c5649f0dee2569ed534cd2d12c5cccf8ba6f137e75f7"} Jul 17 15:09:24.566383 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"5ebdba00f12b0d8bdacd0e1b31fadf0a1a6f441adda66ea14fd481cdb67f4c9c"} Jul 17 15:09:24.566516 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"767ca4cabf655e651377e7409c69e932c3aa65e0ca6eb4ebb21688026a2209ba"} Jul 17 15:09:24.566516 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566507 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"1b1e70bb326161449d1f0cd6657694c418e32373064d827f0e541b1e652eda58"} Jul 17 15:09:24.566629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"9eb325165f72a33af7bb7569ff07555bd3953c825badecee57e2c18376c9f17a"} Jul 17 15:09:24.566629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"a4a3f3756092ab404928ebf87c594259aec6341d22e21e9f2872f71d5cc6fc8b"} Jul 17 15:09:24.566733 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.566631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"af15d8544da1512de6f1a67dbf88205b99c808a2488b5034c308561c296f570a"} Jul 17 15:09:24.567811 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.567787 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="39c30222052d3b36edaf54957eb7c7106cff7ab8d48d8cc702623a3b833c65df" exitCode=0 Jul 17 15:09:24.567903 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.567816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"39c30222052d3b36edaf54957eb7c7106cff7ab8d48d8cc702623a3b833c65df"} Jul 17 15:09:24.570643 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.570621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"5a1060a36ba179dcc035cf78c54d916d","Type":"ContainerStarted","Data":"d8a0ffe96a8aa4a34b8a627bda5cb090bc557a92f331d77503027248bb7e70a8"} Jul 17 15:09:24.572070 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.572041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swkm7" event={"ID":"20e45cd6-4c6c-43e1-aec1-97d4db007b95","Type":"ContainerStarted","Data":"f7b3f47c745232a905e2cc11fa8e201a561ec3a7a7f2af0cedce72bc4c141adc"} Jul 17 15:09:24.573654 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.573633 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f5h2r" event={"ID":"4da9f366-7756-4d8c-8668-ec55bb9ab10b","Type":"ContainerStarted","Data":"18fca38c4faf257ce3eb7e3558bce5cee426f3061ce3e25fe1beda54586619bb"} Jul 17 15:09:24.575357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.575325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rbnn" event={"ID":"9ea79044-bd0d-4114-8820-159fe7c6ecad","Type":"ContainerStarted","Data":"4f422a24d4ee82064435447a1c34119aa661edef084b87f9a8f7ec3523b9f841"} Jul 17 15:09:24.576825 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.576806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p87wz" event={"ID":"351635ae-b06f-4ce7-bf19-76383f02bd0b","Type":"ContainerStarted","Data":"41734cd5acc526bdb41a0d0e7eaa71e73a20547f7df042c757f56e421b3be0c2"} Jul 17 15:09:24.579624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.579587 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-57xpr" podStartSLOduration=2.469842233 podStartE2EDuration="21.579576299s" totalImagesPullingTime="19.109734066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.579481042 +0000 UTC m=+22.741235363" watchObservedRunningTime="2026-07-17 15:09:24.579576299 +0000 UTC m=+22.741330624" Jul 17 15:09:24.594988 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.594949 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" podStartSLOduration=21.594936227 podStartE2EDuration="21.594936227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.594807419 +0000 UTC m=+22.756561745" watchObservedRunningTime="2026-07-17 15:09:24.594936227 +0000 UTC m=+22.756690552" Jul 17 15:09:24.612086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.612045 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p87wz" podStartSLOduration=3.44689484 podStartE2EDuration="22.612031906s" totalImagesPullingTime="19.165137066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.612015357 +0000 UTC m=+22.773769707" watchObservedRunningTime="2026-07-17 15:09:24.612031906 +0000 UTC m=+22.773786231" Jul 17 15:09:24.626946 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.626906 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7rbnn" podStartSLOduration=8.179716237 podStartE2EDuration="22.626892619s" totalImagesPullingTime="14.447176382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.626816687 +0000 UTC m=+22.788571013" watchObservedRunningTime="2026-07-17 15:09:24.626892619 +0000 UTC m=+22.788646941" Jul 17 15:09:24.700597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.700548 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swkm7" podStartSLOduration=2.5841214089999998 podStartE2EDuration="21.700531004s" totalImagesPullingTime="19.116409595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.700079171 +0000 UTC m=+22.861833495" watchObservedRunningTime="2026-07-17 15:09:24.700531004 +0000 UTC m=+22.862285311" Jul 17 15:09:24.700840 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:24.700820 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f5h2r" podStartSLOduration=3.424348353 podStartE2EDuration="22.70081463s" totalImagesPullingTime="19.276466277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:24.681028425 +0000 UTC m=+22.842782752" watchObservedRunningTime="2026-07-17 15:09:24.70081463 +0000 UTC m=+22.862568954" Jul 17 15:09:25.390661 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.390627 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:25.391288 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.391272 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:25.443750 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.443678 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:25.443905 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:25.443781 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:25.580324 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.580268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sb9zp" event={"ID":"8d9137a0-b912-45d1-a251-27efee79885c","Type":"ContainerStarted","Data":"d9668fab4cbeb42ebc11084ce2892f3ae42569f75beb8f925df7c43dbe0ad22a"} Jul 17 15:09:25.581023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.580999 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:25.581136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.581046 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swkm7" Jul 17 15:09:25.597116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.597069 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sb9zp" podStartSLOduration=4.391123317 podStartE2EDuration="23.597055703s" totalImagesPullingTime="19.205932386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:25.596990211 +0000 UTC m=+23.758744560" watchObservedRunningTime="2026-07-17 15:09:25.597055703 +0000 UTC m=+23.758810028" Jul 17 15:09:25.835828 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:25.835800 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 15:09:26.358961 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.358854 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T15:09:25.835820775Z","UUID":"361ec0f3-b68d-4ba8-ab5e-f5bdc0fa5ab5","Handler":null,"Name":"","Endpoint":""} Jul 17 15:09:26.360255 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.360239 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 15:09:26.360377 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.360281 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 15:09:26.447176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.447132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:26.447176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.447158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:26.447677 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:26.447270 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:26.447677 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:26.447420 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:26.584562 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:26.584524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" event={"ID":"b76fe6ce-1d50-4583-9d86-546f94a1f15a","Type":"ContainerStarted","Data":"d85df9b849a1d5390e024440bf8b2cf9e41580561f68e882250309df50ad5006"} Jul 17 15:09:27.443796 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:27.443761 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:27.443979 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:27.443873 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:27.590095 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:27.590005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" event={"ID":"b76fe6ce-1d50-4583-9d86-546f94a1f15a","Type":"ContainerStarted","Data":"cc18654f415c5b2e26973724d4bb0cec9ae0ce4aa2ca051ba5fc5ea21ead89ba"} Jul 17 15:09:27.594279 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:27.594247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"89a8afeb734df34d1a3ba904ee28f99915b5888b30aaa628272758b4b1e6d5ec"} Jul 17 15:09:27.612783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:27.612735 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h4ql" podStartSLOduration=8.071568558 podStartE2EDuration="25.612715867s" totalImagesPullingTime="17.541147309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:27.612024169 +0000 UTC m=+25.773778498" watchObservedRunningTime="2026-07-17 15:09:27.612715867 +0000 UTC m=+25.774470195" Jul 17 15:09:28.443728 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:28.443508 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:28.443918 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:28.443516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:28.443918 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:28.443815 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:28.444026 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:28.443918 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:29.443478 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:29.443431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:29.443909 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:29.443568 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:30.444197 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.444018 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:30.444908 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.444083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:30.444908 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:30.444274 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:30.444908 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:30.444367 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:30.604523 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.604386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" event={"ID":"9629bd88-42c7-468d-906f-b77d1fc6d406","Type":"ContainerStarted","Data":"503dc0f4ad5fb1a3501f10871b3d6f04f99d35c610a02aed71d490f0a98d15ef"} Jul 17 15:09:30.604702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.604679 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:30.606306 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.606280 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="3413bf739deafd6bdbe148f05cbdf11082e1ff421c4095fdd43a66e3ff63e021" exitCode=0 Jul 17 15:09:30.606424 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.606311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"3413bf739deafd6bdbe148f05cbdf11082e1ff421c4095fdd43a66e3ff63e021"} Jul 17 15:09:30.620489 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.620465 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:30.637637 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:30.637596 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" podStartSLOduration=9.447164741 podStartE2EDuration="28.637581811s" totalImagesPullingTime="19.19041707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:30.63696592 +0000 UTC m=+28.798720278" watchObservedRunningTime="2026-07-17 15:09:30.637581811 +0000 UTC m=+28.799336135" Jul 17 15:09:31.443393 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:31.443350 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:31.443704 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:31.443495 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:31.609769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:31.609741 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:31.610215 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:31.609831 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:31.623959 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:31.623934 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:09:32.399367 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.399335 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s928z"] Jul 17 15:09:32.399542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.399488 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:32.399596 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:32.399566 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:32.400793 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.400767 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvwl6"] Jul 17 15:09:32.400919 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.400870 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:32.401043 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:32.400959 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:32.403822 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.403800 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssq2s"] Jul 17 15:09:32.403914 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.403902 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:32.404006 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:32.403986 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:32.613653 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.613617 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="79043f511c09ed4a882fd8d9259984b495aa6dedf61cc3966b0a0ae9656d218b" exitCode=0 Jul 17 15:09:32.614145 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:32.613699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"79043f511c09ed4a882fd8d9259984b495aa6dedf61cc3966b0a0ae9656d218b"} Jul 17 15:09:34.443275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:34.443024 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:34.443675 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:34.443027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:34.443675 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:34.443376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:34.443675 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:34.443088 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:34.443675 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:34.443427 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:34.443675 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:34.443527 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:34.619315 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:34.619283 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="f4380982cbfdda73dbc50c6483f914ba28b3ec601cca8d1b8f97cecdc5cf9348" exitCode=0 Jul 17 15:09:34.619483 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:34.619329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"f4380982cbfdda73dbc50c6483f914ba28b3ec601cca8d1b8f97cecdc5cf9348"} Jul 17 15:09:36.039654 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.039626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:36.040106 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.039778 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:36.040106 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.039834 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs podName:e66ac139-cf27-4f1c-a4ca-7d0d42952cc7 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:08.039819963 +0000 UTC m=+66.201574266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs") pod "network-metrics-daemon-ssq2s" (UID: "e66ac139-cf27-4f1c-a4ca-7d0d42952cc7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 15:09:36.139955 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.139921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:36.140127 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.140044 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:36.140127 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.140091 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret podName:61eee7cb-47a3-4f54-aeba-96476b4d790b nodeName:}" failed. No retries permitted until 2026-07-17 15:10:08.140077009 +0000 UTC m=+66.301831313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret") pod "global-pull-secret-syncer-s928z" (UID: "61eee7cb-47a3-4f54-aeba-96476b4d790b") : object "kube-system"/"original-pull-secret" not registered Jul 17 15:09:36.241039 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.241007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:36.241231 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.241159 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 15:09:36.241231 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.241184 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 15:09:36.241231 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.241197 2575 projected.go:196] Error preparing data for projected volume kube-api-access-b9ksw for pod openshift-network-diagnostics/network-check-target-lvwl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:36.241382 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.241258 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw podName:4e176ec1-f0ce-4d8c-940b-1cb91099fb2d nodeName:}" failed. No retries permitted until 2026-07-17 15:10:08.241240701 +0000 UTC m=+66.402995024 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b9ksw" (UniqueName: "kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw") pod "network-check-target-lvwl6" (UID: "4e176ec1-f0ce-4d8c-940b-1cb91099fb2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 15:09:36.443330 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.443302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:36.443522 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.443345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:36.443522 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.443307 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:36.443522 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.443430 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s928z" podUID="61eee7cb-47a3-4f54-aeba-96476b4d790b" Jul 17 15:09:36.443674 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.443518 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvwl6" podUID="4e176ec1-f0ce-4d8c-940b-1cb91099fb2d" Jul 17 15:09:36.443674 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.443619 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssq2s" podUID="e66ac139-cf27-4f1c-a4ca-7d0d42952cc7" Jul 17 15:09:36.648542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.648512 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeReady" Jul 17 15:09:36.648719 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.648656 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 15:09:36.688176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.688120 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:09:36.690285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.690268 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.693829 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.693808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 15:09:36.694489 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.694464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 15:09:36.694603 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.694510 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hgpkw\"" Jul 17 15:09:36.694603 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.694510 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 15:09:36.704869 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.704841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 15:09:36.706934 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.706911 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:09:36.713361 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.713334 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wskcr"] Jul 17 15:09:36.715344 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.715324 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tt5xh"] Jul 17 15:09:36.715485 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.715467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.717966 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.717949 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.718283 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.718262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 15:09:36.718533 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.718512 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 15:09:36.718620 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.718551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m7zkr\"" Jul 17 15:09:36.720684 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.720658 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 15:09:36.720799 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.720723 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 15:09:36.720799 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.720755 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hhvk5\"" Jul 17 15:09:36.721129 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.721110 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 15:09:36.726630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.726612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tt5xh"] Jul 17 15:09:36.729850 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.729829 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wskcr"] Jul 17 15:09:36.845104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8nj\" (UniqueName: \"kubernetes.io/projected/94dbad65-8322-438c-88df-a20f8ec7319c-kube-api-access-4x8nj\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.845278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09676aab-64eb-41b6-9964-a2e8a902d100-cert\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.845278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94dbad65-8322-438c-88df-a20f8ec7319c-config-volume\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94dbad65-8322-438c-88df-a20f8ec7319c-tmp-dir\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845768 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgmk\" (UniqueName: \"kubernetes.io/projected/09676aab-64eb-41b6-9964-a2e8a902d100-kube-api-access-dfgmk\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.845768 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4px\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.845768 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.845608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.946501 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgmk\" (UniqueName: \"kubernetes.io/projected/09676aab-64eb-41b6-9964-a2e8a902d100-kube-api-access-dfgmk\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.946667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4px\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.946667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.946667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8nj\" (UniqueName: \"kubernetes.io/projected/94dbad65-8322-438c-88df-a20f8ec7319c-kube-api-access-4x8nj\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.946832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09676aab-64eb-41b6-9964-a2e8a902d100-cert\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.946832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.946832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.946832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.946939 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.946969 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.946984 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.946921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94dbad65-8322-438c-88df-a20f8ec7319c-config-volume\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.947022 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.947005 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:09:37.446984296 +0000 UTC m=+35.608738607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:36.947266 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:36.947048 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:37.447032949 +0000 UTC m=+35.608787252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:36.947266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94dbad65-8322-438c-88df-a20f8ec7319c-tmp-dir\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.947266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947586 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.947617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94dbad65-8322-438c-88df-a20f8ec7319c-config-volume\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.947779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94dbad65-8322-438c-88df-a20f8ec7319c-tmp-dir\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.947779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.947676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.948401 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.948378 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.951563 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.951535 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.951649 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.951574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09676aab-64eb-41b6-9964-a2e8a902d100-cert\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.952000 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.951985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.965088 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.965066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:36.965390 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.965370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8nj\" (UniqueName: \"kubernetes.io/projected/94dbad65-8322-438c-88df-a20f8ec7319c-kube-api-access-4x8nj\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:36.968243 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.968222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgmk\" (UniqueName: \"kubernetes.io/projected/09676aab-64eb-41b6-9964-a2e8a902d100-kube-api-access-dfgmk\") pod \"ingress-canary-tt5xh\" (UID: \"09676aab-64eb-41b6-9964-a2e8a902d100\") " pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:36.968634 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:36.968616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4px\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:37.035724 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:37.035683 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tt5xh" Jul 17 15:09:37.196232 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:37.196202 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tt5xh"] Jul 17 15:09:37.200895 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:37.200857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09676aab_64eb_41b6_9964_a2e8a902d100.slice/crio-ab4329077154c5a32f3a47a0b49bf625d16f3684bd60f85e70c8aca7852158af WatchSource:0}: Error finding container ab4329077154c5a32f3a47a0b49bf625d16f3684bd60f85e70c8aca7852158af: Status 404 returned error can't find the container with id ab4329077154c5a32f3a47a0b49bf625d16f3684bd60f85e70c8aca7852158af Jul 17 15:09:37.451468 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:37.451208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:37.451468 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:37.451428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:37.451468 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:37.451352 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:37.451687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:37.451539 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:37.451687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:37.451549 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:37.451687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:37.451540 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:09:38.451522067 +0000 UTC m=+36.613276375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:37.451687 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:37.451623 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:38.451605609 +0000 UTC m=+36.613359925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:37.628894 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:37.628848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tt5xh" event={"ID":"09676aab-64eb-41b6-9964-a2e8a902d100","Type":"ContainerStarted","Data":"ab4329077154c5a32f3a47a0b49bf625d16f3684bd60f85e70c8aca7852158af"} Jul 17 15:09:38.444542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.443465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:09:38.444542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.443465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:09:38.444542 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.443681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:09:38.448105 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.447605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 15:09:38.448105 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.447666 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8gqh\"" Jul 17 15:09:38.448105 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.447862 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 15:09:38.448105 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.447605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54ptc\"" Jul 17 15:09:38.448105 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.448055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 15:09:38.448505 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.448153 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 15:09:38.461238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.461166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:38.461378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:38.461245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:38.461439 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:38.461405 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:38.461439 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:38.461421 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:38.461561 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:38.461484 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:38.461561 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:38.461504 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.461482979 +0000 UTC m=+38.623237304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:38.461561 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:38.461530 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.461517553 +0000 UTC m=+38.623271856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:39.164845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.164809 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b5cb98776-wgkcp"] Jul 17 15:09:39.185634 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.184007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.187487 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187441 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5cb98776-wgkcp"] Jul 17 15:09:39.187816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187798 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.187932 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187911 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7z8c4\"" Jul 17 15:09:39.188009 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187796 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 15:09:39.188063 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187817 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.188115 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187862 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 15:09:39.188115 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.187885 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 15:09:39.189466 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.188973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 15:09:39.271254 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.271222 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn"] Jul 17 15:09:39.273199 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.273181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" Jul 17 15:09:39.275039 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.274990 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-st868"] Jul 17 15:09:39.276215 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.275787 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.276215 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.275961 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.276215 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.276090 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hbk7b\"" Jul 17 15:09:39.277053 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.277022 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9"] Jul 17 15:09:39.277174 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.277147 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.279034 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.279017 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6"] Jul 17 15:09:39.279168 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.279145 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.279777 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.279758 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.280142 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.280122 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jbh7g\"" Jul 17 15:09:39.280336 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.280317 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 15:09:39.280506 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.280463 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.280667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.280652 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 15:09:39.281094 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.281056 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m"] Jul 17 15:09:39.281247 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.281230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 15:09:39.281503 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.281486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.282984 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.282963 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.283102 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.283085 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 15:09:39.283170 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.283114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.283240 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.283223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.283839 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.283513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cr97w\"" Jul 17 15:09:39.284274 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.284256 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.284545 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.284524 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 15:09:39.284631 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.284535 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 15:09:39.284714 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.284698 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fxzxg\"" Jul 17 15:09:39.284714 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.284709 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.286155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.286133 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.287944 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.287918 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 15:09:39.288051 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.288035 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.288349 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.288333 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9w47c\"" Jul 17 15:09:39.288349 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.288342 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn"] Jul 17 15:09:39.290321 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.290269 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6"] Jul 17 15:09:39.290896 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.290722 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 15:09:39.291162 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.291145 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9"] Jul 17 15:09:39.295342 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.295320 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-st868"] Jul 17 15:09:39.295824 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.295802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m"] Jul 17 15:09:39.368652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/374da249-1db7-4b1a-9206-5541d98a35bc-serving-cert\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.368809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.368809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gzz\" (UniqueName: \"kubernetes.io/projected/21301730-b3f2-474e-a8ab-aadff4916b69-kube-api-access-j9gzz\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.368809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvhn\" (UniqueName: \"kubernetes.io/projected/26f2b144-50b5-4078-a9c2-217ac52279d4-kube-api-access-tnvhn\") pod \"volume-data-source-validator-78cf4c6f6-vt7dn\" (UID: \"26f2b144-50b5-4078-a9c2-217ac52279d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" Jul 17 15:09:39.368809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlb77\" (UniqueName: \"kubernetes.io/projected/7f0f7dd2-48f8-4353-9445-44116d0fcd53-kube-api-access-wlb77\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.368809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdgv\" (UniqueName: \"kubernetes.io/projected/374da249-1db7-4b1a-9206-5541d98a35bc-kube-api-access-wqdgv\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-service-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.368927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-snapshots\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/21301730-b3f2-474e-a8ab-aadff4916b69-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.369116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f0f7dd2-48f8-4353-9445-44116d0fcd53-config\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.369457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-stats-auth\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.369457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0f7dd2-48f8-4353-9445-44116d0fcd53-serving-cert\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.369457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrwhh\" (UniqueName: \"kubernetes.io/projected/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-kube-api-access-vrwhh\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.369457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-default-certificate\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.369457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.369271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-tmp\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.370674 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.370650 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9"] Jul 17 15:09:39.373783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.373757 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.377194 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.377091 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 15:09:39.377194 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.377139 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 15:09:39.377385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.377359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9kzf9\"" Jul 17 15:09:39.378209 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.378190 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.378670 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.378438 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.379479 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.379457 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f"] Jul 17 15:09:39.381842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.381812 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xfnd4"] Jul 17 15:09:39.382050 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.381944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" Jul 17 15:09:39.383994 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.383972 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.384534 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.384513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-68hvh\"" Jul 17 15:09:39.387842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387016 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9"] Jul 17 15:09:39.387842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387257 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:09:39.387842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387627 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sh5nx\"" Jul 17 15:09:39.387842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387733 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 15:09:39.388091 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387849 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 15:09:39.388091 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.387956 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 15:09:39.388091 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.388025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f"] Jul 17 15:09:39.389666 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.389650 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xfnd4"] Jul 17 15:09:39.393312 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.393152 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 15:09:39.470198 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/374da249-1db7-4b1a-9206-5541d98a35bc-serving-cert\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.470198 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83e41028-8a86-4ac9-b1f6-a17964a63f71-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.470198 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gzz\" (UniqueName: \"kubernetes.io/projected/21301730-b3f2-474e-a8ab-aadff4916b69-kube-api-access-j9gzz\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvhn\" (UniqueName: \"kubernetes.io/projected/26f2b144-50b5-4078-a9c2-217ac52279d4-kube-api-access-tnvhn\") pod \"volume-data-source-validator-78cf4c6f6-vt7dn\" (UID: \"26f2b144-50b5-4078-a9c2-217ac52279d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlb77\" (UniqueName: \"kubernetes.io/projected/7f0f7dd2-48f8-4353-9445-44116d0fcd53-kube-api-access-wlb77\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9d8b\" (UniqueName: \"kubernetes.io/projected/94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd-kube-api-access-d9d8b\") pod \"network-check-source-7bc5b6bf85-pfg4f\" (UID: \"94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdgv\" (UniqueName: \"kubernetes.io/projected/374da249-1db7-4b1a-9206-5541d98a35bc-kube-api-access-wqdgv\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.470379 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:39.970355525 +0000 UTC m=+38.132109827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-service-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.470772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-snapshots\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/21301730-b3f2-474e-a8ab-aadff4916b69-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f0f7dd2-48f8-4353-9445-44116d0fcd53-config\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-stats-auth\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0f7dd2-48f8-4353-9445-44116d0fcd53-serving-cert\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.470743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrwhh\" (UniqueName: \"kubernetes.io/projected/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-kube-api-access-vrwhh\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.471016 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.471080 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:39.971062462 +0000 UTC m=+38.132816781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f0f7dd2-48f8-4353-9445-44116d0fcd53-config\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471376 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-service-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.471502 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/21301730-b3f2-474e-a8ab-aadff4916b69-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.471555 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:39.971540064 +0000 UTC m=+38.133294371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:39.474238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83e41028-8a86-4ac9-b1f6-a17964a63f71-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-default-certificate\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-tmp\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7cr\" (UniqueName: \"kubernetes.io/projected/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-kube-api-access-5h7cr\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.471907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsswv\" (UniqueName: \"kubernetes.io/projected/83e41028-8a86-4ac9-b1f6-a17964a63f71-kube-api-access-dsswv\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.472066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-snapshots\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.472635 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374da249-1db7-4b1a-9206-5541d98a35bc-tmp\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.472705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/374da249-1db7-4b1a-9206-5541d98a35bc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.474574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0f7dd2-48f8-4353-9445-44116d0fcd53-serving-cert\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.474779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.474626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/374da249-1db7-4b1a-9206-5541d98a35bc-serving-cert\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.475280 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.475259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-stats-auth\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.475335 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.475317 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-default-certificate\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.480045 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.479990 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlb77\" (UniqueName: \"kubernetes.io/projected/7f0f7dd2-48f8-4353-9445-44116d0fcd53-kube-api-access-wlb77\") pod \"service-ca-operator-5bcbc94c78-52lq6\" (UID: \"7f0f7dd2-48f8-4353-9445-44116d0fcd53\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.480167 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.480081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdgv\" (UniqueName: \"kubernetes.io/projected/374da249-1db7-4b1a-9206-5541d98a35bc-kube-api-access-wqdgv\") pod \"insights-operator-555d9d7885-st868\" (UID: \"374da249-1db7-4b1a-9206-5541d98a35bc\") " pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.480999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.480975 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gzz\" (UniqueName: \"kubernetes.io/projected/21301730-b3f2-474e-a8ab-aadff4916b69-kube-api-access-j9gzz\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.481095 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.481002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvhn\" (UniqueName: \"kubernetes.io/projected/26f2b144-50b5-4078-a9c2-217ac52279d4-kube-api-access-tnvhn\") pod \"volume-data-source-validator-78cf4c6f6-vt7dn\" (UID: \"26f2b144-50b5-4078-a9c2-217ac52279d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" Jul 17 15:09:39.482129 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.482110 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrwhh\" (UniqueName: \"kubernetes.io/projected/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-kube-api-access-vrwhh\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.573438 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9d8b\" (UniqueName: \"kubernetes.io/projected/94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd-kube-api-access-d9d8b\") pod \"network-check-source-7bc5b6bf85-pfg4f\" (UID: \"94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" Jul 17 15:09:39.573629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb7pj\" (UniqueName: \"kubernetes.io/projected/322213ec-d848-4955-918c-1144fa103e51-kube-api-access-jb7pj\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.573629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.573629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/322213ec-d848-4955-918c-1144fa103e51-serving-cert\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.573629 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-trusted-ca\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.573835 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.573654 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:39.573835 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-config\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.573835 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.573707 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.073692794 +0000 UTC m=+38.235447100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:39.573835 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83e41028-8a86-4ac9-b1f6-a17964a63f71-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.573835 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7cr\" (UniqueName: \"kubernetes.io/projected/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-kube-api-access-5h7cr\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.574074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsswv\" (UniqueName: \"kubernetes.io/projected/83e41028-8a86-4ac9-b1f6-a17964a63f71-kube-api-access-dsswv\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.574074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.573906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83e41028-8a86-4ac9-b1f6-a17964a63f71-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.574465 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.574431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83e41028-8a86-4ac9-b1f6-a17964a63f71-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.576250 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.576208 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83e41028-8a86-4ac9-b1f6-a17964a63f71-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.583716 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.583690 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsswv\" (UniqueName: \"kubernetes.io/projected/83e41028-8a86-4ac9-b1f6-a17964a63f71-kube-api-access-dsswv\") pod \"kube-storage-version-migrator-operator-7658d9b749-pw6t9\" (UID: \"83e41028-8a86-4ac9-b1f6-a17964a63f71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.584082 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.584058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7cr\" (UniqueName: \"kubernetes.io/projected/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-kube-api-access-5h7cr\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:39.584166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.584066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9d8b\" (UniqueName: \"kubernetes.io/projected/94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd-kube-api-access-d9d8b\") pod \"network-check-source-7bc5b6bf85-pfg4f\" (UID: \"94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" Jul 17 15:09:39.589061 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.588856 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" Jul 17 15:09:39.596923 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.596904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-st868" Jul 17 15:09:39.614771 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.614742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" Jul 17 15:09:39.674849 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.674809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb7pj\" (UniqueName: \"kubernetes.io/projected/322213ec-d848-4955-918c-1144fa103e51-kube-api-access-jb7pj\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.675016 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.674870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/322213ec-d848-4955-918c-1144fa103e51-serving-cert\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.675016 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.674912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-trusted-ca\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.675016 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.674984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-config\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.675916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.675883 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-config\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.676230 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.676208 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322213ec-d848-4955-918c-1144fa103e51-trusted-ca\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.677815 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.677788 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/322213ec-d848-4955-918c-1144fa103e51-serving-cert\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.685553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.685531 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb7pj\" (UniqueName: \"kubernetes.io/projected/322213ec-d848-4955-918c-1144fa103e51-kube-api-access-jb7pj\") pod \"console-operator-565b7b569d-xfnd4\" (UID: \"322213ec-d848-4955-918c-1144fa103e51\") " pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.689247 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.689230 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" Jul 17 15:09:39.697408 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.697383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" Jul 17 15:09:39.703157 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.703133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:39.978744 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.978705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.978930 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.978830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:39.978930 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.978873 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:39.978930 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:39.978881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:39.979060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.978950 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.978925675 +0000 UTC m=+39.140680007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:39.979060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.978998 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:39.979060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.979033 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.979017349 +0000 UTC m=+39.140771657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:39.979060 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:39.979056 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:40.979045823 +0000 UTC m=+39.140800126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:40.079723 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.079687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:40.079903 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.079874 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:40.079964 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.079957 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:41.079936647 +0000 UTC m=+39.241690974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:40.483730 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.483699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.483872 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.483880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.483937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:09:44.483917691 +0000 UTC m=+42.645672013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.484043 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.484086 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:40.484203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.484144 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:44.484127039 +0000 UTC m=+42.645881356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:40.768304 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.768034 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-st868"] Jul 17 15:09:40.791234 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.791200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6"] Jul 17 15:09:40.794247 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.794217 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn"] Jul 17 15:09:40.796154 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.796124 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9"] Jul 17 15:09:40.805898 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.805864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f"] Jul 17 15:09:40.808891 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.808816 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xfnd4"] Jul 17 15:09:40.813182 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.813139 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322213ec_d848_4955_918c_1144fa103e51.slice/crio-9408b823e2031ef44f473b7faf12a87ca2e86b26f2f6604ce02c6c7e49983199 WatchSource:0}: Error finding container 9408b823e2031ef44f473b7faf12a87ca2e86b26f2f6604ce02c6c7e49983199: Status 404 returned error can't find the container with id 9408b823e2031ef44f473b7faf12a87ca2e86b26f2f6604ce02c6c7e49983199 Jul 17 15:09:40.814387 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.814351 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f2b144_50b5_4078_a9c2_217ac52279d4.slice/crio-e40ec710dea8023697906e72e9cd387f3549c94ab516961a9bcd4e2db0ac7d86 WatchSource:0}: Error finding container e40ec710dea8023697906e72e9cd387f3549c94ab516961a9bcd4e2db0ac7d86: Status 404 returned error can't find the container with id e40ec710dea8023697906e72e9cd387f3549c94ab516961a9bcd4e2db0ac7d86 Jul 17 15:09:40.815737 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.815296 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374da249_1db7_4b1a_9206_5541d98a35bc.slice/crio-10398ef84b2087c0a899bbcb46cd6111c275b5dc616fa5d492268528401c8527 WatchSource:0}: Error finding container 10398ef84b2087c0a899bbcb46cd6111c275b5dc616fa5d492268528401c8527: Status 404 returned error can't find the container with id 10398ef84b2087c0a899bbcb46cd6111c275b5dc616fa5d492268528401c8527 Jul 17 15:09:40.816367 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.815837 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0f7dd2_48f8_4353_9445_44116d0fcd53.slice/crio-6372f602f727a8fae6a88cf383aa8aac4ccf07bd23b6bc6caa25e36bbfbd3ce6 WatchSource:0}: Error finding container 6372f602f727a8fae6a88cf383aa8aac4ccf07bd23b6bc6caa25e36bbfbd3ce6: Status 404 returned error can't find the container with id 6372f602f727a8fae6a88cf383aa8aac4ccf07bd23b6bc6caa25e36bbfbd3ce6 Jul 17 15:09:40.818480 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.818000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fa7ee4_6ba0_41d4_b3ff_6265f5f4adcd.slice/crio-112831f299686bd5233000e25862535853af89428a42082ccfc175063d19cec1 WatchSource:0}: Error finding container 112831f299686bd5233000e25862535853af89428a42082ccfc175063d19cec1: Status 404 returned error can't find the container with id 112831f299686bd5233000e25862535853af89428a42082ccfc175063d19cec1 Jul 17 15:09:40.818572 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:09:40.818509 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e41028_8a86_4ac9_b1f6_a17964a63f71.slice/crio-5e6ddd5516abd34627dc7aab4c09b5b432441140cf6288d5eea29c024d03df7e WatchSource:0}: Error finding container 5e6ddd5516abd34627dc7aab4c09b5b432441140cf6288d5eea29c024d03df7e: Status 404 returned error can't find the container with id 5e6ddd5516abd34627dc7aab4c09b5b432441140cf6288d5eea29c024d03df7e Jul 17 15:09:40.991514 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.991472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:40.991667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.991531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:40.991667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:40.991598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:40.991667 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.991656 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.991637327 +0000 UTC m=+41.153391643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:40.991819 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.991709 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:40.991819 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.991717 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:40.991819 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.991752 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.991741201 +0000 UTC m=+41.153495505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:40.991819 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:40.991783 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.991768573 +0000 UTC m=+41.153522876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:41.092663 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.092573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:41.092804 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:41.092720 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:41.092804 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:41.092780 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:43.092765499 +0000 UTC m=+41.254519801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:41.667828 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.666827 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="f34c9243b3842a0ce7f8d5cfec470e53722d7fbbf72af774470c4446c731f789" exitCode=0 Jul 17 15:09:41.667828 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.666917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"f34c9243b3842a0ce7f8d5cfec470e53722d7fbbf72af774470c4446c731f789"} Jul 17 15:09:41.672591 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.672027 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tt5xh" event={"ID":"09676aab-64eb-41b6-9964-a2e8a902d100","Type":"ContainerStarted","Data":"d5a89ff670d4e7bc1d5a88bc32e27c53d4b52ef743481e46e99242f4718e011c"} Jul 17 15:09:41.675996 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.675906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" event={"ID":"7f0f7dd2-48f8-4353-9445-44116d0fcd53","Type":"ContainerStarted","Data":"6372f602f727a8fae6a88cf383aa8aac4ccf07bd23b6bc6caa25e36bbfbd3ce6"} Jul 17 15:09:41.678127 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.677782 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-st868" event={"ID":"374da249-1db7-4b1a-9206-5541d98a35bc","Type":"ContainerStarted","Data":"10398ef84b2087c0a899bbcb46cd6111c275b5dc616fa5d492268528401c8527"} Jul 17 15:09:41.679279 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.679250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" event={"ID":"94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd","Type":"ContainerStarted","Data":"112831f299686bd5233000e25862535853af89428a42082ccfc175063d19cec1"} Jul 17 15:09:41.680765 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.680743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" event={"ID":"83e41028-8a86-4ac9-b1f6-a17964a63f71","Type":"ContainerStarted","Data":"5e6ddd5516abd34627dc7aab4c09b5b432441140cf6288d5eea29c024d03df7e"} Jul 17 15:09:41.682184 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.682164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" event={"ID":"322213ec-d848-4955-918c-1144fa103e51","Type":"ContainerStarted","Data":"9408b823e2031ef44f473b7faf12a87ca2e86b26f2f6604ce02c6c7e49983199"} Jul 17 15:09:41.683626 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.683575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" event={"ID":"26f2b144-50b5-4078-a9c2-217ac52279d4","Type":"ContainerStarted","Data":"e40ec710dea8023697906e72e9cd387f3549c94ab516961a9bcd4e2db0ac7d86"} Jul 17 15:09:41.721523 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:41.720958 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tt5xh" podStartSLOduration=2.40896487 podStartE2EDuration="5.720933865s" totalImagesPullingTime="3.311968995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:41.720140993 +0000 UTC m=+39.881895316" watchObservedRunningTime="2026-07-17 15:09:41.720933865 +0000 UTC m=+39.882688191" Jul 17 15:09:42.698675 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:42.698635 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e0561cf-4324-4046-88e8-37a9f2879541" containerID="29def2b9b8d8cb0fd492c0e2a44929030b234475d361aa26c98ee113ed404ae5" exitCode=0 Jul 17 15:09:42.700649 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:42.700329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerDied","Data":"29def2b9b8d8cb0fd492c0e2a44929030b234475d361aa26c98ee113ed404ae5"} Jul 17 15:09:43.021519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.021476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:43.021703 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.021559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:43.021703 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.021633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:43.021852 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.021833 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:43.021913 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.021903 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:47.021883765 +0000 UTC m=+45.183638071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:43.022306 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.022286 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:47.022273217 +0000 UTC m=+45.184027520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:43.022435 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.022367 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:43.022435 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.022403 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:47.022392196 +0000 UTC m=+45.184146500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:43.123057 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.122946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:43.123184 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.123072 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:43.123184 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:43.123163 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:47.123139137 +0000 UTC m=+45.284893445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:43.705570 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.705538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-df4zc" event={"ID":"1e0561cf-4324-4046-88e8-37a9f2879541","Type":"ContainerStarted","Data":"5a93a459ea0ce6419b161ac43075ac9d5a109766aae53ff653a9a4f45ff25213"} Jul 17 15:09:43.734072 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:43.734004 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-df4zc" podStartSLOduration=8.595071877 podStartE2EDuration="41.7339813s" totalImagesPullingTime="33.138909423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:43.732288638 +0000 UTC m=+41.894042963" watchObservedRunningTime="2026-07-17 15:09:43.7339813 +0000 UTC m=+41.895735626" Jul 17 15:09:44.535416 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:44.535367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:44.535641 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:44.535457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:44.535641 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:44.535550 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:44.535641 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:44.535571 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:44.535641 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:44.535605 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:44.535641 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:44.535625 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.535611166 +0000 UTC m=+50.697365468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:44.535832 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:44.535652 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.535639876 +0000 UTC m=+50.697394178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:47.058474 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:47.058429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:47.058581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.058618 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:47.058636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.058710 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:55.058675698 +0000 UTC m=+53.220430022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.058732 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:55.058721079 +0000 UTC m=+53.220475398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.058809 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:47.059012 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.058879 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:55.058860177 +0000 UTC m=+53.220614485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:47.159910 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:47.159874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:47.160122 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.160033 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:47.160122 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:47.160099 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:55.160082186 +0000 UTC m=+53.321836511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:47.717567 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:47.717531 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" event={"ID":"26f2b144-50b5-4078-a9c2-217ac52279d4","Type":"ContainerStarted","Data":"ff837a2d92cf32f775f82805b00b76a92e1f7ec222d04163f7b0ca75f71f1f09"} Jul 17 15:09:48.723943 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.723902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" event={"ID":"7f0f7dd2-48f8-4353-9445-44116d0fcd53","Type":"ContainerStarted","Data":"6b36d3c647349a5ca205493fa02ce5b1b07a15a1073db57ce3cb3ea0313701a6"} Jul 17 15:09:48.725670 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.725642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-st868" event={"ID":"374da249-1db7-4b1a-9206-5541d98a35bc","Type":"ContainerStarted","Data":"e01c83d1790919089874679c5c9bbb8ce2c5b5c0a35d9eff0bdf9a07b29713ab"} Jul 17 15:09:48.727806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.727639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" event={"ID":"94fa7ee4-6ba0-41d4-b3ff-6265f5f4adcd","Type":"ContainerStarted","Data":"8d6222522a2403f7ea80fb541aed0dad7fdf47fbe666416c9949d0fed7bab2d0"} Jul 17 15:09:48.729655 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.729550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" event={"ID":"83e41028-8a86-4ac9-b1f6-a17964a63f71","Type":"ContainerStarted","Data":"105523a8639fa38c4ccde6da2953f5f23bb9b533dcd5ac2f673a683130ae30eb"} Jul 17 15:09:48.731254 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.731233 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/0.log" Jul 17 15:09:48.731360 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.731272 2575 generic.go:356] "Generic (PLEG): container finished" podID="322213ec-d848-4955-918c-1144fa103e51" containerID="8434c4ead57fba6c646bbee7de30b0f627a6d1b168cd24f6cfd52c02bb7df933" exitCode=255 Jul 17 15:09:48.731417 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.731350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" event={"ID":"322213ec-d848-4955-918c-1144fa103e51","Type":"ContainerDied","Data":"8434c4ead57fba6c646bbee7de30b0f627a6d1b168cd24f6cfd52c02bb7df933"} Jul 17 15:09:48.731637 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.731623 2575 scope.go:117] "RemoveContainer" containerID="8434c4ead57fba6c646bbee7de30b0f627a6d1b168cd24f6cfd52c02bb7df933" Jul 17 15:09:48.742237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.742179 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" podStartSLOduration=2.963726499 podStartE2EDuration="9.742160214s" totalImagesPullingTime="6.778433715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.741853672 +0000 UTC m=+46.903607998" watchObservedRunningTime="2026-07-17 15:09:48.742160214 +0000 UTC m=+46.903914539" Jul 17 15:09:48.765268 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.763929 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-st868" podStartSLOduration=2.985833956 podStartE2EDuration="9.76390864s" totalImagesPullingTime="6.778074684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.762871596 +0000 UTC m=+46.924625921" watchObservedRunningTime="2026-07-17 15:09:48.76390864 +0000 UTC m=+46.925662967" Jul 17 15:09:48.783647 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.783588 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfg4f" podStartSLOduration=2.9988224409999997 podStartE2EDuration="9.78357068s" totalImagesPullingTime="6.784748239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.782759854 +0000 UTC m=+46.944514179" watchObservedRunningTime="2026-07-17 15:09:48.78357068 +0000 UTC m=+46.945324984" Jul 17 15:09:48.824495 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.824424 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vt7dn" podStartSLOduration=3.1316757 podStartE2EDuration="9.824407829s" totalImagesPullingTime="6.692732129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.823612642 +0000 UTC m=+46.985366989" watchObservedRunningTime="2026-07-17 15:09:48.824407829 +0000 UTC m=+46.986162154" Jul 17 15:09:48.843238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:48.843183 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" podStartSLOduration=3.067660016 podStartE2EDuration="9.843157623s" totalImagesPullingTime="6.775497607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.842083965 +0000 UTC m=+47.003838290" watchObservedRunningTime="2026-07-17 15:09:48.843157623 +0000 UTC m=+47.004911949" Jul 17 15:09:49.100613 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.100577 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-chgkv"] Jul 17 15:09:49.120287 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.119737 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chgkv"] Jul 17 15:09:49.120287 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.119849 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.122756 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.122716 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 15:09:49.123076 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.123055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rtllk\"" Jul 17 15:09:49.123286 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.123270 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 15:09:49.181731 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.181614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.181731 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.181688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.181945 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.181827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbszw\" (UniqueName: \"kubernetes.io/projected/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-api-access-kbszw\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.181945 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.181871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cf22707-b708-4c51-85ac-bc59e676db8e-data-volume\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.182068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.182051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cf22707-b708-4c51-85ac-bc59e676db8e-crio-socket\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283084 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbszw\" (UniqueName: \"kubernetes.io/projected/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-api-access-kbszw\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283260 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cf22707-b708-4c51-85ac-bc59e676db8e-data-volume\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283260 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cf22707-b708-4c51-85ac-bc59e676db8e-crio-socket\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283664 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283622 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cf22707-b708-4c51-85ac-bc59e676db8e-crio-socket\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283842 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.283822 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 15:09:49.283921 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.283921 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.283899 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:49.783871544 +0000 UTC m=+47.945625861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : configmap "kube-rbac-proxy" not found Jul 17 15:09:49.284033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.283921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.284199 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.284182 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 15:09:49.284270 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.284234 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:49.784215675 +0000 UTC m=+47.945969993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : secret "insights-runtime-extractor-tls" not found Jul 17 15:09:49.285276 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.285245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cf22707-b708-4c51-85ac-bc59e676db8e-data-volume\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.303970 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.303931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbszw\" (UniqueName: \"kubernetes.io/projected/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-api-access-kbszw\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.703971 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.703937 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:49.704122 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.704014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:49.736082 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736048 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:09:49.736552 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736536 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/0.log" Jul 17 15:09:49.736627 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736573 2575 generic.go:356] "Generic (PLEG): container finished" podID="322213ec-d848-4955-918c-1144fa103e51" containerID="dea043b181172117ae4046cd4ed50ff443d2dfa6e41535c5061348917f08de3e" exitCode=255 Jul 17 15:09:49.736708 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736681 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" event={"ID":"322213ec-d848-4955-918c-1144fa103e51","Type":"ContainerDied","Data":"dea043b181172117ae4046cd4ed50ff443d2dfa6e41535c5061348917f08de3e"} Jul 17 15:09:49.736763 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736746 2575 scope.go:117] "RemoveContainer" containerID="8434c4ead57fba6c646bbee7de30b0f627a6d1b168cd24f6cfd52c02bb7df933" Jul 17 15:09:49.736990 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.736970 2575 scope.go:117] "RemoveContainer" containerID="dea043b181172117ae4046cd4ed50ff443d2dfa6e41535c5061348917f08de3e" Jul 17 15:09:49.737203 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.737177 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xfnd4_openshift-console-operator(322213ec-d848-4955-918c-1144fa103e51)\"" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" podUID="322213ec-d848-4955-918c-1144fa103e51" Jul 17 15:09:49.788244 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.788215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.788359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:49.788250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:49.788359 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.788322 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 15:09:49.788515 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.788389 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:50.788367168 +0000 UTC m=+48.950121486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : configmap "kube-rbac-proxy" not found Jul 17 15:09:49.788515 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.788412 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 15:09:49.788515 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:49.788479 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:50.788462916 +0000 UTC m=+48.950217225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : secret "insights-runtime-extractor-tls" not found Jul 17 15:09:50.741864 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:50.741831 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:09:50.742260 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:50.742168 2575 scope.go:117] "RemoveContainer" containerID="dea043b181172117ae4046cd4ed50ff443d2dfa6e41535c5061348917f08de3e" Jul 17 15:09:50.742335 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:50.742316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xfnd4_openshift-console-operator(322213ec-d848-4955-918c-1144fa103e51)\"" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" podUID="322213ec-d848-4955-918c-1144fa103e51" Jul 17 15:09:50.797553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:50.797513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:50.797553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:50.797553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:50.797804 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:50.797631 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 15:09:50.797804 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:50.797712 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.797680828 +0000 UTC m=+50.959435131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : configmap "kube-rbac-proxy" not found Jul 17 15:09:50.797804 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:50.797746 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 15:09:50.797948 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:50.797809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.797784959 +0000 UTC m=+50.959539265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : secret "insights-runtime-extractor-tls" not found Jul 17 15:09:51.109182 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:51.109099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57xpr_b2472fb3-bf41-492f-ac70-764d612f02c8/dns-node-resolver/0.log" Jul 17 15:09:51.711969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:51.711941 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rbnn_9ea79044-bd0d-4114-8820-159fe7c6ecad/node-ca/0.log" Jul 17 15:09:52.614513 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:52.614474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.614618 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.614639 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dcc9c8b78-ns5hk: secret "image-registry-tls" not found Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:52.614638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.614701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls podName:5afd24b7-727f-4944-98ee-cae2f8bb0849 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:08.614686651 +0000 UTC m=+66.776440954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls") pod "image-registry-dcc9c8b78-ns5hk" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849") : secret "image-registry-tls" not found Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.614748 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 15:09:52.614884 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.614800 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls podName:94dbad65-8322-438c-88df-a20f8ec7319c nodeName:}" failed. No retries permitted until 2026-07-17 15:10:08.614789085 +0000 UTC m=+66.776543388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls") pod "dns-default-wskcr" (UID: "94dbad65-8322-438c-88df-a20f8ec7319c") : secret "dns-default-metrics-tls" not found Jul 17 15:09:52.815742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:52.815700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:52.815742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:52.815742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:52.815977 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.815824 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 15:09:52.815977 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.815843 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 15:09:52.815977 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.815887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:56.815873206 +0000 UTC m=+54.977627510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : configmap "kube-rbac-proxy" not found Jul 17 15:09:52.815977 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:52.815963 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:09:56.815950883 +0000 UTC m=+54.977705201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : secret "insights-runtime-extractor-tls" not found Jul 17 15:09:52.912838 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:52.912808 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tt5xh_09676aab-64eb-41b6-9964-a2e8a902d100/serve-healthcheck-canary/0.log" Jul 17 15:09:55.137029 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:55.136993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:55.137055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:55.137154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.137165 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:11.137148285 +0000 UTC m=+69.298902587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : configmap references non-existent config key: service-ca.crt Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.137210 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.137237 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.137263 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls podName:21301730-b3f2-474e-a8ab-aadff4916b69 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:11.137251108 +0000 UTC m=+69.299005411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-58cs9" (UID: "21301730-b3f2-474e-a8ab-aadff4916b69") : secret "cluster-monitoring-operator-tls" not found Jul 17 15:09:55.137481 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.137292 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs podName:b9a7c92b-64f8-4378-aaf0-5ae0f491a484 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:11.137278268 +0000 UTC m=+69.299032585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs") pod "router-default-5b5cb98776-wgkcp" (UID: "b9a7c92b-64f8-4378-aaf0-5ae0f491a484") : secret "router-metrics-certs-default" not found Jul 17 15:09:55.238089 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:55.238055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:09:55.238336 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.238212 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 15:09:55.238336 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:55.238283 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls podName:fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:11.238266209 +0000 UTC m=+69.400020513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-mv85m" (UID: "fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6") : secret "samples-operator-tls" not found Jul 17 15:09:56.851773 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:56.851728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:56.851773 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:56.851771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:56.852249 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:56.851960 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 15:09:56.852249 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:09:56.852028 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls podName:3cf22707-b708-4c51-85ac-bc59e676db8e nodeName:}" failed. No retries permitted until 2026-07-17 15:10:04.852013438 +0000 UTC m=+63.013767741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-chgkv" (UID: "3cf22707-b708-4c51-85ac-bc59e676db8e") : secret "insights-runtime-extractor-tls" not found Jul 17 15:09:56.852249 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:56.852235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cf22707-b708-4c51-85ac-bc59e676db8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:09:59.703396 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.703361 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:59.703857 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.703417 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:59.703857 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.703808 2575 scope.go:117] "RemoveContainer" containerID="dea043b181172117ae4046cd4ed50ff443d2dfa6e41535c5061348917f08de3e" Jul 17 15:09:59.770939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.770915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:09:59.771072 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.770977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" event={"ID":"322213ec-d848-4955-918c-1144fa103e51","Type":"ContainerStarted","Data":"c102478c5519ab1789429f9c698154a4d3718d68a7512c2e0d49f62db1a46d02"} Jul 17 15:09:59.771266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.771240 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:09:59.772625 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.772600 2575 patch_prober.go:28] interesting pod/console-operator-565b7b569d-xfnd4 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.17:8443/readyz\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jul 17 15:09:59.772726 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.772643 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" podUID="322213ec-d848-4955-918c-1144fa103e51" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.17:8443/readyz\": dial tcp 10.132.0.17:8443: connect: connection refused" Jul 17 15:09:59.791284 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:09:59.791224 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" podStartSLOduration=14.010620744 podStartE2EDuration="20.791208017s" totalImagesPullingTime="6.780587273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:59.790618699 +0000 UTC m=+57.952373024" watchObservedRunningTime="2026-07-17 15:09:59.791208017 +0000 UTC m=+57.952962343" Jul 17 15:10:00.778733 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:00.778706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-xfnd4" Jul 17 15:10:03.626192 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:03.626164 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9r4ss" Jul 17 15:10:04.921117 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:04.921060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:10:04.923384 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:04.923364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cf22707-b708-4c51-85ac-bc59e676db8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chgkv\" (UID: \"3cf22707-b708-4c51-85ac-bc59e676db8e\") " pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:10:05.034390 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:05.034359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rtllk\"" Jul 17 15:10:05.042503 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:05.042478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chgkv" Jul 17 15:10:05.170520 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:05.170497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chgkv"] Jul 17 15:10:05.173114 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:05.173053 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf22707_b708_4c51_85ac_bc59e676db8e.slice/crio-e642ccd86e079413dedaf31e30be9857956746817b1e4d18ba2be4fc4081083d WatchSource:0}: Error finding container e642ccd86e079413dedaf31e30be9857956746817b1e4d18ba2be4fc4081083d: Status 404 returned error can't find the container with id e642ccd86e079413dedaf31e30be9857956746817b1e4d18ba2be4fc4081083d Jul 17 15:10:05.794208 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:05.794110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chgkv" event={"ID":"3cf22707-b708-4c51-85ac-bc59e676db8e","Type":"ContainerStarted","Data":"e642ccd86e079413dedaf31e30be9857956746817b1e4d18ba2be4fc4081083d"} Jul 17 15:10:08.051886 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.051840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:10:08.055185 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.055155 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 15:10:08.064788 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.064764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e66ac139-cf27-4f1c-a4ca-7d0d42952cc7-metrics-certs\") pod \"network-metrics-daemon-ssq2s\" (UID: \"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7\") " pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:10:08.153671 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.153635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:10:08.158291 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.158263 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 15:10:08.164615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.164591 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8gqh\"" Jul 17 15:10:08.166734 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.166709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61eee7cb-47a3-4f54-aeba-96476b4d790b-original-pull-secret\") pod \"global-pull-secret-syncer-s928z\" (UID: \"61eee7cb-47a3-4f54-aeba-96476b4d790b\") " pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:10:08.172077 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.172054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssq2s" Jul 17 15:10:08.176481 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.176432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s928z" Jul 17 15:10:08.254652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.254614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:10:08.257271 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.257242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9ksw\" (UniqueName: \"kubernetes.io/projected/4e176ec1-f0ce-4d8c-940b-1cb91099fb2d-kube-api-access-b9ksw\") pod \"network-check-target-lvwl6\" (UID: \"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d\") " pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:10:08.474732 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.474610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54ptc\"" Jul 17 15:10:08.482078 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.482052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:10:08.658814 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.658777 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:08.659000 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.658864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:10:08.661357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.661332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94dbad65-8322-438c-88df-a20f8ec7319c-metrics-tls\") pod \"dns-default-wskcr\" (UID: \"94dbad65-8322-438c-88df-a20f8ec7319c\") " pod="openshift-dns/dns-default-wskcr" Jul 17 15:10:08.661500 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.661387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"image-registry-dcc9c8b78-ns5hk\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:08.802719 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.802647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hgpkw\"" Jul 17 15:10:08.810189 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.810162 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:08.831386 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.831356 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m7zkr\"" Jul 17 15:10:08.839442 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:08.839419 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wskcr" Jul 17 15:10:10.102893 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.102751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s928z"] Jul 17 15:10:10.106258 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:10.106224 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61eee7cb_47a3_4f54_aeba_96476b4d790b.slice/crio-5d3f4ccbdab3a9058be3a0db8c55190ad4b4be127b159c44fde781fc6fdc9587 WatchSource:0}: Error finding container 5d3f4ccbdab3a9058be3a0db8c55190ad4b4be127b159c44fde781fc6fdc9587: Status 404 returned error can't find the container with id 5d3f4ccbdab3a9058be3a0db8c55190ad4b4be127b159c44fde781fc6fdc9587 Jul 17 15:10:10.325178 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.325085 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssq2s"] Jul 17 15:10:10.328658 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.328630 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wskcr"] Jul 17 15:10:10.329834 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:10.329799 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66ac139_cf27_4f1c_a4ca_7d0d42952cc7.slice/crio-2768b982a099255a703b5ea974df4f7d71c0f85e137f58a0386d2f7f63dfe251 WatchSource:0}: Error finding container 2768b982a099255a703b5ea974df4f7d71c0f85e137f58a0386d2f7f63dfe251: Status 404 returned error can't find the container with id 2768b982a099255a703b5ea974df4f7d71c0f85e137f58a0386d2f7f63dfe251 Jul 17 15:10:10.330436 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:10.330394 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dbad65_8322_438c_88df_a20f8ec7319c.slice/crio-f9dd4c33a0167df1d6a69296177425bb9e9f3cc28cc88dbb50e0f24abeddc9c8 WatchSource:0}: Error finding container f9dd4c33a0167df1d6a69296177425bb9e9f3cc28cc88dbb50e0f24abeddc9c8: Status 404 returned error can't find the container with id f9dd4c33a0167df1d6a69296177425bb9e9f3cc28cc88dbb50e0f24abeddc9c8 Jul 17 15:10:10.352479 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.352436 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvwl6"] Jul 17 15:10:10.355040 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:10.355015 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e176ec1_f0ce_4d8c_940b_1cb91099fb2d.slice/crio-ca466ea6d9bd84f15711bab67e54c566f30d5979ea5292453f4c6e8ff1ec455f WatchSource:0}: Error finding container ca466ea6d9bd84f15711bab67e54c566f30d5979ea5292453f4c6e8ff1ec455f: Status 404 returned error can't find the container with id ca466ea6d9bd84f15711bab67e54c566f30d5979ea5292453f4c6e8ff1ec455f Jul 17 15:10:10.362529 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.362508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:10:10.365384 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:10.365364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afd24b7_727f_4944_98ee_cae2f8bb0849.slice/crio-b42dba795c5960a7ed4531b82483d50104940bccc9b222471b0377da5dde2f8b WatchSource:0}: Error finding container b42dba795c5960a7ed4531b82483d50104940bccc9b222471b0377da5dde2f8b: Status 404 returned error can't find the container with id b42dba795c5960a7ed4531b82483d50104940bccc9b222471b0377da5dde2f8b Jul 17 15:10:10.814671 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.814616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chgkv" event={"ID":"3cf22707-b708-4c51-85ac-bc59e676db8e","Type":"ContainerStarted","Data":"6353331c60f1920b650acb00cf494160ed165f225e75b0ccc1e634c782d0c1f3"} Jul 17 15:10:10.816876 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.816397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvwl6" event={"ID":"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d","Type":"ContainerStarted","Data":"866dd29b1731a3208a8f0cd09b0ce9ea9ad81b6adbe5fbee536e29eb8c6f8c2c"} Jul 17 15:10:10.816876 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.816442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvwl6" event={"ID":"4e176ec1-f0ce-4d8c-940b-1cb91099fb2d","Type":"ContainerStarted","Data":"ca466ea6d9bd84f15711bab67e54c566f30d5979ea5292453f4c6e8ff1ec455f"} Jul 17 15:10:10.816876 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.816662 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:10:10.820248 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.820220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" event={"ID":"5afd24b7-727f-4944-98ee-cae2f8bb0849","Type":"ContainerStarted","Data":"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78"} Jul 17 15:10:10.820376 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.820269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" event={"ID":"5afd24b7-727f-4944-98ee-cae2f8bb0849","Type":"ContainerStarted","Data":"b42dba795c5960a7ed4531b82483d50104940bccc9b222471b0377da5dde2f8b"} Jul 17 15:10:10.820376 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.820317 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:10.821889 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.821747 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssq2s" event={"ID":"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7","Type":"ContainerStarted","Data":"2768b982a099255a703b5ea974df4f7d71c0f85e137f58a0386d2f7f63dfe251"} Jul 17 15:10:10.824249 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.824227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wskcr" event={"ID":"94dbad65-8322-438c-88df-a20f8ec7319c","Type":"ContainerStarted","Data":"f9dd4c33a0167df1d6a69296177425bb9e9f3cc28cc88dbb50e0f24abeddc9c8"} Jul 17 15:10:10.825504 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.825472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s928z" event={"ID":"61eee7cb-47a3-4f54-aeba-96476b4d790b","Type":"ContainerStarted","Data":"5d3f4ccbdab3a9058be3a0db8c55190ad4b4be127b159c44fde781fc6fdc9587"} Jul 17 15:10:10.863092 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.863021 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lvwl6" podStartSLOduration=67.863000525 podStartE2EDuration="1m7.863000525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:10.839504792 +0000 UTC m=+69.001259119" watchObservedRunningTime="2026-07-17 15:10:10.863000525 +0000 UTC m=+69.024754843" Jul 17 15:10:10.863557 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:10.863516 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" podStartSLOduration=67.863503695 podStartE2EDuration="1m7.863503695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:10.862668892 +0000 UTC m=+69.024423221" watchObservedRunningTime="2026-07-17 15:10:10.863503695 +0000 UTC m=+69.025258022" Jul 17 15:10:11.183968 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.183930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:11.184577 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.183997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:10:11.184577 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.184064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:11.185211 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.185159 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-service-ca-bundle\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:11.189795 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.189771 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9a7c92b-64f8-4378-aaf0-5ae0f491a484-metrics-certs\") pod \"router-default-5b5cb98776-wgkcp\" (UID: \"b9a7c92b-64f8-4378-aaf0-5ae0f491a484\") " pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:11.191336 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.191311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/21301730-b3f2-474e-a8ab-aadff4916b69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-58cs9\" (UID: \"21301730-b3f2-474e-a8ab-aadff4916b69\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:10:11.285295 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.285257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:10:11.289971 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.289937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-mv85m\" (UID: \"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:10:11.300106 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.300079 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7z8c4\"" Jul 17 15:10:11.308409 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.308387 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:11.407749 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.407715 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cr97w\"" Jul 17 15:10:11.416192 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.416161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" Jul 17 15:10:11.422461 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.422217 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9w47c\"" Jul 17 15:10:11.431826 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.431591 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" Jul 17 15:10:11.557360 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.554007 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5cb98776-wgkcp"] Jul 17 15:10:11.603974 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.603942 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9"] Jul 17 15:10:11.638172 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:11.638141 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m"] Jul 17 15:10:11.881951 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:11.881870 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a7c92b_64f8_4378_aaf0_5ae0f491a484.slice/crio-d51050a53321b3b3d35a68f52c497d30e4073d62b575ce6040329ce43e67b9e6 WatchSource:0}: Error finding container d51050a53321b3b3d35a68f52c497d30e4073d62b575ce6040329ce43e67b9e6: Status 404 returned error can't find the container with id d51050a53321b3b3d35a68f52c497d30e4073d62b575ce6040329ce43e67b9e6 Jul 17 15:10:11.884332 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:11.884294 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21301730_b3f2_474e_a8ab_aadff4916b69.slice/crio-c6e32c5bd19879037d95a8be64fab5f609c0c0fa44db4d90f30a83810d6cbfbc WatchSource:0}: Error finding container c6e32c5bd19879037d95a8be64fab5f609c0c0fa44db4d90f30a83810d6cbfbc: Status 404 returned error can't find the container with id c6e32c5bd19879037d95a8be64fab5f609c0c0fa44db4d90f30a83810d6cbfbc Jul 17 15:10:12.839097 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:12.839056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" event={"ID":"21301730-b3f2-474e-a8ab-aadff4916b69","Type":"ContainerStarted","Data":"c6e32c5bd19879037d95a8be64fab5f609c0c0fa44db4d90f30a83810d6cbfbc"} Jul 17 15:10:12.845816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:12.845778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" event={"ID":"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6","Type":"ContainerStarted","Data":"c274cdef5de633caf70511977bfd5d89519d5914a20a03236d2e7f8e04d9fb85"} Jul 17 15:10:12.848646 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:12.848493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" event={"ID":"b9a7c92b-64f8-4378-aaf0-5ae0f491a484","Type":"ContainerStarted","Data":"cb8be719af3d186194afe9fd160905f062f64154c78727712fa4cf0178b51738"} Jul 17 15:10:12.848646 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:12.848545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" event={"ID":"b9a7c92b-64f8-4378-aaf0-5ae0f491a484","Type":"ContainerStarted","Data":"d51050a53321b3b3d35a68f52c497d30e4073d62b575ce6040329ce43e67b9e6"} Jul 17 15:10:12.870063 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:12.869948 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" podStartSLOduration=33.869930666 podStartE2EDuration="33.869930666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:12.869515551 +0000 UTC m=+71.031269878" watchObservedRunningTime="2026-07-17 15:10:12.869930666 +0000 UTC m=+71.031684991" Jul 17 15:10:13.309489 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:13.309438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:13.314549 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:13.314521 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:13.853594 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:13.853554 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:13.854936 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:13.854914 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b5cb98776-wgkcp" Jul 17 15:10:14.859207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:14.859173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssq2s" event={"ID":"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7","Type":"ContainerStarted","Data":"38e129ccb89cb86354f9d4db80989a2fd384ef0dbf4fd88d4d1b3931d64fce5d"} Jul 17 15:10:18.876182 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.876098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssq2s" event={"ID":"e66ac139-cf27-4f1c-a4ca-7d0d42952cc7","Type":"ContainerStarted","Data":"0f3c7a070c67141f80b56c0b96d54c9557c7648893118e6d45ebb482b975b677"} Jul 17 15:10:18.878276 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.878170 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" event={"ID":"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6","Type":"ContainerStarted","Data":"e4699d558c28d4b52b01664b325e3ac8041e44ecda051a4b13aa2e3d0ba6516a"} Jul 17 15:10:18.878276 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.878238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" event={"ID":"fe7c3962-cc47-4b81-92b3-8f3bfce9a9c6","Type":"ContainerStarted","Data":"289804354cb6eed035a46dc8209198a98ae60ee4fdd08af0eb407fda029ee0f6"} Jul 17 15:10:18.880196 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.880175 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wskcr" event={"ID":"94dbad65-8322-438c-88df-a20f8ec7319c","Type":"ContainerStarted","Data":"f1c7fd30a85e96cbca4c801885d7c2ed61fbb9dc921d07a0baf735f9f06b7aa5"} Jul 17 15:10:18.880302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.880216 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wskcr" Jul 17 15:10:18.880302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.880235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wskcr" event={"ID":"94dbad65-8322-438c-88df-a20f8ec7319c","Type":"ContainerStarted","Data":"0b5cc231141d18f63844b468c24c24d17b7602f49a3a7269b35b5ebf634934ca"} Jul 17 15:10:18.881925 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.881890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s928z" event={"ID":"61eee7cb-47a3-4f54-aeba-96476b4d790b","Type":"ContainerStarted","Data":"eb9c5b8ad5e650c458a8fa8a535f64b66fce8bb50df1a7a571534f8751fdaebb"} Jul 17 15:10:18.883986 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.883965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" event={"ID":"21301730-b3f2-474e-a8ab-aadff4916b69","Type":"ContainerStarted","Data":"44c2dad5e072378dd8c174918310a1f51c84b8eadb79462b66cd5616e329f504"} Jul 17 15:10:18.886403 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.886378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chgkv" event={"ID":"3cf22707-b708-4c51-85ac-bc59e676db8e","Type":"ContainerStarted","Data":"7aee314e37c8f42f4012508613b6a5164991a8be543cb3725e2a084a8b5b3362"} Jul 17 15:10:18.895814 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.895797 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:10:18.900878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.900829 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ssq2s" podStartSLOduration=75.310628785 podStartE2EDuration="1m16.900811172s" totalImagesPullingTime="1.590182387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.900348129 +0000 UTC m=+77.062102488" watchObservedRunningTime="2026-07-17 15:10:18.900811172 +0000 UTC m=+77.062565476" Jul 17 15:10:18.905680 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.905541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:18.908705 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z5mff\"" Jul 17 15:10:18.908819 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908587 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 15:10:18.908819 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908805 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 15:10:18.908947 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 15:10:18.908947 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908884 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 15:10:18.909049 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.908980 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 15:10:18.909207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.909188 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 15:10:18.910110 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.909646 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 15:10:18.911326 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.911304 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:10:18.935531 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.934371 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wskcr" podStartSLOduration=35.915231 podStartE2EDuration="42.934352486s" totalImagesPullingTime="7.019121486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.934003569 +0000 UTC m=+77.095757896" watchObservedRunningTime="2026-07-17 15:10:18.934352486 +0000 UTC m=+77.096106812" Jul 17 15:10:18.954876 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.954827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s928z" podStartSLOduration=67.616385336 podStartE2EDuration="1m15.954812835s" totalImagesPullingTime="8.338427499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.954606057 +0000 UTC m=+77.116360383" watchObservedRunningTime="2026-07-17 15:10:18.954812835 +0000 UTC m=+77.116567160" Jul 17 15:10:18.971783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.971731 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-58cs9" podStartSLOduration=33.411191278 podStartE2EDuration="39.971717014s" totalImagesPullingTime="6.560525736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.970840731 +0000 UTC m=+77.132595057" watchObservedRunningTime="2026-07-17 15:10:18.971717014 +0000 UTC m=+77.133471340" Jul 17 15:10:18.991631 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:18.991584 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-mv85m" podStartSLOduration=33.471174732 podStartE2EDuration="39.991568989s" totalImagesPullingTime="6.520394257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.991186431 +0000 UTC m=+77.152940758" watchObservedRunningTime="2026-07-17 15:10:18.991568989 +0000 UTC m=+77.153323314" Jul 17 15:10:19.050459 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w95sm\" (UniqueName: \"kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.050661 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.050661 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.050774 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.050774 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.050878 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.050786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.132387 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.132306 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x"] Jul 17 15:10:19.143106 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.143078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:19.147138 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.147112 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x"] Jul 17 15:10:19.147682 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.147662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 15:10:19.147903 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.147884 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bbl8h\"" Jul 17 15:10:19.154224 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w95sm\" (UniqueName: \"kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.154316 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.154316 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.154422 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.154422 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.154422 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.154398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.155049 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.155028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.155209 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.155160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.156872 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.156850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.157425 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.157400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.157547 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.157475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.165082 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.165058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w95sm\" (UniqueName: \"kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm\") pod \"console-c544f7848-wsq9s\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.217051 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.217010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:19.255283 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.255068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73b403dd-8b82-450e-97ab-35b69ff1db13-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n92x\" (UID: \"73b403dd-8b82-450e-97ab-35b69ff1db13\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:19.356672 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.356581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73b403dd-8b82-450e-97ab-35b69ff1db13-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n92x\" (UID: \"73b403dd-8b82-450e-97ab-35b69ff1db13\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:19.359697 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.359663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73b403dd-8b82-450e-97ab-35b69ff1db13-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5n92x\" (UID: \"73b403dd-8b82-450e-97ab-35b69ff1db13\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:19.401537 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.401503 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:10:19.404746 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:19.404721 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacda9a1_a076_4381_96fe_32335d7e340d.slice/crio-65eafb20dc9abf016474e47a648fdf0bb8927501fb003b2e2164c577312a1bcd WatchSource:0}: Error finding container 65eafb20dc9abf016474e47a648fdf0bb8927501fb003b2e2164c577312a1bcd: Status 404 returned error can't find the container with id 65eafb20dc9abf016474e47a648fdf0bb8927501fb003b2e2164c577312a1bcd Jul 17 15:10:19.457867 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.457831 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:19.631175 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.631146 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x"] Jul 17 15:10:19.635512 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:19.635478 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b403dd_8b82_450e_97ab_35b69ff1db13.slice/crio-0e0c6a8a78a059e7306f676428b31f07e85bb6fc3f4726f8bcc66886e07750a4 WatchSource:0}: Error finding container 0e0c6a8a78a059e7306f676428b31f07e85bb6fc3f4726f8bcc66886e07750a4: Status 404 returned error can't find the container with id 0e0c6a8a78a059e7306f676428b31f07e85bb6fc3f4726f8bcc66886e07750a4 Jul 17 15:10:19.898736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.898692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c544f7848-wsq9s" event={"ID":"bacda9a1-a076-4381-96fe-32335d7e340d","Type":"ContainerStarted","Data":"65eafb20dc9abf016474e47a648fdf0bb8927501fb003b2e2164c577312a1bcd"} Jul 17 15:10:19.900031 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:19.899991 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" event={"ID":"73b403dd-8b82-450e-97ab-35b69ff1db13","Type":"ContainerStarted","Data":"0e0c6a8a78a059e7306f676428b31f07e85bb6fc3f4726f8bcc66886e07750a4"} Jul 17 15:10:23.918863 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.918826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c544f7848-wsq9s" event={"ID":"bacda9a1-a076-4381-96fe-32335d7e340d","Type":"ContainerStarted","Data":"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098"} Jul 17 15:10:23.920852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.920831 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chgkv" event={"ID":"3cf22707-b708-4c51-85ac-bc59e676db8e","Type":"ContainerStarted","Data":"448dd9d6d24cdb4292b65015e52ae42e230177776bc38e2b31e5e4588cc03ef0"} Jul 17 15:10:23.922210 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.922192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" event={"ID":"73b403dd-8b82-450e-97ab-35b69ff1db13","Type":"ContainerStarted","Data":"a9fc5a5f20203a99f74cc6ad92366d5f2bd3f42a764498b3def6557cf11a336d"} Jul 17 15:10:23.922309 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.922293 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:23.929857 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.929826 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" Jul 17 15:10:23.940690 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.940648 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c544f7848-wsq9s" podStartSLOduration=1.6340591020000002 podStartE2EDuration="5.940634148s" totalImagesPullingTime="4.306575046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:23.93992649 +0000 UTC m=+82.101680816" watchObservedRunningTime="2026-07-17 15:10:23.940634148 +0000 UTC m=+82.102388473" Jul 17 15:10:23.957506 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.957410 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5n92x" podStartSLOduration=0.890819468 podStartE2EDuration="4.957398784s" totalImagesPullingTime="4.066579316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:23.957027481 +0000 UTC m=+82.118781806" watchObservedRunningTime="2026-07-17 15:10:23.957398784 +0000 UTC m=+82.119153145" Jul 17 15:10:23.976573 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:23.976528 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-chgkv" podStartSLOduration=16.736161264 podStartE2EDuration="34.976513988s" totalImagesPullingTime="18.240352724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:23.976286995 +0000 UTC m=+82.138041320" watchObservedRunningTime="2026-07-17 15:10:23.976513988 +0000 UTC m=+82.138268346" Jul 17 15:10:28.903430 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:28.903395 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wskcr" Jul 17 15:10:29.218222 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:29.218132 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:29.218222 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:29.218209 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:29.222383 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:29.222358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:29.949032 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:29.949006 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:10:31.837811 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:31.837783 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:32.603259 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:32.603229 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:10:39.589386 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.589343 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mn4ql"] Jul 17 15:10:39.686205 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.686177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.690592 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.690551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 15:10:39.690770 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.690745 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 15:10:39.692036 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.692013 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 15:10:39.692150 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.692118 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 15:10:39.692150 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.692140 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wtgbr\"" Jul 17 15:10:39.707692 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.707816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-tls\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.707816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-sys\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.707816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7sd\" (UniqueName: \"kubernetes.io/projected/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-kube-api-access-vz7sd\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.707816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-textfile\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.707816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-root\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.708031 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-wtmp\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.708031 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.707879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.708031 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.708004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-metrics-client-ca\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809434 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-tls\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-sys\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7sd\" (UniqueName: \"kubernetes.io/projected/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-kube-api-access-vz7sd\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-textfile\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-root\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-wtmp\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809615 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809601 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-sys\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-root\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809681 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-metrics-client-ca\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.809938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.809751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.810145 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.810039 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-wtmp\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.810207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.810178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-textfile\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.810278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.810257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.810337 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.810273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-metrics-client-ca\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.811984 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.811964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-tls\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.812388 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.812370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.818780 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.818755 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7sd\" (UniqueName: \"kubernetes.io/projected/512677ea-a9cd-4637-82ef-2e2dd91c1d5f-kube-api-access-vz7sd\") pod \"node-exporter-mn4ql\" (UID: \"512677ea-a9cd-4637-82ef-2e2dd91c1d5f\") " pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:39.999779 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:39.999748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mn4ql" Jul 17 15:10:40.042326 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:40.042297 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512677ea_a9cd_4637_82ef_2e2dd91c1d5f.slice/crio-eec46d3be91dab511d9463699506b6b023ad6a2222fa5359f6eba3542950c037 WatchSource:0}: Error finding container eec46d3be91dab511d9463699506b6b023ad6a2222fa5359f6eba3542950c037: Status 404 returned error can't find the container with id eec46d3be91dab511d9463699506b6b023ad6a2222fa5359f6eba3542950c037 Jul 17 15:10:40.664230 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.664193 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:10:40.667323 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.667303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.669816 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.669792 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 15:10:40.669917 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.669846 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 15:10:40.670174 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670146 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 15:10:40.670290 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 15:10:40.670290 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670219 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 15:10:40.670514 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670499 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 15:10:40.670610 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670512 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 15:10:40.670677 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 15:10:40.670677 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 15:10:40.670780 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.670709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4svzk\"" Jul 17 15:10:40.690292 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.690258 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:10:40.716798 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnqp\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.716998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.716998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.716998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.716998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.716998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.716964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.717275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.717259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.817902 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.817872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.817916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.817944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.817963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.817981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:10:40.818100 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle podName:aea34c1c-a2f0-4c9c-ba7c-145e71ff00db nodeName:}" failed. No retries permitted until 2026-07-17 15:10:41.318078356 +0000 UTC m=+99.479832662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db") : configmap references non-existent config key: ca-bundle.crt Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnqp\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818659 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818342 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818659 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.818659 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.819057 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.818686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.821175 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.821143 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.822796 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.822770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.822898 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.822862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.823836 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.823794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.824008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.823959 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.825060 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.825020 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.825376 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.825355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.826402 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.826381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.826832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.826772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.827331 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.827283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.829614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.829592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnqp\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:40.989510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:40.989395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn4ql" event={"ID":"512677ea-a9cd-4637-82ef-2e2dd91c1d5f","Type":"ContainerStarted","Data":"eec46d3be91dab511d9463699506b6b023ad6a2222fa5359f6eba3542950c037"} Jul 17 15:10:41.322948 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.322871 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:41.323597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.323580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:41.578642 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.578553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:10:41.732261 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.732229 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:10:41.732807 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:41.732778 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea34c1c_a2f0_4c9c_ba7c_145e71ff00db.slice/crio-06023f5d0f47ef08dee09ea248dd9296b1194fe8d0644aa3e8f51a8ab3d89ff0 WatchSource:0}: Error finding container 06023f5d0f47ef08dee09ea248dd9296b1194fe8d0644aa3e8f51a8ab3d89ff0: Status 404 returned error can't find the container with id 06023f5d0f47ef08dee09ea248dd9296b1194fe8d0644aa3e8f51a8ab3d89ff0 Jul 17 15:10:41.791016 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.790973 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:10:41.835724 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.835647 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lvwl6" Jul 17 15:10:41.998753 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.998716 2575 generic.go:356] "Generic (PLEG): container finished" podID="512677ea-a9cd-4637-82ef-2e2dd91c1d5f" containerID="bb47c1608ec61a7bfe63249f689d53fb213022301265a83602521e62d5fa55ff" exitCode=0 Jul 17 15:10:41.998941 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.998802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn4ql" event={"ID":"512677ea-a9cd-4637-82ef-2e2dd91c1d5f","Type":"ContainerDied","Data":"bb47c1608ec61a7bfe63249f689d53fb213022301265a83602521e62d5fa55ff"} Jul 17 15:10:41.999989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:41.999968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"06023f5d0f47ef08dee09ea248dd9296b1194fe8d0644aa3e8f51a8ab3d89ff0"} Jul 17 15:10:43.007689 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:43.007652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn4ql" event={"ID":"512677ea-a9cd-4637-82ef-2e2dd91c1d5f","Type":"ContainerStarted","Data":"7c75f8a2712f51de2948ea966df72274a8889712a91c30102a3d855b4d0b3e22"} Jul 17 15:10:43.008117 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:43.007707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn4ql" event={"ID":"512677ea-a9cd-4637-82ef-2e2dd91c1d5f","Type":"ContainerStarted","Data":"8876a1c9eb19c123b37cd2f74b9f519284ab178f77537435461ba8d225446329"} Jul 17 15:10:43.009141 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:43.009115 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="cb011e0bd225caafc7bc68010a5b972e711684c0ffd994dd85a336e0db85204b" exitCode=0 Jul 17 15:10:43.009237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:43.009158 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"cb011e0bd225caafc7bc68010a5b972e711684c0ffd994dd85a336e0db85204b"} Jul 17 15:10:43.032556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:43.032498 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mn4ql" podStartSLOduration=2.982383734 podStartE2EDuration="4.032479983s" totalImagesPullingTime="984.269709ms" totalInitContainerRuntime="65.82654ms" isStatefulPod=true podCreationTimestamp="2026-07-17 15:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:43.030481656 +0000 UTC m=+101.192235975" watchObservedRunningTime="2026-07-17 15:10:43.032479983 +0000 UTC m=+101.194234307" Jul 17 15:10:44.454776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.454738 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb"] Jul 17 15:10:44.457949 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.457927 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.461828 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.461802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p8pmd\"" Jul 17 15:10:44.465439 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.465165 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 17 15:10:44.511559 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.511495 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb"] Jul 17 15:10:44.551469 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.551426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd003d00-9bbb-4b90-bb79-6073e756e71a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.551647 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.551549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs8qh\" (UniqueName: \"kubernetes.io/projected/cd003d00-9bbb-4b90-bb79-6073e756e71a-kube-api-access-bs8qh\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.652929 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.652894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs8qh\" (UniqueName: \"kubernetes.io/projected/cd003d00-9bbb-4b90-bb79-6073e756e71a-kube-api-access-bs8qh\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.653065 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.653036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd003d00-9bbb-4b90-bb79-6073e756e71a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.655658 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.655633 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd003d00-9bbb-4b90-bb79-6073e756e71a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.666009 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.665986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs8qh\" (UniqueName: \"kubernetes.io/projected/cd003d00-9bbb-4b90-bb79-6073e756e71a-kube-api-access-bs8qh\") pod \"monitoring-plugin-7b7b7bc8bf-p9dcb\" (UID: \"cd003d00-9bbb-4b90-bb79-6073e756e71a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.767883 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.767859 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:44.917043 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:44.917018 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb"] Jul 17 15:10:44.919441 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:10:44.919415 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd003d00_9bbb_4b90_bb79_6073e756e71a.slice/crio-6e23f4b820da42a130b8b5846c692b5a7c5f06a3e3ee54ad8f5d9d8e01b593d4 WatchSource:0}: Error finding container 6e23f4b820da42a130b8b5846c692b5a7c5f06a3e3ee54ad8f5d9d8e01b593d4: Status 404 returned error can't find the container with id 6e23f4b820da42a130b8b5846c692b5a7c5f06a3e3ee54ad8f5d9d8e01b593d4 Jul 17 15:10:45.018119 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.018041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" event={"ID":"cd003d00-9bbb-4b90-bb79-6073e756e71a","Type":"ContainerStarted","Data":"6e23f4b820da42a130b8b5846c692b5a7c5f06a3e3ee54ad8f5d9d8e01b593d4"} Jul 17 15:10:45.020980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.020956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"80e21c971ee16b3ee45f4df886a6b1b249a069660a108ca1c63cf79572ee2ee8"} Jul 17 15:10:45.021101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.021011 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"7df94f9185c2bb35d9c37f75ed44dd264196b8bc299d7016e63236ac46095565"} Jul 17 15:10:45.021101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.021038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"e5bde6b948c7a3196d0b0afd78b4846ef9e41bdf327437ff5cb7d15d2b756819"} Jul 17 15:10:45.021101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.021062 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"a4120aadd34b8a1725dc471b546d5c7e4640396b3bd63c22322269c5e256355d"} Jul 17 15:10:45.021101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:45.021085 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"35dc7fb19ce20a43c15a1127c75dc5d2a31665f720ef41305f229807368e7c09"} Jul 17 15:10:46.030161 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:46.030123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerStarted","Data":"586119afa678e8d62816779a209314c8507e0269d20aec117792403348e54e3a"} Jul 17 15:10:46.069036 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:46.068984 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.622438796 podStartE2EDuration="6.068963895s" totalImagesPullingTime="3.430329536s" totalInitContainerRuntime="16.195563ms" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:46.06684142 +0000 UTC m=+104.228595781" watchObservedRunningTime="2026-07-17 15:10:46.068963895 +0000 UTC m=+104.230718220" Jul 17 15:10:47.035507 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:47.035473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" event={"ID":"cd003d00-9bbb-4b90-bb79-6073e756e71a","Type":"ContainerStarted","Data":"ac6a4d7b2f28431ebdf220f748d1acea3a62d024f4a474ceafba57f6993ab8b2"} Jul 17 15:10:47.035922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:47.035728 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:47.044062 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:47.044036 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" Jul 17 15:10:47.075814 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:47.075770 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p9dcb" podStartSLOduration=1.425964254 podStartE2EDuration="3.075756726s" totalImagesPullingTime="1.649792472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:47.073946134 +0000 UTC m=+105.235700459" watchObservedRunningTime="2026-07-17 15:10:47.075756726 +0000 UTC m=+105.237511051" Jul 17 15:10:57.627572 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.627511 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" podUID="5afd24b7-727f-4944-98ee-cae2f8bb0849" containerName="registry" containerID="cri-o://70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78" gracePeriod=30 Jul 17 15:10:57.876958 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.876935 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:57.966624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966594 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm4px\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.966786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966652 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.966786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.966786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966719 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.966786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966736 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.966786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966776 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.967021 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966800 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.967021 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.966968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token\") pod \"5afd24b7-727f-4944-98ee-cae2f8bb0849\" (UID: \"5afd24b7-727f-4944-98ee-cae2f8bb0849\") " Jul 17 15:10:57.967438 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.967379 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:10:57.967578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.967442 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:10:57.969218 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.969193 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:10:57.969321 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.969286 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px" (OuterVolumeSpecName: "kube-api-access-vm4px") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "kube-api-access-vm4px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:10:57.969437 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.969403 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:10:57.969630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.969533 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:10:57.969630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.969611 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:10:57.975569 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:57.975546 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5afd24b7-727f-4944-98ee-cae2f8bb0849" (UID: "5afd24b7-727f-4944-98ee-cae2f8bb0849"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:10:58.068528 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068495 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-tls\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068528 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068521 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-trusted-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068528 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068530 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5afd24b7-727f-4944-98ee-cae2f8bb0849-registry-certificates\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068540 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-image-registry-private-configuration\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068550 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-bound-sa-token\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068558 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm4px\" (UniqueName: \"kubernetes.io/projected/5afd24b7-727f-4944-98ee-cae2f8bb0849-kube-api-access-vm4px\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068566 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5afd24b7-727f-4944-98ee-cae2f8bb0849-installation-pull-secrets\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.068736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.068575 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5afd24b7-727f-4944-98ee-cae2f8bb0849-ca-trust-extracted\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:10:58.082681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.082645 2575 generic.go:356] "Generic (PLEG): container finished" podID="5afd24b7-727f-4944-98ee-cae2f8bb0849" containerID="70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78" exitCode=0 Jul 17 15:10:58.082681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.082682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" event={"ID":"5afd24b7-727f-4944-98ee-cae2f8bb0849","Type":"ContainerDied","Data":"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78"} Jul 17 15:10:58.082893 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.082707 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" Jul 17 15:10:58.082893 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.082742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dcc9c8b78-ns5hk" event={"ID":"5afd24b7-727f-4944-98ee-cae2f8bb0849","Type":"ContainerDied","Data":"b42dba795c5960a7ed4531b82483d50104940bccc9b222471b0377da5dde2f8b"} Jul 17 15:10:58.082893 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.082762 2575 scope.go:117] "RemoveContainer" containerID="70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78" Jul 17 15:10:58.092085 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.092068 2575 scope.go:117] "RemoveContainer" containerID="70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78" Jul 17 15:10:58.092349 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:10:58.092328 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78\": container with ID starting with 70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78 not found: ID does not exist" containerID="70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78" Jul 17 15:10:58.092415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.092362 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78"} err="failed to get container status \"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78\": rpc error: code = NotFound desc = could not find container \"70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78\": container with ID starting with 70afa67fe290eaf182edc594374e249122dda229c7c62b2ba5fb64b5bd76ab78 not found: ID does not exist" Jul 17 15:10:58.107160 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.107139 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:10:58.114539 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.114517 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dcc9c8b78-ns5hk"] Jul 17 15:10:58.448419 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:10:58.448389 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5afd24b7-727f-4944-98ee-cae2f8bb0849" path="/var/lib/kubelet/pods/5afd24b7-727f-4944-98ee-cae2f8bb0849/volumes" Jul 17 15:11:06.812162 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:06.812095 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c544f7848-wsq9s" podUID="bacda9a1-a076-4381-96fe-32335d7e340d" containerName="console" containerID="cri-o://434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098" gracePeriod=15 Jul 17 15:11:07.059850 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.059826 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:11:07.117066 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.116980 2575 generic.go:356] "Generic (PLEG): container finished" podID="bacda9a1-a076-4381-96fe-32335d7e340d" containerID="434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098" exitCode=0 Jul 17 15:11:07.117066 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.117022 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c544f7848-wsq9s" Jul 17 15:11:07.117066 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.117032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c544f7848-wsq9s" event={"ID":"bacda9a1-a076-4381-96fe-32335d7e340d","Type":"ContainerDied","Data":"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098"} Jul 17 15:11:07.117304 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.117079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c544f7848-wsq9s" event={"ID":"bacda9a1-a076-4381-96fe-32335d7e340d","Type":"ContainerDied","Data":"65eafb20dc9abf016474e47a648fdf0bb8927501fb003b2e2164c577312a1bcd"} Jul 17 15:11:07.117304 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.117108 2575 scope.go:117] "RemoveContainer" containerID="434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098" Jul 17 15:11:07.124964 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.124940 2575 scope.go:117] "RemoveContainer" containerID="434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098" Jul 17 15:11:07.125247 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:11:07.125226 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098\": container with ID starting with 434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098 not found: ID does not exist" containerID="434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098" Jul 17 15:11:07.125324 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.125269 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098"} err="failed to get container status \"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098\": rpc error: code = NotFound desc = could not find container \"434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098\": container with ID starting with 434f3cf1cd3c53557154e76ae999cec6e5a25880e33788cc7afb53865f710098 not found: ID does not exist" Jul 17 15:11:07.140010 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.139986 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140027 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140101 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140073 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140103 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140135 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w95sm\" (UniqueName: \"kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140201 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config\") pod \"bacda9a1-a076-4381-96fe-32335d7e340d\" (UID: \"bacda9a1-a076-4381-96fe-32335d7e340d\") " Jul 17 15:11:07.140461 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140416 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca" (OuterVolumeSpecName: "service-ca") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:11:07.140535 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config" (OuterVolumeSpecName: "console-config") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:11:07.140587 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.140545 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:11:07.142274 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.142254 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:11:07.142357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.142280 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm" (OuterVolumeSpecName: "kube-api-access-w95sm") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "kube-api-access-w95sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:11:07.142357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.142310 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bacda9a1-a076-4381-96fe-32335d7e340d" (UID: "bacda9a1-a076-4381-96fe-32335d7e340d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:11:07.240852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240821 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.240852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240848 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-console-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.240852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240857 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-oauth-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.241058 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240866 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w95sm\" (UniqueName: \"kubernetes.io/projected/bacda9a1-a076-4381-96fe-32335d7e340d-kube-api-access-w95sm\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.241058 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240874 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bacda9a1-a076-4381-96fe-32335d7e340d-console-oauth-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.241058 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.240884 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bacda9a1-a076-4381-96fe-32335d7e340d-service-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:11:07.447323 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.447292 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:11:07.468041 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:07.468013 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c544f7848-wsq9s"] Jul 17 15:11:08.448116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:08.448072 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bacda9a1-a076-4381-96fe-32335d7e340d" path="/var/lib/kubelet/pods/bacda9a1-a076-4381-96fe-32335d7e340d/volumes" Jul 17 15:11:10.130344 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:10.130309 2575 generic.go:356] "Generic (PLEG): container finished" podID="7f0f7dd2-48f8-4353-9445-44116d0fcd53" containerID="6b36d3c647349a5ca205493fa02ce5b1b07a15a1073db57ce3cb3ea0313701a6" exitCode=0 Jul 17 15:11:10.130834 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:10.130387 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" event={"ID":"7f0f7dd2-48f8-4353-9445-44116d0fcd53","Type":"ContainerDied","Data":"6b36d3c647349a5ca205493fa02ce5b1b07a15a1073db57ce3cb3ea0313701a6"} Jul 17 15:11:10.130834 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:10.130730 2575 scope.go:117] "RemoveContainer" containerID="6b36d3c647349a5ca205493fa02ce5b1b07a15a1073db57ce3cb3ea0313701a6" Jul 17 15:11:11.135968 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:11.135936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-52lq6" event={"ID":"7f0f7dd2-48f8-4353-9445-44116d0fcd53","Type":"ContainerStarted","Data":"2c5ece93b88bd8ac0678e539419cec9c5657a5021b43731f39364da17e03e69d"} Jul 17 15:11:14.148354 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:14.148319 2575 generic.go:356] "Generic (PLEG): container finished" podID="374da249-1db7-4b1a-9206-5541d98a35bc" containerID="e01c83d1790919089874679c5c9bbb8ce2c5b5c0a35d9eff0bdf9a07b29713ab" exitCode=0 Jul 17 15:11:14.148743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:14.148389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-st868" event={"ID":"374da249-1db7-4b1a-9206-5541d98a35bc","Type":"ContainerDied","Data":"e01c83d1790919089874679c5c9bbb8ce2c5b5c0a35d9eff0bdf9a07b29713ab"} Jul 17 15:11:14.148743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:14.148722 2575 scope.go:117] "RemoveContainer" containerID="e01c83d1790919089874679c5c9bbb8ce2c5b5c0a35d9eff0bdf9a07b29713ab" Jul 17 15:11:15.153742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:15.153702 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-st868" event={"ID":"374da249-1db7-4b1a-9206-5541d98a35bc","Type":"ContainerStarted","Data":"02fdb74df154a5c76a9f666c4773ac90964dbde18a249efe967a78c8bae58692"} Jul 17 15:11:19.169503 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:19.169467 2575 generic.go:356] "Generic (PLEG): container finished" podID="83e41028-8a86-4ac9-b1f6-a17964a63f71" containerID="105523a8639fa38c4ccde6da2953f5f23bb9b533dcd5ac2f673a683130ae30eb" exitCode=0 Jul 17 15:11:19.169961 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:19.169522 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" event={"ID":"83e41028-8a86-4ac9-b1f6-a17964a63f71","Type":"ContainerDied","Data":"105523a8639fa38c4ccde6da2953f5f23bb9b533dcd5ac2f673a683130ae30eb"} Jul 17 15:11:19.169961 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:19.169855 2575 scope.go:117] "RemoveContainer" containerID="105523a8639fa38c4ccde6da2953f5f23bb9b533dcd5ac2f673a683130ae30eb" Jul 17 15:11:20.175562 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:11:20.175528 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pw6t9" event={"ID":"83e41028-8a86-4ac9-b1f6-a17964a63f71","Type":"ContainerStarted","Data":"a64004d6ee06bc16dd579f9970e661f02e6c8c854fc1b91bf8b11f53f0c48a10"} Jul 17 15:12:00.111310 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111224 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111492 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="alertmanager" containerID="cri-o://35dc7fb19ce20a43c15a1127c75dc5d2a31665f720ef41305f229807368e7c09" gracePeriod=120 Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111563 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-metric" containerID="cri-o://80e21c971ee16b3ee45f4df886a6b1b249a069660a108ca1c63cf79572ee2ee8" gracePeriod=120 Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111590 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy" containerID="cri-o://7df94f9185c2bb35d9c37f75ed44dd264196b8bc299d7016e63236ac46095565" gracePeriod=120 Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111613 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="prom-label-proxy" containerID="cri-o://586119afa678e8d62816779a209314c8507e0269d20aec117792403348e54e3a" gracePeriod=120 Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111563 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-web" containerID="cri-o://e5bde6b948c7a3196d0b0afd78b4846ef9e41bdf327437ff5cb7d15d2b756819" gracePeriod=120 Jul 17 15:12:00.111845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.111603 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="config-reloader" containerID="cri-o://a4120aadd34b8a1725dc471b546d5c7e4640396b3bd63c22322269c5e256355d" gracePeriod=120 Jul 17 15:12:00.329776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329742 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="586119afa678e8d62816779a209314c8507e0269d20aec117792403348e54e3a" exitCode=0 Jul 17 15:12:00.329776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329771 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="7df94f9185c2bb35d9c37f75ed44dd264196b8bc299d7016e63236ac46095565" exitCode=0 Jul 17 15:12:00.329776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329778 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="a4120aadd34b8a1725dc471b546d5c7e4640396b3bd63c22322269c5e256355d" exitCode=0 Jul 17 15:12:00.329776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329784 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="35dc7fb19ce20a43c15a1127c75dc5d2a31665f720ef41305f229807368e7c09" exitCode=0 Jul 17 15:12:00.330044 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"586119afa678e8d62816779a209314c8507e0269d20aec117792403348e54e3a"} Jul 17 15:12:00.330044 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"7df94f9185c2bb35d9c37f75ed44dd264196b8bc299d7016e63236ac46095565"} Jul 17 15:12:00.330044 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"a4120aadd34b8a1725dc471b546d5c7e4640396b3bd63c22322269c5e256355d"} Jul 17 15:12:00.330044 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:00.329964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"35dc7fb19ce20a43c15a1127c75dc5d2a31665f720ef41305f229807368e7c09"} Jul 17 15:12:01.338266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.338220 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="80e21c971ee16b3ee45f4df886a6b1b249a069660a108ca1c63cf79572ee2ee8" exitCode=0 Jul 17 15:12:01.338266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.338265 2575 generic.go:356] "Generic (PLEG): container finished" podID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerID="e5bde6b948c7a3196d0b0afd78b4846ef9e41bdf327437ff5cb7d15d2b756819" exitCode=0 Jul 17 15:12:01.338693 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.338264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"80e21c971ee16b3ee45f4df886a6b1b249a069660a108ca1c63cf79572ee2ee8"} Jul 17 15:12:01.338693 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.338350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"e5bde6b948c7a3196d0b0afd78b4846ef9e41bdf327437ff5cb7d15d2b756819"} Jul 17 15:12:01.357616 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.357591 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:01.461285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461183 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461281 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461404 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461471 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461500 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461519 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461543 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpnqp\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461565 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461599 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461630 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461636 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461669 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461698 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.461806 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461805 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets\") pod \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\" (UID: \"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db\") " Jul 17 15:12:01.462143 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.461861 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:12:01.462143 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.462048 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.462143 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.462068 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-metrics-client-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.462314 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.462166 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:12:01.464679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464083 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.464679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464372 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.464679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464537 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.464922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464731 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:12:01.464922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464777 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out" (OuterVolumeSpecName: "config-out") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:12:01.464922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.464808 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp" (OuterVolumeSpecName: "kube-api-access-kpnqp") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "kube-api-access-kpnqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:12:01.466137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.466110 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume" (OuterVolumeSpecName: "config-volume") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.466622 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.466593 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.468314 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.468292 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.474775 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.474751 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config" (OuterVolumeSpecName: "web-config") pod "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" (UID: "aea34c1c-a2f0-4c9c-ba7c-145e71ff00db"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:12:01.562385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562349 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpnqp\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-kube-api-access-kpnqp\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562381 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-cluster-tls-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562392 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562402 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562412 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-out\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562421 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-config-volume\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562429 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-tls-assets\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562436 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-main-tls\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562468 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-web-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562477 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:01.562624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:01.562486 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db-alertmanager-main-db\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:12:02.344870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.344801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aea34c1c-a2f0-4c9c-ba7c-145e71ff00db","Type":"ContainerDied","Data":"06023f5d0f47ef08dee09ea248dd9296b1194fe8d0644aa3e8f51a8ab3d89ff0"} Jul 17 15:12:02.344870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.344835 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.344870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.344877 2575 scope.go:117] "RemoveContainer" containerID="586119afa678e8d62816779a209314c8507e0269d20aec117792403348e54e3a" Jul 17 15:12:02.352427 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.352410 2575 scope.go:117] "RemoveContainer" containerID="80e21c971ee16b3ee45f4df886a6b1b249a069660a108ca1c63cf79572ee2ee8" Jul 17 15:12:02.359091 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.359074 2575 scope.go:117] "RemoveContainer" containerID="7df94f9185c2bb35d9c37f75ed44dd264196b8bc299d7016e63236ac46095565" Jul 17 15:12:02.365441 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.365425 2575 scope.go:117] "RemoveContainer" containerID="e5bde6b948c7a3196d0b0afd78b4846ef9e41bdf327437ff5cb7d15d2b756819" Jul 17 15:12:02.372233 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.372212 2575 scope.go:117] "RemoveContainer" containerID="a4120aadd34b8a1725dc471b546d5c7e4640396b3bd63c22322269c5e256355d" Jul 17 15:12:02.374865 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.374844 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:02.379553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.379533 2575 scope.go:117] "RemoveContainer" containerID="35dc7fb19ce20a43c15a1127c75dc5d2a31665f720ef41305f229807368e7c09" Jul 17 15:12:02.387681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.387648 2575 scope.go:117] "RemoveContainer" containerID="cb011e0bd225caafc7bc68010a5b972e711684c0ffd994dd85a336e0db85204b" Jul 17 15:12:02.391055 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.391029 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:02.449002 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.448930 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" path="/var/lib/kubelet/pods/aea34c1c-a2f0-4c9c-ba7c-145e71ff00db/volumes" Jul 17 15:12:02.493464 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493426 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:02.493704 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493691 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="init-config-reloader" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493706 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="init-config-reloader" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493715 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bacda9a1-a076-4381-96fe-32335d7e340d" containerName="console" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493720 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bacda9a1-a076-4381-96fe-32335d7e340d" containerName="console" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493726 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493733 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493739 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="prom-label-proxy" Jul 17 15:12:02.493743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493745 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="prom-label-proxy" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493754 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afd24b7-727f-4944-98ee-cae2f8bb0849" containerName="registry" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493760 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afd24b7-727f-4944-98ee-cae2f8bb0849" containerName="registry" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493765 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="alertmanager" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493770 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="alertmanager" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493776 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-web" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493781 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-web" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493787 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-metric" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493792 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-metric" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493837 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="config-reloader" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493842 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="config-reloader" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493892 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-web" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493899 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy-metric" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493905 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5afd24b7-727f-4944-98ee-cae2f8bb0849" containerName="registry" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493912 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bacda9a1-a076-4381-96fe-32335d7e340d" containerName="console" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493918 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="config-reloader" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493924 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="kube-rbac-proxy" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493928 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="alertmanager" Jul 17 15:12:02.493939 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.493933 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea34c1c-a2f0-4c9c-ba7c-145e71ff00db" containerName="prom-label-proxy" Jul 17 15:12:02.497681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.497662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.505297 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.505279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 15:12:02.505376 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.505280 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 15:12:02.505810 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.505794 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 15:12:02.505852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.505839 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 15:12:02.505909 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.505843 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 15:12:02.506154 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.506138 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4svzk\"" Jul 17 15:12:02.506220 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.506168 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 15:12:02.506504 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.506489 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 15:12:02.506550 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.506506 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 15:12:02.519085 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.518863 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 15:12:02.523318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.523295 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:02.568917 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.568887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.568917 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.568920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kjts\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-kube-api-access-7kjts\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.568940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.568958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-config-volume\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-web-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569470 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.569470 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.569317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-config-out\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670269 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670269 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670305 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-config-volume\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-web-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-config-out\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.670571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.671060 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kjts\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-kube-api-access-7kjts\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.671060 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.670730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.671558 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.671188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.671558 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.671419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a122c035-214e-482d-8c8b-c0a50ea7f202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673686 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673686 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673686 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673622 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a122c035-214e-482d-8c8b-c0a50ea7f202-config-out\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673686 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-web-config\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-config-volume\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.673938 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.673899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.674147 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.674070 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.675432 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.675412 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a122c035-214e-482d-8c8b-c0a50ea7f202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.685737 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.685715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kjts\" (UniqueName: \"kubernetes.io/projected/a122c035-214e-482d-8c8b-c0a50ea7f202-kube-api-access-7kjts\") pod \"alertmanager-main-0\" (UID: \"a122c035-214e-482d-8c8b-c0a50ea7f202\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.806513 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.806425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 15:12:02.961236 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:02.961202 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 15:12:02.964429 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:12:02.964405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda122c035_214e_482d_8c8b_c0a50ea7f202.slice/crio-4ea8a12af42c8149a0f04f64f4e870ce477a7aedf7abe80e28204b1c960aaad7 WatchSource:0}: Error finding container 4ea8a12af42c8149a0f04f64f4e870ce477a7aedf7abe80e28204b1c960aaad7: Status 404 returned error can't find the container with id 4ea8a12af42c8149a0f04f64f4e870ce477a7aedf7abe80e28204b1c960aaad7 Jul 17 15:12:03.350857 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:03.350819 2575 generic.go:356] "Generic (PLEG): container finished" podID="a122c035-214e-482d-8c8b-c0a50ea7f202" containerID="7ab98e89a1c86acb58c6b6ffe53c21355031883c6c2d1cea5f1bb998d25bcff6" exitCode=0 Jul 17 15:12:03.351272 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:03.350911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerDied","Data":"7ab98e89a1c86acb58c6b6ffe53c21355031883c6c2d1cea5f1bb998d25bcff6"} Jul 17 15:12:03.351272 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:03.350993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"4ea8a12af42c8149a0f04f64f4e870ce477a7aedf7abe80e28204b1c960aaad7"} Jul 17 15:12:04.164312 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.164273 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bb848d65-rzd8w"] Jul 17 15:12:04.166960 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.166941 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.169719 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.169689 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 17 15:12:04.169901 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.169886 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s2qls\"" Jul 17 15:12:04.170474 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.170430 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 17 15:12:04.170577 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.170490 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 17 15:12:04.170653 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.170574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 17 15:12:04.170841 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.170822 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 17 15:12:04.176774 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.176754 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 17 15:12:04.190855 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.190828 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb848d65-rzd8w"] Jul 17 15:12:04.283772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-metrics-client-ca\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjgq\" (UniqueName: \"kubernetes.io/projected/6160547f-4fc1-4423-ae65-b65726ae9e1d-kube-api-access-xrjgq\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-serving-certs-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-federate-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.283999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.283981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.284186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.284009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.365656 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"0709cce9bcac66803109bb09c402633cc62d3ed00301d8f013b55cb28c8cb7b2"} Jul 17 15:12:04.366003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"971964d26f53f0881cde6116e7531519cf6ded47f41469061d89d139339feff7"} Jul 17 15:12:04.366003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"793a78b70c70ef2c36f2f5a7e835f4be319a5b4e9b0b9be12ac0e508b8b12c2c"} Jul 17 15:12:04.366003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"5a22968fca3b58555b2b87a51936230add4e87c4f88177e580fb3e34f5b0bbff"} Jul 17 15:12:04.366003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"b502da50169233ca024b9c0f903e300e4aa6df34a2a6f43448057ad5015e2111"} Jul 17 15:12:04.366003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.365809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a122c035-214e-482d-8c8b-c0a50ea7f202","Type":"ContainerStarted","Data":"95826e2447a85f95ea87951684af790b96782dd68c11cce390ac15966cdb5cfe"} Jul 17 15:12:04.384978 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.384936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.384978 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.384976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-metrics-client-ca\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjgq\" (UniqueName: \"kubernetes.io/projected/6160547f-4fc1-4423-ae65-b65726ae9e1d-kube-api-access-xrjgq\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-serving-certs-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-federate-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.385943 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-metrics-client-ca\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.386107 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.385915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-serving-certs-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.386366 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.386343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.387707 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.387676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.387804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.387768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-federate-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.387937 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.387915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-telemeter-client-tls\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.387993 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.387923 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6160547f-4fc1-4423-ae65-b65726ae9e1d-secret-telemeter-client\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.401937 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.401906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjgq\" (UniqueName: \"kubernetes.io/projected/6160547f-4fc1-4423-ae65-b65726ae9e1d-kube-api-access-xrjgq\") pod \"telemeter-client-7bb848d65-rzd8w\" (UID: \"6160547f-4fc1-4423-ae65-b65726ae9e1d\") " pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.408567 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.408520 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.390322656 podStartE2EDuration="2.408504134s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.181478ms" isStatefulPod=false podCreationTimestamp="2026-07-17 15:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:12:04.406018056 +0000 UTC m=+182.567772380" watchObservedRunningTime="2026-07-17 15:12:04.408504134 +0000 UTC m=+182.570258494" Jul 17 15:12:04.477103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.477018 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" Jul 17 15:12:04.612978 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:04.612946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bb848d65-rzd8w"] Jul 17 15:12:04.616344 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:12:04.616316 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6160547f_4fc1_4423_ae65_b65726ae9e1d.slice/crio-ee71c9d0f8ff910e8dc08eb47f674fe76b7b1c603262bb2b2a2e7760daacd593 WatchSource:0}: Error finding container ee71c9d0f8ff910e8dc08eb47f674fe76b7b1c603262bb2b2a2e7760daacd593: Status 404 returned error can't find the container with id ee71c9d0f8ff910e8dc08eb47f674fe76b7b1c603262bb2b2a2e7760daacd593 Jul 17 15:12:05.370541 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:05.370503 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" event={"ID":"6160547f-4fc1-4423-ae65-b65726ae9e1d","Type":"ContainerStarted","Data":"ee71c9d0f8ff910e8dc08eb47f674fe76b7b1c603262bb2b2a2e7760daacd593"} Jul 17 15:12:07.381574 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:07.381539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" event={"ID":"6160547f-4fc1-4423-ae65-b65726ae9e1d","Type":"ContainerStarted","Data":"0b73991d2434f9f8da6c70d7855323e12e6c5d5877503469b2498e705b5868d6"} Jul 17 15:12:07.381963 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:07.381597 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" event={"ID":"6160547f-4fc1-4423-ae65-b65726ae9e1d","Type":"ContainerStarted","Data":"fb5c18db3f6ba3e0934617be8b513717d93db1d8f55e16186ee4f08df9d6feef"} Jul 17 15:12:07.381963 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:07.381618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" event={"ID":"6160547f-4fc1-4423-ae65-b65726ae9e1d","Type":"ContainerStarted","Data":"dfb4a43a97642b8bc124263bdc9a72cbf0be1abbf67e172acbf36aa73347b562"} Jul 17 15:12:07.410871 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:07.410810 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bb848d65-rzd8w" podStartSLOduration=1.207363567 podStartE2EDuration="3.410786839s" totalImagesPullingTime="2.203423272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:12:07.409894839 +0000 UTC m=+185.571649176" watchObservedRunningTime="2026-07-17 15:12:07.410786839 +0000 UTC m=+185.572541165" Jul 17 15:12:08.143062 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.143027 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:12:08.145578 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.145556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.148304 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.148274 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 15:12:08.148410 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.148345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 15:12:08.148476 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.148424 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 15:12:08.149777 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.149755 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 15:12:08.149931 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.149912 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 15:12:08.149995 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.149917 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z5mff\"" Jul 17 15:12:08.150064 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.150044 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 15:12:08.150064 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.150049 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 15:12:08.154563 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.154543 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 15:12:08.158892 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.158870 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:12:08.219404 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.219602 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.219597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4s8x\" (UniqueName: \"kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320508 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320508 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320707 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320786 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320882 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.320882 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.320858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4s8x\" (UniqueName: \"kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.321411 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.321379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.321570 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.321539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.321624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.321605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.321657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.321639 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.323055 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.323037 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.323106 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.323072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.331156 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.331136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4s8x\" (UniqueName: \"kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x\") pod \"console-7f7b6895db-q265j\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.457136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.457017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:08.591027 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:08.591003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:12:08.593489 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:12:08.593461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e530e7_173f_40c5_90f7_9bd6b5c2cfa3.slice/crio-d0b27fe064a3232a0e0603d7ac7caff93c9ad4b9712d9ef45e374c7b7e606afd WatchSource:0}: Error finding container d0b27fe064a3232a0e0603d7ac7caff93c9ad4b9712d9ef45e374c7b7e606afd: Status 404 returned error can't find the container with id d0b27fe064a3232a0e0603d7ac7caff93c9ad4b9712d9ef45e374c7b7e606afd Jul 17 15:12:09.391027 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:09.390982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7b6895db-q265j" event={"ID":"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3","Type":"ContainerStarted","Data":"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e"} Jul 17 15:12:09.391174 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:09.391036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7b6895db-q265j" event={"ID":"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3","Type":"ContainerStarted","Data":"d0b27fe064a3232a0e0603d7ac7caff93c9ad4b9712d9ef45e374c7b7e606afd"} Jul 17 15:12:09.411598 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:09.411552 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f7b6895db-q265j" podStartSLOduration=1.411536659 podStartE2EDuration="1.411536659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:12:09.410524654 +0000 UTC m=+187.572278979" watchObservedRunningTime="2026-07-17 15:12:09.411536659 +0000 UTC m=+187.573290984" Jul 17 15:12:18.457969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:18.457942 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:18.458355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:18.457985 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:18.462759 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:18.462737 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:12:19.437154 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:12:19.437127 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:13:17.662942 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.662905 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:13:17.666342 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.666321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.680525 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.680497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:13:17.792742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.792980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.792928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fpxw\" (UniqueName: \"kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.893995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fpxw\" (UniqueName: \"kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894278 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894875 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894979 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.894979 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.894959 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.895095 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.895036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.896591 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.896568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.896672 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.896634 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.903755 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.903736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fpxw\" (UniqueName: \"kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw\") pod \"console-66d8455559-2d29b\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:17.976813 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:17.976725 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:18.114669 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:18.114642 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:13:18.653989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:18.653954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8455559-2d29b" event={"ID":"4fc1e516-097a-4e26-b8ad-9ceee236726d","Type":"ContainerStarted","Data":"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16"} Jul 17 15:13:18.654164 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:18.654000 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8455559-2d29b" event={"ID":"4fc1e516-097a-4e26-b8ad-9ceee236726d","Type":"ContainerStarted","Data":"cad2ed2bacd5d23739d55eee4bc119c58e8cfab1b1080938fc394e41675e81b5"} Jul 17 15:13:18.681124 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:18.681075 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66d8455559-2d29b" podStartSLOduration=1.681058223 podStartE2EDuration="1.681058223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:13:18.67981611 +0000 UTC m=+256.841570440" watchObservedRunningTime="2026-07-17 15:13:18.681058223 +0000 UTC m=+256.842812548" Jul 17 15:13:27.977393 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:27.977352 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:27.978003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:27.977413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:27.982275 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:27.982250 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:28.697055 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:28.697031 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:13:28.755129 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:28.755095 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:13:53.778047 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:53.777983 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f7b6895db-q265j" podUID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" containerName="console" containerID="cri-o://45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e" gracePeriod=15 Jul 17 15:13:54.012679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.012651 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:13:54.102712 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102636 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102712 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102674 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102712 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102697 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102724 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4s8x\" (UniqueName: \"kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102768 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102795 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.102980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.102809 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config\") pod \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\" (UID: \"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3\") " Jul 17 15:13:54.103237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.103204 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:13:54.103320 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.103207 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca" (OuterVolumeSpecName: "service-ca") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:13:54.103363 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.103326 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:13:54.103363 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.103317 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config" (OuterVolumeSpecName: "console-config") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:13:54.104747 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.104724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:13:54.104899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.104877 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:13:54.104967 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.104947 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x" (OuterVolumeSpecName: "kube-api-access-x4s8x") pod "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" (UID: "57e530e7-173f-40c5-90f7-9bd6b5c2cfa3"). InnerVolumeSpecName "kube-api-access-x4s8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:13:54.203652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203624 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-trusted-ca-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203649 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-oauth-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203659 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4s8x\" (UniqueName: \"kubernetes.io/projected/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-kube-api-access-x4s8x\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203873 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203673 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-service-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203873 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203686 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-oauth-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203873 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203694 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.203873 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.203702 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3-console-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:13:54.794228 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.794135 2575 generic.go:356] "Generic (PLEG): container finished" podID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" containerID="45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e" exitCode=0 Jul 17 15:13:54.794228 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.794182 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7b6895db-q265j" Jul 17 15:13:54.794228 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.794212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7b6895db-q265j" event={"ID":"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3","Type":"ContainerDied","Data":"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e"} Jul 17 15:13:54.794809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.794264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7b6895db-q265j" event={"ID":"57e530e7-173f-40c5-90f7-9bd6b5c2cfa3","Type":"ContainerDied","Data":"d0b27fe064a3232a0e0603d7ac7caff93c9ad4b9712d9ef45e374c7b7e606afd"} Jul 17 15:13:54.794809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.794285 2575 scope.go:117] "RemoveContainer" containerID="45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e" Jul 17 15:13:54.802708 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.802688 2575 scope.go:117] "RemoveContainer" containerID="45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e" Jul 17 15:13:54.802986 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:13:54.802969 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e\": container with ID starting with 45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e not found: ID does not exist" containerID="45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e" Jul 17 15:13:54.803065 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.802994 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e"} err="failed to get container status \"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e\": rpc error: code = NotFound desc = could not find container \"45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e\": container with ID starting with 45bd4af58be44e8c4ddf6dc817d528c98db7f168a126a00ee6ee7da056cc674e not found: ID does not exist" Jul 17 15:13:54.814306 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.814285 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:13:54.820765 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:54.820742 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f7b6895db-q265j"] Jul 17 15:13:56.449288 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:13:56.449253 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" path="/var/lib/kubelet/pods/57e530e7-173f-40c5-90f7-9bd6b5c2cfa3/volumes" Jul 17 15:14:02.286061 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:02.286016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:14:02.290519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:02.290492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:14:02.295856 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:02.295833 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 15:14:14.372035 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.371975 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j"] Jul 17 15:14:14.373923 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.372404 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" containerName="console" Jul 17 15:14:14.373923 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.372421 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" containerName="console" Jul 17 15:14:14.373923 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.372497 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e530e7-173f-40c5-90f7-9bd6b5c2cfa3" containerName="console" Jul 17 15:14:14.375051 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.375036 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.379476 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.379437 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 15:14:14.379587 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.379553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szmbn\"" Jul 17 15:14:14.381292 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.381268 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 15:14:14.387722 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.387692 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j"] Jul 17 15:14:14.464260 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.464228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.464424 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.464267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85lmv\" (UniqueName: \"kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.464424 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.464295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.565639 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.565606 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.565784 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.565648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85lmv\" (UniqueName: \"kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.565784 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.565748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.566074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.566053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.566111 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.566065 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.575517 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.575483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85lmv\" (UniqueName: \"kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.684252 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.684220 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:14:14.812397 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.812365 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j"] Jul 17 15:14:14.815337 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:14:14.815308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c986b6f_ca32_4b68_a32f_ca44d9dd885c.slice/crio-5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf WatchSource:0}: Error finding container 5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf: Status 404 returned error can't find the container with id 5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf Jul 17 15:14:14.817597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.817582 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:14:14.876887 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:14.876850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerStarted","Data":"5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf"} Jul 17 15:14:25.039412 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:14:25.039367 2575 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8" Jul 17 15:14:25.039850 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:14:25.039500 2575 kuberuntime_manager.go:1459] "Unhandled Error" err="init container util start failed in pod 685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j_openshift-marketplace(0c986b6f-ca32-4b68-a32f-ca44d9dd885c): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 17 15:14:25.039850 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:14:25.039532 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"util\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" Jul 17 15:14:25.919726 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:14:25.919695 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"util\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05a68aa4b2f0449784d9c6fe3254f907b1a71e1df2b16633ec24d3130e39ddc8: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" Jul 17 15:14:47.002119 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:47.002075 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerStarted","Data":"bea63f4024fc176805261ae526ad0a59f40f63387fd8c1e9cc023ffdaaa26186"} Jul 17 15:14:48.010119 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:48.010086 2575 generic.go:356] "Generic (PLEG): container finished" podID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerID="bea63f4024fc176805261ae526ad0a59f40f63387fd8c1e9cc023ffdaaa26186" exitCode=0 Jul 17 15:14:48.010520 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:48.010125 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerDied","Data":"bea63f4024fc176805261ae526ad0a59f40f63387fd8c1e9cc023ffdaaa26186"} Jul 17 15:14:51.024302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:51.024267 2575 generic.go:356] "Generic (PLEG): container finished" podID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerID="9815c5346f2ced359d176daa1f78b5df2d3c1c890221ec1cb9fb7071dbdd03c0" exitCode=0 Jul 17 15:14:51.024697 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:51.024339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerDied","Data":"9815c5346f2ced359d176daa1f78b5df2d3c1c890221ec1cb9fb7071dbdd03c0"} Jul 17 15:14:59.061429 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:59.061402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerStarted","Data":"5dd09e77113b26c6d7cc996253fdc9c52dba42532f9747f62cb6d1698f217757"} Jul 17 15:14:59.080514 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:14:59.080469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" podStartSLOduration=0.903807187 podStartE2EDuration="45.080432058s" totalImagesPullingTime="44.176624871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:14:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 15:14:59.079902218 +0000 UTC m=+357.241656543" watchObservedRunningTime="2026-07-17 15:14:59.080432058 +0000 UTC m=+357.242186383" Jul 17 15:15:00.068130 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:00.068098 2575 generic.go:356] "Generic (PLEG): container finished" podID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerID="5dd09e77113b26c6d7cc996253fdc9c52dba42532f9747f62cb6d1698f217757" exitCode=0 Jul 17 15:15:00.068611 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:00.068161 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerDied","Data":"5dd09e77113b26c6d7cc996253fdc9c52dba42532f9747f62cb6d1698f217757"} Jul 17 15:15:01.206149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.206123 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:15:01.343391 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.343307 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85lmv\" (UniqueName: \"kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv\") pod \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " Jul 17 15:15:01.343391 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.343363 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util\") pod \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " Jul 17 15:15:01.343391 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.343380 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle\") pod \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\" (UID: \"0c986b6f-ca32-4b68-a32f-ca44d9dd885c\") " Jul 17 15:15:01.344030 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.344004 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle" (OuterVolumeSpecName: "bundle") pod "0c986b6f-ca32-4b68-a32f-ca44d9dd885c" (UID: "0c986b6f-ca32-4b68-a32f-ca44d9dd885c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:01.345518 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.345492 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv" (OuterVolumeSpecName: "kube-api-access-85lmv") pod "0c986b6f-ca32-4b68-a32f-ca44d9dd885c" (UID: "0c986b6f-ca32-4b68-a32f-ca44d9dd885c"). InnerVolumeSpecName "kube-api-access-85lmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:15:01.348272 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.348249 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util" (OuterVolumeSpecName: "util") pod "0c986b6f-ca32-4b68-a32f-ca44d9dd885c" (UID: "0c986b6f-ca32-4b68-a32f-ca44d9dd885c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:01.444166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.444131 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:01.444166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.444158 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:01.444166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:01.444167 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85lmv\" (UniqueName: \"kubernetes.io/projected/0c986b6f-ca32-4b68-a32f-ca44d9dd885c-kube-api-access-85lmv\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:02.077991 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:02.077963 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" Jul 17 15:15:02.078171 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:02.077994 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xlw5j" event={"ID":"0c986b6f-ca32-4b68-a32f-ca44d9dd885c","Type":"ContainerDied","Data":"5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf"} Jul 17 15:15:02.078171 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:02.078038 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5602fe4fc75ae9e83047a58d157ab2c7b3bad759609dcf6585b002b769c55aaf" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848100 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz"] Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848757 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="util" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848776 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="util" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848808 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="pull" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848817 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="pull" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848838 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="extract" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.848849 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="extract" Jul 17 15:15:07.850415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.849002 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c986b6f-ca32-4b68-a32f-ca44d9dd885c" containerName="extract" Jul 17 15:15:07.852137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.852115 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:07.855366 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.855340 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pbxpt\"" Jul 17 15:15:07.855500 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.855417 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:15:07.855500 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.855483 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 17 15:15:07.933721 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.933690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz"] Jul 17 15:15:07.998889 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.998863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kmd\" (UniqueName: \"kubernetes.io/projected/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-kube-api-access-87kmd\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:07.999033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:07.998895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.099594 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.099563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kmd\" (UniqueName: \"kubernetes.io/projected/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-kube-api-access-87kmd\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.099782 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.099601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.099954 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.099938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.110782 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.110721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kmd\" (UniqueName: \"kubernetes.io/projected/ccf20dfe-1082-4815-9f94-6cdfce3b81a4-kube-api-access-87kmd\") pod \"cert-manager-operator-controller-manager-55c444bf86-np6sz\" (UID: \"ccf20dfe-1082-4815-9f94-6cdfce3b81a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.161414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.161389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" Jul 17 15:15:08.304065 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:08.304038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz"] Jul 17 15:15:08.306908 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:08.306881 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf20dfe_1082_4815_9f94_6cdfce3b81a4.slice/crio-b1f14013cdbf9d834707056bee1c28a6307fbbde0c73362eb09a372f79ca4a81 WatchSource:0}: Error finding container b1f14013cdbf9d834707056bee1c28a6307fbbde0c73362eb09a372f79ca4a81: Status 404 returned error can't find the container with id b1f14013cdbf9d834707056bee1c28a6307fbbde0c73362eb09a372f79ca4a81 Jul 17 15:15:09.105760 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:09.105723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" event={"ID":"ccf20dfe-1082-4815-9f94-6cdfce3b81a4","Type":"ContainerStarted","Data":"b1f14013cdbf9d834707056bee1c28a6307fbbde0c73362eb09a372f79ca4a81"} Jul 17 15:15:10.963936 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.963903 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fz9tz"] Jul 17 15:15:10.966455 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.966425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:10.970652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.970631 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 15:15:10.970783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.970655 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 15:15:10.970783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.970728 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lxs5t\"" Jul 17 15:15:10.977061 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:10.977040 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fz9tz"] Jul 17 15:15:11.115956 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.115918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" event={"ID":"ccf20dfe-1082-4815-9f94-6cdfce3b81a4","Type":"ContainerStarted","Data":"d0ccff18c403c45df4f4a2613d7a779eaf1b800c6dc239b9b92a180b970b7b5b"} Jul 17 15:15:11.128259 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.128229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.128403 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.128291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhv6b\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-kube-api-access-qhv6b\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.143258 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.143211 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-np6sz" podStartSLOduration=2.366478244 podStartE2EDuration="4.143198939s" totalImagesPullingTime="1.776720695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:11.142040887 +0000 UTC m=+369.303795241" watchObservedRunningTime="2026-07-17 15:15:11.143198939 +0000 UTC m=+369.304953263" Jul 17 15:15:11.229584 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.229510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhv6b\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-kube-api-access-qhv6b\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.229710 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.229598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.239441 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.239410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.239664 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.239644 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhv6b\" (UniqueName: \"kubernetes.io/projected/bb4ce37b-6183-480b-9c86-457cc90ce08b-kube-api-access-qhv6b\") pod \"cert-manager-webhook-6486ffd997-fz9tz\" (UID: \"bb4ce37b-6183-480b-9c86-457cc90ce08b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.290431 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.290404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:11.421778 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.421734 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fz9tz"] Jul 17 15:15:11.424240 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:11.424214 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb4ce37b_6183_480b_9c86_457cc90ce08b.slice/crio-c8b8c6c78abd292e1e5f4cc9684f76edc6ff0dcf5f18be20dadcd54ba0595bda WatchSource:0}: Error finding container c8b8c6c78abd292e1e5f4cc9684f76edc6ff0dcf5f18be20dadcd54ba0595bda: Status 404 returned error can't find the container with id c8b8c6c78abd292e1e5f4cc9684f76edc6ff0dcf5f18be20dadcd54ba0595bda Jul 17 15:15:11.884154 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.884118 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56"] Jul 17 15:15:11.887574 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.887546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:11.890328 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.890304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 15:15:11.890499 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.890306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 15:15:11.891475 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.891437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szmbn\"" Jul 17 15:15:11.900036 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:11.900016 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56"] Jul 17 15:15:12.035998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.035965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.036350 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.036019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.036350 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.036060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4hf\" (UniqueName: \"kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.127268 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.127228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" event={"ID":"bb4ce37b-6183-480b-9c86-457cc90ce08b","Type":"ContainerStarted","Data":"c8b8c6c78abd292e1e5f4cc9684f76edc6ff0dcf5f18be20dadcd54ba0595bda"} Jul 17 15:15:12.136650 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.136571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4hf\" (UniqueName: \"kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.136769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.136675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.136769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.136736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.137059 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.137032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.137174 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.137071 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.146468 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.146427 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4hf\" (UniqueName: \"kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.196597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.196562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:12.354804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:12.354770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56"] Jul 17 15:15:12.356886 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:12.356854 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b8f068_912b_4e88_96a8_63997b3e6116.slice/crio-400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963 WatchSource:0}: Error finding container 400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963: Status 404 returned error can't find the container with id 400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963 Jul 17 15:15:13.133384 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.133351 2575 generic.go:356] "Generic (PLEG): container finished" podID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerID="3753fb86f3b87fcc2eb0eb55beeed89f71309f45e1d4a6cac93d9428706cc78a" exitCode=0 Jul 17 15:15:13.133862 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.133460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" event={"ID":"e6b8f068-912b-4e88-96a8-63997b3e6116","Type":"ContainerDied","Data":"3753fb86f3b87fcc2eb0eb55beeed89f71309f45e1d4a6cac93d9428706cc78a"} Jul 17 15:15:13.133862 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.133511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" event={"ID":"e6b8f068-912b-4e88-96a8-63997b3e6116","Type":"ContainerStarted","Data":"400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963"} Jul 17 15:15:13.402707 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.402677 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sxv94"] Jul 17 15:15:13.405224 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.405203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.407949 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.407920 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mp528\"" Jul 17 15:15:13.421068 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.421045 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sxv94"] Jul 17 15:15:13.548675 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.548644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.548871 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.548702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84t2d\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-kube-api-access-84t2d\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.649552 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.649516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.649720 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.649567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84t2d\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-kube-api-access-84t2d\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.660834 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.660769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.661352 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.661334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84t2d\" (UniqueName: \"kubernetes.io/projected/3559dd69-9daf-443c-86c1-08aa4c92228e-kube-api-access-84t2d\") pod \"cert-manager-cainjector-559cdd8c87-sxv94\" (UID: \"3559dd69-9daf-443c-86c1-08aa4c92228e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:13.716565 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:13.716526 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" Jul 17 15:15:14.129093 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:14.129069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sxv94"] Jul 17 15:15:14.130573 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:14.130545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3559dd69_9daf_443c_86c1_08aa4c92228e.slice/crio-319995719d5db5297ab0214f80b81e642b1d6da06c36083fb5de3e79044aa50c WatchSource:0}: Error finding container 319995719d5db5297ab0214f80b81e642b1d6da06c36083fb5de3e79044aa50c: Status 404 returned error can't find the container with id 319995719d5db5297ab0214f80b81e642b1d6da06c36083fb5de3e79044aa50c Jul 17 15:15:14.138620 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:14.138557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" event={"ID":"3559dd69-9daf-443c-86c1-08aa4c92228e","Type":"ContainerStarted","Data":"319995719d5db5297ab0214f80b81e642b1d6da06c36083fb5de3e79044aa50c"} Jul 17 15:15:14.140687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:14.140649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" event={"ID":"bb4ce37b-6183-480b-9c86-457cc90ce08b","Type":"ContainerStarted","Data":"9c4d56cf30de8f08b74fc548e96e830dfb2b8f36947913c75929db8b25829341"} Jul 17 15:15:14.140809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:14.140780 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:14.169503 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:14.169431 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" podStartSLOduration=1.556816357 podStartE2EDuration="4.169411467s" totalImagesPullingTime="2.61259511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:14.168868586 +0000 UTC m=+372.330622942" watchObservedRunningTime="2026-07-17 15:15:14.169411467 +0000 UTC m=+372.331165794" Jul 17 15:15:15.148103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:15.148065 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" event={"ID":"3559dd69-9daf-443c-86c1-08aa4c92228e","Type":"ContainerStarted","Data":"24f6d647701df873118287e98e14e0647459a5726f1c3e5e487e7ac6c23bd53d"} Jul 17 15:15:15.169199 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:15.169152 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sxv94" podStartSLOduration=2.169133461 podStartE2EDuration="2.169133461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:15.168004119 +0000 UTC m=+373.329758447" watchObservedRunningTime="2026-07-17 15:15:15.169133461 +0000 UTC m=+373.330887786" Jul 17 15:15:16.154203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:16.154172 2575 generic.go:356] "Generic (PLEG): container finished" podID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerID="f7993dd0226188655a253e9fe0b00d50840dca83de9ab6a688f8124636990b9b" exitCode=0 Jul 17 15:15:16.154612 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:16.154307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" event={"ID":"e6b8f068-912b-4e88-96a8-63997b3e6116","Type":"ContainerDied","Data":"f7993dd0226188655a253e9fe0b00d50840dca83de9ab6a688f8124636990b9b"} Jul 17 15:15:17.161125 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:17.161083 2575 generic.go:356] "Generic (PLEG): container finished" podID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerID="86bd6908a06c67802ec8c0b2c6f360cbe5ad5eb39ea93635ca570f3ef785b6d2" exitCode=0 Jul 17 15:15:17.161125 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:17.161124 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" event={"ID":"e6b8f068-912b-4e88-96a8-63997b3e6116","Type":"ContainerDied","Data":"86bd6908a06c67802ec8c0b2c6f360cbe5ad5eb39ea93635ca570f3ef785b6d2"} Jul 17 15:15:18.299166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.299140 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:18.389098 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.389062 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df4hf\" (UniqueName: \"kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf\") pod \"e6b8f068-912b-4e88-96a8-63997b3e6116\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " Jul 17 15:15:18.389300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.389118 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle\") pod \"e6b8f068-912b-4e88-96a8-63997b3e6116\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " Jul 17 15:15:18.389300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.389178 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util\") pod \"e6b8f068-912b-4e88-96a8-63997b3e6116\" (UID: \"e6b8f068-912b-4e88-96a8-63997b3e6116\") " Jul 17 15:15:18.389625 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.389586 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle" (OuterVolumeSpecName: "bundle") pod "e6b8f068-912b-4e88-96a8-63997b3e6116" (UID: "e6b8f068-912b-4e88-96a8-63997b3e6116"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:18.391154 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.391129 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf" (OuterVolumeSpecName: "kube-api-access-df4hf") pod "e6b8f068-912b-4e88-96a8-63997b3e6116" (UID: "e6b8f068-912b-4e88-96a8-63997b3e6116"). InnerVolumeSpecName "kube-api-access-df4hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:15:18.394759 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.394730 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util" (OuterVolumeSpecName: "util") pod "e6b8f068-912b-4e88-96a8-63997b3e6116" (UID: "e6b8f068-912b-4e88-96a8-63997b3e6116"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:18.489870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.489834 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df4hf\" (UniqueName: \"kubernetes.io/projected/e6b8f068-912b-4e88-96a8-63997b3e6116-kube-api-access-df4hf\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:18.490033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.489889 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:18.490033 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:18.489898 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6b8f068-912b-4e88-96a8-63997b3e6116-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:19.171879 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:19.171848 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" Jul 17 15:15:19.171879 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:19.171869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmlm56" event={"ID":"e6b8f068-912b-4e88-96a8-63997b3e6116","Type":"ContainerDied","Data":"400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963"} Jul 17 15:15:19.172074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:19.171911 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="400c981b0288a078cb8ce4bd330f5eeebc65415099f16cc3f21a06a93e978963" Jul 17 15:15:20.150565 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:20.150533 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fz9tz" Jul 17 15:15:31.576214 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576178 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn"] Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576512 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="extract" Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576524 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="extract" Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576534 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="util" Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576541 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="util" Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576548 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="pull" Jul 17 15:15:31.576608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576554 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="pull" Jul 17 15:15:31.576791 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.576622 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6b8f068-912b-4e88-96a8-63997b3e6116" containerName="extract" Jul 17 15:15:31.595651 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.595621 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn"] Jul 17 15:15:31.595801 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.595736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.598556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.598526 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 15:15:31.598678 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.598565 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 15:15:31.598678 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.598579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szmbn\"" Jul 17 15:15:31.695922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.695891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.695922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.695922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8d9f\" (UniqueName: \"kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.696126 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.695993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.797385 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.797350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.797560 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.797392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8d9f\" (UniqueName: \"kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.797560 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.797497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.797736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.797719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.797814 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.797799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.806819 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.806792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8d9f\" (UniqueName: \"kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:31.906798 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:31.906768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:32.057457 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:32.057419 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn"] Jul 17 15:15:32.059479 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:32.059428 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783b3927_e29e_42e8_a0d5_d9285e0b38df.slice/crio-98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b WatchSource:0}: Error finding container 98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b: Status 404 returned error can't find the container with id 98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b Jul 17 15:15:32.232393 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:32.232365 2575 generic.go:356] "Generic (PLEG): container finished" podID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerID="27f734c239ff44f813c7908bb0385755167aba8eeb399607e499be877f641cd4" exitCode=0 Jul 17 15:15:32.232554 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:32.232410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" event={"ID":"783b3927-e29e-42e8-a0d5-d9285e0b38df","Type":"ContainerDied","Data":"27f734c239ff44f813c7908bb0385755167aba8eeb399607e499be877f641cd4"} Jul 17 15:15:32.232554 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:32.232477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" event={"ID":"783b3927-e29e-42e8-a0d5-d9285e0b38df","Type":"ContainerStarted","Data":"98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b"} Jul 17 15:15:34.242870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:34.242834 2575 generic.go:356] "Generic (PLEG): container finished" podID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerID="9d32a1acdd12874e29074692bbc79eead44365ded9a6ac5708c805bf326356d1" exitCode=0 Jul 17 15:15:34.243414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:34.242894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" event={"ID":"783b3927-e29e-42e8-a0d5-d9285e0b38df","Type":"ContainerDied","Data":"9d32a1acdd12874e29074692bbc79eead44365ded9a6ac5708c805bf326356d1"} Jul 17 15:15:35.249561 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:35.249530 2575 generic.go:356] "Generic (PLEG): container finished" podID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerID="2eb8ddf1e180bfaab2649d59f07a4d8e1e42b10b8d51d6dfffb80fe875399024" exitCode=0 Jul 17 15:15:35.249994 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:35.249569 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" event={"ID":"783b3927-e29e-42e8-a0d5-d9285e0b38df","Type":"ContainerDied","Data":"2eb8ddf1e180bfaab2649d59f07a4d8e1e42b10b8d51d6dfffb80fe875399024"} Jul 17 15:15:36.379359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.379335 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:36.435196 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.435157 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util\") pod \"783b3927-e29e-42e8-a0d5-d9285e0b38df\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " Jul 17 15:15:36.435364 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.435210 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle\") pod \"783b3927-e29e-42e8-a0d5-d9285e0b38df\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " Jul 17 15:15:36.435364 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.435243 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8d9f\" (UniqueName: \"kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f\") pod \"783b3927-e29e-42e8-a0d5-d9285e0b38df\" (UID: \"783b3927-e29e-42e8-a0d5-d9285e0b38df\") " Jul 17 15:15:36.436083 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.436059 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle" (OuterVolumeSpecName: "bundle") pod "783b3927-e29e-42e8-a0d5-d9285e0b38df" (UID: "783b3927-e29e-42e8-a0d5-d9285e0b38df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:36.437327 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.437292 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f" (OuterVolumeSpecName: "kube-api-access-k8d9f") pod "783b3927-e29e-42e8-a0d5-d9285e0b38df" (UID: "783b3927-e29e-42e8-a0d5-d9285e0b38df"). InnerVolumeSpecName "kube-api-access-k8d9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:15:36.441343 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.441322 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util" (OuterVolumeSpecName: "util") pod "783b3927-e29e-42e8-a0d5-d9285e0b38df" (UID: "783b3927-e29e-42e8-a0d5-d9285e0b38df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:15:36.536295 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.536202 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:36.536295 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.536232 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/783b3927-e29e-42e8-a0d5-d9285e0b38df-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:36.536295 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:36.536246 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8d9f\" (UniqueName: \"kubernetes.io/projected/783b3927-e29e-42e8-a0d5-d9285e0b38df-kube-api-access-k8d9f\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:15:37.260825 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:37.260797 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" Jul 17 15:15:37.260989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:37.260824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvv4mn" event={"ID":"783b3927-e29e-42e8-a0d5-d9285e0b38df","Type":"ContainerDied","Data":"98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b"} Jul 17 15:15:37.260989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:37.260895 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98848af56f343d7a67716307ab8e19fd7a61da7a8f65c6c81ce4b78de86ab77b" Jul 17 15:15:44.585205 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585169 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd"] Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585510 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="util" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585523 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="util" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585540 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="extract" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585546 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="extract" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585554 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="pull" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585560 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="pull" Jul 17 15:15:44.585885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.585620 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="783b3927-e29e-42e8-a0d5-d9285e0b38df" containerName="extract" Jul 17 15:15:44.622311 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.622278 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd"] Jul 17 15:15:44.622437 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.622375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.625298 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.625274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 15:15:44.625414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.625275 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 15:15:44.625414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.625368 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzq56\"" Jul 17 15:15:44.626117 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.626096 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 15:15:44.626740 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.626720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 15:15:44.708688 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.708659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.708837 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.708693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.708837 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.708723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.708837 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.708772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9d6f\" (UniqueName: \"kubernetes.io/projected/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-kube-api-access-w9d6f\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.708951 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.708854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.809906 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.809873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.809906 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.809909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9d6f\" (UniqueName: \"kubernetes.io/projected/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-kube-api-access-w9d6f\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.810102 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.809957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.810102 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.810021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.810102 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.810052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.810414 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.810394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.812356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.812318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.812499 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.812480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.812568 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.812483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.824553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.824531 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9d6f\" (UniqueName: \"kubernetes.io/projected/57f3f8d2-7f38-49ff-91fc-8fc7e235f991-kube-api-access-w9d6f\") pod \"opendatahub-operator-controller-manager-6fb95c7566-8mrkd\" (UID: \"57f3f8d2-7f38-49ff-91fc-8fc7e235f991\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:44.932695 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:44.932668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:45.090149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:45.090122 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd"] Jul 17 15:15:45.092038 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:15:45.092004 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f3f8d2_7f38_49ff_91fc_8fc7e235f991.slice/crio-462a4445b9200aee9c063d9367440b510db77150a823fe1131f106ac0e6f8364 WatchSource:0}: Error finding container 462a4445b9200aee9c063d9367440b510db77150a823fe1131f106ac0e6f8364: Status 404 returned error can't find the container with id 462a4445b9200aee9c063d9367440b510db77150a823fe1131f106ac0e6f8364 Jul 17 15:15:45.299480 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:45.299381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" event={"ID":"57f3f8d2-7f38-49ff-91fc-8fc7e235f991","Type":"ContainerStarted","Data":"462a4445b9200aee9c063d9367440b510db77150a823fe1131f106ac0e6f8364"} Jul 17 15:15:48.317497 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:48.317394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" event={"ID":"57f3f8d2-7f38-49ff-91fc-8fc7e235f991","Type":"ContainerStarted","Data":"b4c578b5e77f319a9919f3a85f4c50bf3a5996b3ee3d86ab22970f1177e6b8b4"} Jul 17 15:15:49.323136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:49.323047 2575 generic.go:356] "Generic (PLEG): container finished" podID="57f3f8d2-7f38-49ff-91fc-8fc7e235f991" containerID="b4c578b5e77f319a9919f3a85f4c50bf3a5996b3ee3d86ab22970f1177e6b8b4" exitCode=0 Jul 17 15:15:49.323535 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:49.323134 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" event={"ID":"57f3f8d2-7f38-49ff-91fc-8fc7e235f991","Type":"ContainerDied","Data":"b4c578b5e77f319a9919f3a85f4c50bf3a5996b3ee3d86ab22970f1177e6b8b4"} Jul 17 15:15:50.329532 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:50.329496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" event={"ID":"57f3f8d2-7f38-49ff-91fc-8fc7e235f991","Type":"ContainerStarted","Data":"07f130e234bdc7f5ca196b6dc78afa483aa2eae56e86b8566774eaa564d6409c"} Jul 17 15:15:50.329927 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:50.329622 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:15:50.355795 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:15:50.355746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" podStartSLOduration=2.070941376 podStartE2EDuration="6.355730882s" totalImagesPullingTime="3.279359095s" totalInitContainerRuntime="1.005430411s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:50.352975431 +0000 UTC m=+408.514729756" watchObservedRunningTime="2026-07-17 15:15:50.355730882 +0000 UTC m=+408.517485207" Jul 17 15:16:01.336751 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:01.336713 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-8mrkd" Jul 17 15:16:02.412554 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.412521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx"] Jul 17 15:16:02.417327 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.417307 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.421426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421402 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 15:16:02.421426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421402 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 15:16:02.421652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421516 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x8knc\"" Jul 17 15:16:02.421652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421540 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 15:16:02.421652 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421612 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 15:16:02.421855 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.421830 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 15:16:02.428855 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.428836 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx"] Jul 17 15:16:02.571812 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.571769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.572001 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.571927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed8f9686-1f2e-4c87-9f3d-0038bd317599-manager-config\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.572001 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.571989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-metrics-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.572104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.572021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlt5p\" (UniqueName: \"kubernetes.io/projected/ed8f9686-1f2e-4c87-9f3d-0038bd317599-kube-api-access-tlt5p\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.672925 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.672805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed8f9686-1f2e-4c87-9f3d-0038bd317599-manager-config\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.672925 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.672887 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-metrics-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.672925 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.672911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlt5p\" (UniqueName: \"kubernetes.io/projected/ed8f9686-1f2e-4c87-9f3d-0038bd317599-kube-api-access-tlt5p\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.673233 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.672943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.673500 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.673472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed8f9686-1f2e-4c87-9f3d-0038bd317599-manager-config\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.675441 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.675421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.675523 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.675472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed8f9686-1f2e-4c87-9f3d-0038bd317599-metrics-cert\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.683065 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.683038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlt5p\" (UniqueName: \"kubernetes.io/projected/ed8f9686-1f2e-4c87-9f3d-0038bd317599-kube-api-access-tlt5p\") pod \"lws-controller-manager-76c68485bc-4grdx\" (UID: \"ed8f9686-1f2e-4c87-9f3d-0038bd317599\") " pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.726155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.726117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:02.857135 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:02.856964 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx"] Jul 17 15:16:02.859836 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:16:02.859812 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8f9686_1f2e_4c87_9f3d_0038bd317599.slice/crio-ceececd3c148ccb8d08daa0d505efaec3d279f045c42d9375bb5f0fc52fb6bea WatchSource:0}: Error finding container ceececd3c148ccb8d08daa0d505efaec3d279f045c42d9375bb5f0fc52fb6bea: Status 404 returned error can't find the container with id ceececd3c148ccb8d08daa0d505efaec3d279f045c42d9375bb5f0fc52fb6bea Jul 17 15:16:03.391239 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:03.391200 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" event={"ID":"ed8f9686-1f2e-4c87-9f3d-0038bd317599","Type":"ContainerStarted","Data":"ceececd3c148ccb8d08daa0d505efaec3d279f045c42d9375bb5f0fc52fb6bea"} Jul 17 15:16:05.402990 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:05.402949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" event={"ID":"ed8f9686-1f2e-4c87-9f3d-0038bd317599","Type":"ContainerStarted","Data":"04447fa8f8bdac5a5de8132b38a7a192c3839b68709d53ac7cd8c7e7ea204a33"} Jul 17 15:16:05.403476 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:05.403018 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:05.430989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:05.430928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" podStartSLOduration=1.7153174199999999 podStartE2EDuration="3.430912526s" totalImagesPullingTime="1.715595106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:05.429834092 +0000 UTC m=+423.591588428" watchObservedRunningTime="2026-07-17 15:16:05.430912526 +0000 UTC m=+423.592666851" Jul 17 15:16:16.409666 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:16.409635 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76c68485bc-4grdx" Jul 17 15:16:22.743844 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.743811 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6"] Jul 17 15:16:22.750770 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.750751 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.753500 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.753418 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 15:16:22.753611 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.753542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xcp8v\"" Jul 17 15:16:22.759657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.759628 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6"] Jul 17 15:16:22.846804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e980db-2905-4e71-94e4-285d091c34c9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.846804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e980db-2905-4e71-94e4-285d091c34c9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldrj\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-kube-api-access-4ldrj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.846991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847023 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.847010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.847260 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.847055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947669 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e980db-2905-4e71-94e4-285d091c34c9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947669 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947874 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e980db-2905-4e71-94e4-285d091c34c9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947874 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldrj\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-kube-api-access-4ldrj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947943 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.947943 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948017 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.947991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948063 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948292 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948434 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948321 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948434 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948414 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.948614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.948550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e980db-2905-4e71-94e4-285d091c34c9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.950259 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.950240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e980db-2905-4e71-94e4-285d091c34c9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.950366 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.950268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e980db-2905-4e71-94e4-285d091c34c9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.957214 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.957185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:22.957886 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:22.957857 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldrj\" (UniqueName: \"kubernetes.io/projected/13e980db-2905-4e71-94e4-285d091c34c9-kube-api-access-4ldrj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cbkv6\" (UID: \"13e980db-2905-4e71-94e4-285d091c34c9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:23.061543 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:23.061438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:23.195230 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:23.195208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6"] Jul 17 15:16:23.197102 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:16:23.197074 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e980db_2905_4e71_94e4_285d091c34c9.slice/crio-ee4c15dbdb1428b5de3becac390ac42578385b50e24381e5a3bef2fb1a11a5ce WatchSource:0}: Error finding container ee4c15dbdb1428b5de3becac390ac42578385b50e24381e5a3bef2fb1a11a5ce: Status 404 returned error can't find the container with id ee4c15dbdb1428b5de3becac390ac42578385b50e24381e5a3bef2fb1a11a5ce Jul 17 15:16:23.484463 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:23.484408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" event={"ID":"13e980db-2905-4e71-94e4-285d091c34c9","Type":"ContainerStarted","Data":"ee4c15dbdb1428b5de3becac390ac42578385b50e24381e5a3bef2fb1a11a5ce"} Jul 17 15:16:25.687501 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:25.687440 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:16:25.687778 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:25.687537 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:16:25.687778 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:25.687567 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:16:26.500660 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:26.500620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" event={"ID":"13e980db-2905-4e71-94e4-285d091c34c9","Type":"ContainerStarted","Data":"84280fa81024f4a2a77a31df79d2858b07c8d2cb3195810509aea85042e723c0"} Jul 17 15:16:26.522510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:26.522462 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" podStartSLOduration=2.034361919 podStartE2EDuration="4.522431153s" totalImagesPullingTime="2.488069234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:26.521762545 +0000 UTC m=+444.683516869" watchObservedRunningTime="2026-07-17 15:16:26.522431153 +0000 UTC m=+444.684185478" Jul 17 15:16:27.062513 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:27.062479 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:27.066982 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:27.066955 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:27.505528 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:27.505496 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:16:27.506381 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:16:27.506360 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cbkv6" Jul 17 15:17:05.598818 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.598778 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:05.606653 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.606624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:05.609410 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.609384 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 15:17:05.609410 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.609403 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 15:17:05.609837 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.609820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vwc6z\"" Jul 17 15:17:05.610979 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.610955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:05.618694 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.618671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c\") pod \"kuadrant-operator-catalog-4lkgk\" (UID: \"0420fdd3-fe32-4675-b30d-daafd3c9dc7c\") " pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:05.719662 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.719632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c\") pod \"kuadrant-operator-catalog-4lkgk\" (UID: \"0420fdd3-fe32-4675-b30d-daafd3c9dc7c\") " pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:05.736293 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.736266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c\") pod \"kuadrant-operator-catalog-4lkgk\" (UID: \"0420fdd3-fe32-4675-b30d-daafd3c9dc7c\") " pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:05.918187 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.918141 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:05.959412 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:05.959373 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:06.055148 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.055124 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:06.057223 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:06.057186 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0420fdd3_fe32_4675_b30d_daafd3c9dc7c.slice/crio-f63f6a69167371c536826e118c6e82d9c5b26f1e054fef04747c219c7bdffed0 WatchSource:0}: Error finding container f63f6a69167371c536826e118c6e82d9c5b26f1e054fef04747c219c7bdffed0: Status 404 returned error can't find the container with id f63f6a69167371c536826e118c6e82d9c5b26f1e054fef04747c219c7bdffed0 Jul 17 15:17:06.172538 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.172434 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrdsf"] Jul 17 15:17:06.176083 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.176061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:06.185425 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.185401 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrdsf"] Jul 17 15:17:06.223980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.223947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfz6\" (UniqueName: \"kubernetes.io/projected/22f47c18-051e-4db5-ac14-00c09f5cac02-kube-api-access-9hfz6\") pod \"kuadrant-operator-catalog-wrdsf\" (UID: \"22f47c18-051e-4db5-ac14-00c09f5cac02\") " pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:06.324691 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.324639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfz6\" (UniqueName: \"kubernetes.io/projected/22f47c18-051e-4db5-ac14-00c09f5cac02-kube-api-access-9hfz6\") pod \"kuadrant-operator-catalog-wrdsf\" (UID: \"22f47c18-051e-4db5-ac14-00c09f5cac02\") " pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:06.338813 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.338786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfz6\" (UniqueName: \"kubernetes.io/projected/22f47c18-051e-4db5-ac14-00c09f5cac02-kube-api-access-9hfz6\") pod \"kuadrant-operator-catalog-wrdsf\" (UID: \"22f47c18-051e-4db5-ac14-00c09f5cac02\") " pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:06.485919 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.485835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:06.615570 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.615546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrdsf"] Jul 17 15:17:06.618077 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:06.618048 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f47c18_051e_4db5_ac14_00c09f5cac02.slice/crio-5436a7272ea74bddacca59651457696b57414e820b8dba71012d0096e1ee57da WatchSource:0}: Error finding container 5436a7272ea74bddacca59651457696b57414e820b8dba71012d0096e1ee57da: Status 404 returned error can't find the container with id 5436a7272ea74bddacca59651457696b57414e820b8dba71012d0096e1ee57da Jul 17 15:17:06.687921 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.687888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" event={"ID":"0420fdd3-fe32-4675-b30d-daafd3c9dc7c","Type":"ContainerStarted","Data":"f63f6a69167371c536826e118c6e82d9c5b26f1e054fef04747c219c7bdffed0"} Jul 17 15:17:06.688956 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:06.688933 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" event={"ID":"22f47c18-051e-4db5-ac14-00c09f5cac02","Type":"ContainerStarted","Data":"5436a7272ea74bddacca59651457696b57414e820b8dba71012d0096e1ee57da"} Jul 17 15:17:08.702243 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.702202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" event={"ID":"0420fdd3-fe32-4675-b30d-daafd3c9dc7c","Type":"ContainerStarted","Data":"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928"} Jul 17 15:17:08.702732 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.702240 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" podUID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" containerName="registry-server" containerID="cri-o://2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928" gracePeriod=2 Jul 17 15:17:08.703833 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.703809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" event={"ID":"22f47c18-051e-4db5-ac14-00c09f5cac02","Type":"ContainerStarted","Data":"92a05896f75da46a9bd21831db003bf685f5fbe5c10a89ceb715fe1ff9557f48"} Jul 17 15:17:08.731886 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.731846 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" podStartSLOduration=1.489203584 podStartE2EDuration="3.731832122s" totalImagesPullingTime="2.242628538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:17:08.729474885 +0000 UTC m=+486.891229210" watchObservedRunningTime="2026-07-17 15:17:08.731832122 +0000 UTC m=+486.893586446" Jul 17 15:17:08.753704 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.753665 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" podStartSLOduration=1.07527619 podStartE2EDuration="2.75365144s" totalImagesPullingTime="1.67837525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:17:08.753595644 +0000 UTC m=+486.915349968" watchObservedRunningTime="2026-07-17 15:17:08.75365144 +0000 UTC m=+486.915405764" Jul 17 15:17:08.948217 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:08.948187 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:09.048970 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.048884 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c\") pod \"0420fdd3-fe32-4675-b30d-daafd3c9dc7c\" (UID: \"0420fdd3-fe32-4675-b30d-daafd3c9dc7c\") " Jul 17 15:17:09.051034 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.051002 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c" (OuterVolumeSpecName: "kube-api-access-nqz5c") pod "0420fdd3-fe32-4675-b30d-daafd3c9dc7c" (UID: "0420fdd3-fe32-4675-b30d-daafd3c9dc7c"). InnerVolumeSpecName "kube-api-access-nqz5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:17:09.149775 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.149734 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/0420fdd3-fe32-4675-b30d-daafd3c9dc7c-kube-api-access-nqz5c\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:09.710093 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.710060 2575 generic.go:356] "Generic (PLEG): container finished" podID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" containerID="2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928" exitCode=0 Jul 17 15:17:09.710546 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.710098 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" Jul 17 15:17:09.710546 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.710141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" event={"ID":"0420fdd3-fe32-4675-b30d-daafd3c9dc7c","Type":"ContainerDied","Data":"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928"} Jul 17 15:17:09.710546 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.710191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4lkgk" event={"ID":"0420fdd3-fe32-4675-b30d-daafd3c9dc7c","Type":"ContainerDied","Data":"f63f6a69167371c536826e118c6e82d9c5b26f1e054fef04747c219c7bdffed0"} Jul 17 15:17:09.710546 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.710216 2575 scope.go:117] "RemoveContainer" containerID="2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928" Jul 17 15:17:09.719287 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.719269 2575 scope.go:117] "RemoveContainer" containerID="2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928" Jul 17 15:17:09.719530 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:09.719511 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928\": container with ID starting with 2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928 not found: ID does not exist" containerID="2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928" Jul 17 15:17:09.719586 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.719539 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928"} err="failed to get container status \"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928\": rpc error: code = NotFound desc = could not find container \"2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928\": container with ID starting with 2cc3c970c8ba5281c4df34d903445d00deee1466cbc7291c6aa5a46cecf34928 not found: ID does not exist" Jul 17 15:17:09.734238 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.734204 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:09.741924 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:09.741893 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4lkgk"] Jul 17 15:17:10.449200 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:10.449166 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" path="/var/lib/kubelet/pods/0420fdd3-fe32-4675-b30d-daafd3c9dc7c/volumes" Jul 17 15:17:16.486773 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:16.486742 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:16.487345 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:16.486796 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:16.508842 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:16.508816 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:16.762766 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:16.762696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wrdsf" Jul 17 15:17:24.354712 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.354680 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s"] Jul 17 15:17:24.355104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.355028 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" containerName="registry-server" Jul 17 15:17:24.355104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.355040 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" containerName="registry-server" Jul 17 15:17:24.355176 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.355111 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0420fdd3-fe32-4675-b30d-daafd3c9dc7c" containerName="registry-server" Jul 17 15:17:24.357432 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.357416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.360155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.360135 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pg8td\"" Jul 17 15:17:24.366395 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.366374 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s"] Jul 17 15:17:24.458561 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.458529 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld"] Jul 17 15:17:24.461160 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.461142 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.470688 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.470662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld"] Jul 17 15:17:24.479169 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.479131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.479297 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.479257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96zrr\" (UniqueName: \"kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.479342 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.479304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.561870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.561829 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn"] Jul 17 15:17:24.564438 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.564422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.576142 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.576114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn"] Jul 17 15:17:24.579737 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.579711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mghp\" (UniqueName: \"kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.579879 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.579768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.579879 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.579836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96zrr\" (UniqueName: \"kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.579879 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.579867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.580041 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.579900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.580041 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.580013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.580265 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.580246 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.580335 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.580315 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.592178 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.592153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96zrr\" (UniqueName: \"kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.660480 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.660427 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn"] Jul 17 15:17:24.663521 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.663502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.666614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.666593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:24.673477 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.673433 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn"] Jul 17 15:17:24.681188 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.681160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mghp\" (UniqueName: \"kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.683302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.683272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx57g\" (UniqueName: \"kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.683419 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.683368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.683519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.683430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.683519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.683498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.683644 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.683626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.684352 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.684325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.684931 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.684835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.691861 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.691839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mghp\" (UniqueName: \"kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.772006 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.771965 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:24.784874 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.784845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.785013 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.784898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.785089 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.785089 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx57g\" (UniqueName: \"kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.785196 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.785196 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmkn\" (UniqueName: \"kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.785302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.785412 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.785389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.796369 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.796343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx57g\" (UniqueName: \"kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.812705 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.812670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s"] Jul 17 15:17:24.814493 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:24.814465 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbaf184_3ea1_42ab_aa42_de5f8fde76fa.slice/crio-6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e WatchSource:0}: Error finding container 6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e: Status 404 returned error can't find the container with id 6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e Jul 17 15:17:24.881053 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.880785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:24.886261 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.886210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.886407 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.886369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmkn\" (UniqueName: \"kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.886487 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.886430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.886743 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.886716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.887298 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.887276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.896576 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.896550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmkn\" (UniqueName: \"kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:24.913978 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.913934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld"] Jul 17 15:17:24.914576 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:24.914548 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc14a1a0_143f_424a_8875_2e77cb8f52a7.slice/crio-b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915 WatchSource:0}: Error finding container b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915: Status 404 returned error can't find the container with id b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915 Jul 17 15:17:24.974648 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:24.974613 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:25.033531 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.033189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn"] Jul 17 15:17:25.035609 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:25.035576 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66523d24_562a_4f78_9d79_538329268e78.slice/crio-3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c WatchSource:0}: Error finding container 3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c: Status 404 returned error can't find the container with id 3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c Jul 17 15:17:25.125324 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.125295 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn"] Jul 17 15:17:25.128508 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:25.128479 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75d6041_739f_4bb7_955e_8e9ff25b530a.slice/crio-11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30 WatchSource:0}: Error finding container 11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30: Status 404 returned error can't find the container with id 11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30 Jul 17 15:17:25.789049 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.789017 2575 generic.go:356] "Generic (PLEG): container finished" podID="66523d24-562a-4f78-9d79-538329268e78" containerID="f6275d2c88e815e4af5fabf8efd619e766282ec283aeaae05a296e5b4f010b7c" exitCode=0 Jul 17 15:17:25.789549 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.789107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" event={"ID":"66523d24-562a-4f78-9d79-538329268e78","Type":"ContainerDied","Data":"f6275d2c88e815e4af5fabf8efd619e766282ec283aeaae05a296e5b4f010b7c"} Jul 17 15:17:25.789549 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.789151 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" event={"ID":"66523d24-562a-4f78-9d79-538329268e78","Type":"ContainerStarted","Data":"3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c"} Jul 17 15:17:25.790708 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.790683 2575 generic.go:356] "Generic (PLEG): container finished" podID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerID="918aa69a8251fca0b44261c83080f7efe93a7d604970dff490a53d62bdcd0497" exitCode=0 Jul 17 15:17:25.790807 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.790773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" event={"ID":"c75d6041-739f-4bb7-955e-8e9ff25b530a","Type":"ContainerDied","Data":"918aa69a8251fca0b44261c83080f7efe93a7d604970dff490a53d62bdcd0497"} Jul 17 15:17:25.790852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.790819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" event={"ID":"c75d6041-739f-4bb7-955e-8e9ff25b530a","Type":"ContainerStarted","Data":"11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30"} Jul 17 15:17:25.792163 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.792145 2575 generic.go:356] "Generic (PLEG): container finished" podID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerID="d5d70e0f59c52445171c6672d78bd65eecc8eafd14e7172712ac06407ee0894a" exitCode=0 Jul 17 15:17:25.792246 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.792225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" event={"ID":"cc14a1a0-143f-424a-8875-2e77cb8f52a7","Type":"ContainerDied","Data":"d5d70e0f59c52445171c6672d78bd65eecc8eafd14e7172712ac06407ee0894a"} Jul 17 15:17:25.792293 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.792266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" event={"ID":"cc14a1a0-143f-424a-8875-2e77cb8f52a7","Type":"ContainerStarted","Data":"b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915"} Jul 17 15:17:25.793573 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.793552 2575 generic.go:356] "Generic (PLEG): container finished" podID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerID="07b96918fb62f0c6f9b3ead09d387d664b63684452939f5b3ebf6dbdf5102e27" exitCode=0 Jul 17 15:17:25.793671 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.793598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" event={"ID":"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa","Type":"ContainerDied","Data":"07b96918fb62f0c6f9b3ead09d387d664b63684452939f5b3ebf6dbdf5102e27"} Jul 17 15:17:25.793671 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:25.793627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" event={"ID":"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa","Type":"ContainerStarted","Data":"6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e"} Jul 17 15:17:26.802093 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:26.802060 2575 generic.go:356] "Generic (PLEG): container finished" podID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerID="831e18cc2072b63d60a12a57f7187ee70e9583a3e9e7deaef140e3ab2f7943b9" exitCode=0 Jul 17 15:17:26.802536 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:26.802161 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" event={"ID":"cc14a1a0-143f-424a-8875-2e77cb8f52a7","Type":"ContainerDied","Data":"831e18cc2072b63d60a12a57f7187ee70e9583a3e9e7deaef140e3ab2f7943b9"} Jul 17 15:17:26.804172 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:26.804148 2575 generic.go:356] "Generic (PLEG): container finished" podID="66523d24-562a-4f78-9d79-538329268e78" containerID="3d023f87a55104e7ea30b83c5afd7eaf508ad6c9d5d6aabe4377be67e57a10fc" exitCode=0 Jul 17 15:17:26.804258 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:26.804195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" event={"ID":"66523d24-562a-4f78-9d79-538329268e78","Type":"ContainerDied","Data":"3d023f87a55104e7ea30b83c5afd7eaf508ad6c9d5d6aabe4377be67e57a10fc"} Jul 17 15:17:27.812864 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.812825 2575 generic.go:356] "Generic (PLEG): container finished" podID="66523d24-562a-4f78-9d79-538329268e78" containerID="82fde05ad5825d133ed2c6230454821e3586248e3fd7824dfa26b4ed3017d8ed" exitCode=0 Jul 17 15:17:27.813322 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.812916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" event={"ID":"66523d24-562a-4f78-9d79-538329268e78","Type":"ContainerDied","Data":"82fde05ad5825d133ed2c6230454821e3586248e3fd7824dfa26b4ed3017d8ed"} Jul 17 15:17:27.814616 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.814591 2575 generic.go:356] "Generic (PLEG): container finished" podID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerID="2fcf29aa6a8da4de096c72aa661cb754da86ae96dde494c6436a07e55993c193" exitCode=0 Jul 17 15:17:27.814717 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.814658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" event={"ID":"c75d6041-739f-4bb7-955e-8e9ff25b530a","Type":"ContainerDied","Data":"2fcf29aa6a8da4de096c72aa661cb754da86ae96dde494c6436a07e55993c193"} Jul 17 15:17:27.816667 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.816648 2575 generic.go:356] "Generic (PLEG): container finished" podID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerID="1d8c194b19197b913ea82aff9545468b6559c4748e1ba29025cc9681494d703c" exitCode=0 Jul 17 15:17:27.816754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.816726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" event={"ID":"cc14a1a0-143f-424a-8875-2e77cb8f52a7","Type":"ContainerDied","Data":"1d8c194b19197b913ea82aff9545468b6559c4748e1ba29025cc9681494d703c"} Jul 17 15:17:27.818507 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.818488 2575 generic.go:356] "Generic (PLEG): container finished" podID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerID="1d2112f5c384f59df912e706e9b926a180f549cb1933a0ed5a1594655873d05e" exitCode=0 Jul 17 15:17:27.818589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:27.818515 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" event={"ID":"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa","Type":"ContainerDied","Data":"1d2112f5c384f59df912e706e9b926a180f549cb1933a0ed5a1594655873d05e"} Jul 17 15:17:28.825871 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.825838 2575 generic.go:356] "Generic (PLEG): container finished" podID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerID="bc4fe08bd52cac03045711618d0ee91b021e2f8869ebf2eb89b4df7d5a607ac7" exitCode=0 Jul 17 15:17:28.826266 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.825929 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" event={"ID":"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa","Type":"ContainerDied","Data":"bc4fe08bd52cac03045711618d0ee91b021e2f8869ebf2eb89b4df7d5a607ac7"} Jul 17 15:17:28.827846 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.827826 2575 generic.go:356] "Generic (PLEG): container finished" podID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerID="5aca210fe45e02b1339fa0341db6bab9a6182fff458a550d689561ca8fd7e900" exitCode=0 Jul 17 15:17:28.827932 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.827909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" event={"ID":"c75d6041-739f-4bb7-955e-8e9ff25b530a","Type":"ContainerDied","Data":"5aca210fe45e02b1339fa0341db6bab9a6182fff458a550d689561ca8fd7e900"} Jul 17 15:17:28.986212 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.986155 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:28.989022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:28.988996 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:29.125710 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125611 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle\") pod \"66523d24-562a-4f78-9d79-538329268e78\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " Jul 17 15:17:29.125710 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125666 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mghp\" (UniqueName: \"kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp\") pod \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " Jul 17 15:17:29.125710 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125682 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util\") pod \"66523d24-562a-4f78-9d79-538329268e78\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " Jul 17 15:17:29.125969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125723 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle\") pod \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " Jul 17 15:17:29.125969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125747 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx57g\" (UniqueName: \"kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g\") pod \"66523d24-562a-4f78-9d79-538329268e78\" (UID: \"66523d24-562a-4f78-9d79-538329268e78\") " Jul 17 15:17:29.125969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.125861 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util\") pod \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\" (UID: \"cc14a1a0-143f-424a-8875-2e77cb8f52a7\") " Jul 17 15:17:29.126409 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.126353 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle" (OuterVolumeSpecName: "bundle") pod "66523d24-562a-4f78-9d79-538329268e78" (UID: "66523d24-562a-4f78-9d79-538329268e78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:29.126515 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.126486 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle" (OuterVolumeSpecName: "bundle") pod "cc14a1a0-143f-424a-8875-2e77cb8f52a7" (UID: "cc14a1a0-143f-424a-8875-2e77cb8f52a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:29.127944 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.127915 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp" (OuterVolumeSpecName: "kube-api-access-6mghp") pod "cc14a1a0-143f-424a-8875-2e77cb8f52a7" (UID: "cc14a1a0-143f-424a-8875-2e77cb8f52a7"). InnerVolumeSpecName "kube-api-access-6mghp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:17:29.128239 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.128215 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g" (OuterVolumeSpecName: "kube-api-access-cx57g") pod "66523d24-562a-4f78-9d79-538329268e78" (UID: "66523d24-562a-4f78-9d79-538329268e78"). InnerVolumeSpecName "kube-api-access-cx57g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:17:29.131748 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.131718 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util" (OuterVolumeSpecName: "util") pod "cc14a1a0-143f-424a-8875-2e77cb8f52a7" (UID: "cc14a1a0-143f-424a-8875-2e77cb8f52a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:29.132186 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.132166 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util" (OuterVolumeSpecName: "util") pod "66523d24-562a-4f78-9d79-538329268e78" (UID: "66523d24-562a-4f78-9d79-538329268e78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:29.227419 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227388 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.227419 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227417 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.227630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227429 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mghp\" (UniqueName: \"kubernetes.io/projected/cc14a1a0-143f-424a-8875-2e77cb8f52a7-kube-api-access-6mghp\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.227630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227438 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66523d24-562a-4f78-9d79-538329268e78-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.227630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227468 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc14a1a0-143f-424a-8875-2e77cb8f52a7-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.227630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.227478 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx57g\" (UniqueName: \"kubernetes.io/projected/66523d24-562a-4f78-9d79-538329268e78-kube-api-access-cx57g\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:29.836147 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.836112 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" Jul 17 15:17:29.836147 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.836138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld" event={"ID":"cc14a1a0-143f-424a-8875-2e77cb8f52a7","Type":"ContainerDied","Data":"b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915"} Jul 17 15:17:29.836624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.836186 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4886f1f60d8de8d7e2dc7b454105734473d726e1a966dea5e6271d9eb121915" Jul 17 15:17:29.838075 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.838051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" event={"ID":"66523d24-562a-4f78-9d79-538329268e78","Type":"ContainerDied","Data":"3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c"} Jul 17 15:17:29.838203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.838094 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b5b38da18c853065292e73cf74a472b2208c2d6c4a840c41fd24ab1c9d9391c" Jul 17 15:17:29.838203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.838099 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn" Jul 17 15:17:29.996818 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.996789 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:29.999488 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:29.999432 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:30.133608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133516 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpmkn\" (UniqueName: \"kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn\") pod \"c75d6041-739f-4bb7-955e-8e9ff25b530a\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " Jul 17 15:17:30.133608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133585 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle\") pod \"c75d6041-739f-4bb7-955e-8e9ff25b530a\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " Jul 17 15:17:30.133826 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133612 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96zrr\" (UniqueName: \"kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr\") pod \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " Jul 17 15:17:30.133826 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133641 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle\") pod \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " Jul 17 15:17:30.133826 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util\") pod \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\" (UID: \"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa\") " Jul 17 15:17:30.133826 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.133688 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util\") pod \"c75d6041-739f-4bb7-955e-8e9ff25b530a\" (UID: \"c75d6041-739f-4bb7-955e-8e9ff25b530a\") " Jul 17 15:17:30.134172 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.134141 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle" (OuterVolumeSpecName: "bundle") pod "c75d6041-739f-4bb7-955e-8e9ff25b530a" (UID: "c75d6041-739f-4bb7-955e-8e9ff25b530a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:30.134353 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.134331 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle" (OuterVolumeSpecName: "bundle") pod "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" (UID: "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:30.135772 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.135748 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr" (OuterVolumeSpecName: "kube-api-access-96zrr") pod "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" (UID: "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa"). InnerVolumeSpecName "kube-api-access-96zrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:17:30.136054 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.136039 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn" (OuterVolumeSpecName: "kube-api-access-mpmkn") pod "c75d6041-739f-4bb7-955e-8e9ff25b530a" (UID: "c75d6041-739f-4bb7-955e-8e9ff25b530a"). InnerVolumeSpecName "kube-api-access-mpmkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:17:30.139852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.139810 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util" (OuterVolumeSpecName: "util") pod "c75d6041-739f-4bb7-955e-8e9ff25b530a" (UID: "c75d6041-739f-4bb7-955e-8e9ff25b530a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:30.140534 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.140511 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util" (OuterVolumeSpecName: "util") pod "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" (UID: "3fbaf184-3ea1-42ab-aa42-de5f8fde76fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:17:30.234285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234253 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpmkn\" (UniqueName: \"kubernetes.io/projected/c75d6041-739f-4bb7-955e-8e9ff25b530a-kube-api-access-mpmkn\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.234285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234282 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.234285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234292 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96zrr\" (UniqueName: \"kubernetes.io/projected/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-kube-api-access-96zrr\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.234519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234302 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.234519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234310 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fbaf184-3ea1-42ab-aa42-de5f8fde76fa-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.234519 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.234318 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c75d6041-739f-4bb7-955e-8e9ff25b530a-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:17:30.845727 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.845634 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" Jul 17 15:17:30.845727 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.845640 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn" event={"ID":"c75d6041-739f-4bb7-955e-8e9ff25b530a","Type":"ContainerDied","Data":"11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30"} Jul 17 15:17:30.846162 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.845757 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11537e2b9fbfd781ba2096b9c17b4eb2b468912793694a021dda251ba8f5ad30" Jul 17 15:17:30.847929 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.847853 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" Jul 17 15:17:30.847929 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.847865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s" event={"ID":"3fbaf184-3ea1-42ab-aa42-de5f8fde76fa","Type":"ContainerDied","Data":"6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e"} Jul 17 15:17:30.848167 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:30.847984 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bb1496fd3b630bdd883143f136ef390109e1044368e3c9a6d67a9214ee1ef8e" Jul 17 15:17:39.144293 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144253 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf"] Jul 17 15:17:39.144822 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144800 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="util" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144827 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="util" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144840 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="pull" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144848 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="pull" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144857 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144865 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144878 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144887 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144901 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144909 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="extract" Jul 17 15:17:39.144916 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144918 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="extract" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144926 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="extract" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144951 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144961 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144983 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.144992 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145001 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145009 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145025 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145035 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="util" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145044 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145052 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145062 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145069 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="pull" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145163 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="66523d24-562a-4f78-9d79-538329268e78" containerName="extract" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145174 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc14a1a0-143f-424a-8875-2e77cb8f52a7" containerName="extract" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145182 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fbaf184-3ea1-42ab-aa42-de5f8fde76fa" containerName="extract" Jul 17 15:17:39.145358 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.145196 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75d6041-739f-4bb7-955e-8e9ff25b530a" containerName="extract" Jul 17 15:17:39.148856 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.148835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.152662 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.152642 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6xtm\"" Jul 17 15:17:39.165999 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.165972 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf"] Jul 17 15:17:39.312832 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.312777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5wpt\" (UniqueName: \"kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.313232 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.312941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.414187 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.414079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.414187 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.414156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5wpt\" (UniqueName: \"kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.414504 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.414484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.427399 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.427377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5wpt\" (UniqueName: \"kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.458813 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.458786 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:39.639740 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.639710 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf"] Jul 17 15:17:39.647830 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:39.647793 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb750120_6c51_4e51_ba04_d66f829e0c2e.slice/crio-424bfa4ef5cec78f7f60bb33327d3b7d646a34236cf99558909fc493354ab2d0 WatchSource:0}: Error finding container 424bfa4ef5cec78f7f60bb33327d3b7d646a34236cf99558909fc493354ab2d0: Status 404 returned error can't find the container with id 424bfa4ef5cec78f7f60bb33327d3b7d646a34236cf99558909fc493354ab2d0 Jul 17 15:17:39.895541 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:39.895510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" event={"ID":"eb750120-6c51-4e51-ba04-d66f829e0c2e","Type":"ContainerStarted","Data":"424bfa4ef5cec78f7f60bb33327d3b7d646a34236cf99558909fc493354ab2d0"} Jul 17 15:17:42.078270 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.078177 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s"] Jul 17 15:17:42.096601 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.096570 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s"] Jul 17 15:17:42.096754 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.096662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:42.101081 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.101057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bkffz\"" Jul 17 15:17:42.241463 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.241415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2ztm\" (UniqueName: \"kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm\") pod \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" (UID: \"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:42.342861 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.342775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2ztm\" (UniqueName: \"kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm\") pod \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" (UID: \"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:42.354962 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.354929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2ztm\" (UniqueName: \"kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm\") pod \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" (UID: \"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:42.408647 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.408621 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:42.572424 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.572402 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s"] Jul 17 15:17:42.573829 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:42.573806 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2dd675_b1c5_46b4_bf4d_d2d94228b7df.slice/crio-038d107cc39be869d05653af926aace66ae1556ed543cf4d46796229a6498ffd WatchSource:0}: Error finding container 038d107cc39be869d05653af926aace66ae1556ed543cf4d46796229a6498ffd: Status 404 returned error can't find the container with id 038d107cc39be869d05653af926aace66ae1556ed543cf4d46796229a6498ffd Jul 17 15:17:42.913963 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:42.913928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" event={"ID":"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df","Type":"ContainerStarted","Data":"038d107cc39be869d05653af926aace66ae1556ed543cf4d46796229a6498ffd"} Jul 17 15:17:45.934318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.934281 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" event={"ID":"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df","Type":"ContainerStarted","Data":"8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4"} Jul 17 15:17:45.934762 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.934407 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:45.936013 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.935990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" event={"ID":"eb750120-6c51-4e51-ba04-d66f829e0c2e","Type":"ContainerStarted","Data":"f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce"} Jul 17 15:17:45.936114 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.936069 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:45.955823 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.955770 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" podStartSLOduration=1.109049876 podStartE2EDuration="3.955756175s" totalImagesPullingTime="2.846706299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:17:45.953422269 +0000 UTC m=+524.115176594" watchObservedRunningTime="2026-07-17 15:17:45.955756175 +0000 UTC m=+524.117510500" Jul 17 15:17:45.987941 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:45.987890 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" podStartSLOduration=1.203783078 podStartE2EDuration="6.987875343s" totalImagesPullingTime="5.784092265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:17:45.98621306 +0000 UTC m=+524.147967385" watchObservedRunningTime="2026-07-17 15:17:45.987875343 +0000 UTC m=+524.149629667" Jul 17 15:17:48.436651 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.436617 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92"] Jul 17 15:17:48.443726 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.443697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.446958 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.446937 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 17 15:17:48.448084 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.448058 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pg8td\"" Jul 17 15:17:48.448778 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.448058 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 17 15:17:48.452021 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.451998 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92"] Jul 17 15:17:48.601555 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.601509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmngn\" (UniqueName: \"kubernetes.io/projected/24c864c1-02a2-493a-bd20-a4a80649617d-kube-api-access-qmngn\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.601729 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.601667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24c864c1-02a2-493a-bd20-a4a80649617d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.601729 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.601701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24c864c1-02a2-493a-bd20-a4a80649617d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.702517 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.702410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24c864c1-02a2-493a-bd20-a4a80649617d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.702517 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.702470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24c864c1-02a2-493a-bd20-a4a80649617d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.702517 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.702506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmngn\" (UniqueName: \"kubernetes.io/projected/24c864c1-02a2-493a-bd20-a4a80649617d-kube-api-access-qmngn\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.703192 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.703166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24c864c1-02a2-493a-bd20-a4a80649617d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.704922 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.704900 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24c864c1-02a2-493a-bd20-a4a80649617d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.714510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.714481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmngn\" (UniqueName: \"kubernetes.io/projected/24c864c1-02a2-493a-bd20-a4a80649617d-kube-api-access-qmngn\") pod \"kuadrant-console-plugin-66b5774985-nhc92\" (UID: \"24c864c1-02a2-493a-bd20-a4a80649617d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.755147 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.755118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" Jul 17 15:17:48.885980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.885950 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92"] Jul 17 15:17:48.887876 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:17:48.887849 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24c864c1_02a2_493a_bd20_a4a80649617d.slice/crio-c1a442bca7fd8c809acb9d2354ac05dd8ea1c1151a6bc86748626cf71f244f87 WatchSource:0}: Error finding container c1a442bca7fd8c809acb9d2354ac05dd8ea1c1151a6bc86748626cf71f244f87: Status 404 returned error can't find the container with id c1a442bca7fd8c809acb9d2354ac05dd8ea1c1151a6bc86748626cf71f244f87 Jul 17 15:17:48.951074 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:48.951039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" event={"ID":"24c864c1-02a2-493a-bd20-a4a80649617d","Type":"ContainerStarted","Data":"c1a442bca7fd8c809acb9d2354ac05dd8ea1c1151a6bc86748626cf71f244f87"} Jul 17 15:17:56.943515 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:56.943402 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:56.943935 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:56.943822 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:58.626783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.626652 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf"] Jul 17 15:17:58.627291 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.626887 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" containerName="manager" containerID="cri-o://f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce" gracePeriod=2 Jul 17 15:17:58.630145 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.629715 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf"] Jul 17 15:17:58.632022 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.631974 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:58.640347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.640319 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s"] Jul 17 15:17:58.640676 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.640636 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" containerName="manager" containerID="cri-o://8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4" gracePeriod=2 Jul 17 15:17:58.643134 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.643096 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:58.645853 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.645816 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:58.650022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.649996 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s"] Jul 17 15:17:58.678207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678176 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:17:58.678738 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678718 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" containerName="manager" Jul 17 15:17:58.678738 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678738 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" containerName="manager" Jul 17 15:17:58.678926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678751 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" containerName="manager" Jul 17 15:17:58.678926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678761 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" containerName="manager" Jul 17 15:17:58.678926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678863 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" containerName="manager" Jul 17 15:17:58.678926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.678877 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" containerName="manager" Jul 17 15:17:58.681216 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.681163 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.681736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.681710 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw"] Jul 17 15:17:58.684775 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.684725 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:58.685363 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.685348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:17:58.693964 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.693920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5czv5\" (UniqueName: \"kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.694095 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.694073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.703641 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.703613 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw"] Jul 17 15:17:58.719967 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.719918 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:17:58.742867 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.742831 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:58.745818 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.745783 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:17:58.748385 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:17:58.748343 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:17:58.795396 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.795350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5khx\" (UniqueName: \"kubernetes.io/projected/1abe0412-c3d7-45e4-b5e7-fae821e2ab21-kube-api-access-p5khx\") pod \"limitador-operator-controller-manager-859d7b78bd-gbmpw\" (UID: \"1abe0412-c3d7-45e4-b5e7-fae821e2ab21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:17:58.795595 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.795433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.795595 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.795563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5czv5\" (UniqueName: \"kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.795861 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.795834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.808187 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.808160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5czv5\" (UniqueName: \"kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5mc7\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:58.897053 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.897014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5khx\" (UniqueName: \"kubernetes.io/projected/1abe0412-c3d7-45e4-b5e7-fae821e2ab21-kube-api-access-p5khx\") pod \"limitador-operator-controller-manager-859d7b78bd-gbmpw\" (UID: \"1abe0412-c3d7-45e4-b5e7-fae821e2ab21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:17:58.910642 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:58.910609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5khx\" (UniqueName: \"kubernetes.io/projected/1abe0412-c3d7-45e4-b5e7-fae821e2ab21-kube-api-access-p5khx\") pod \"limitador-operator-controller-manager-859d7b78bd-gbmpw\" (UID: \"1abe0412-c3d7-45e4-b5e7-fae821e2ab21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:17:59.032760 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:59.032727 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:17:59.040557 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:17:59.040529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:18:12.415263 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.414879 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:12.417647 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:12.417609 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:12.418977 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.418940 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:12.421192 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:12.421162 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:12.423070 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:12.423041 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:12.452020 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:12.451980 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:12.454208 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:12.454164 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:12.455479 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.455435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:18:12.456182 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:18:12.456162 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd10f5e_7d25_4b0e_9dea_2a464383d7bf.slice/crio-7fd658741f12faafeaa8a77b829906d6cb28bac944e849d4e4c232b3f2e8cb60 WatchSource:0}: Error finding container 7fd658741f12faafeaa8a77b829906d6cb28bac944e849d4e4c232b3f2e8cb60: Status 404 returned error can't find the container with id 7fd658741f12faafeaa8a77b829906d6cb28bac944e849d4e4c232b3f2e8cb60 Jul 17 15:18:12.476432 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.476408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw"] Jul 17 15:18:12.493011 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:18:12.492984 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abe0412_c3d7_45e4_b5e7_fae821e2ab21.slice/crio-40b8179c048b373a962558d6532239c17a46dbda7bc8ca66ce47d7e8ebf9ca3f WatchSource:0}: Error finding container 40b8179c048b373a962558d6532239c17a46dbda7bc8ca66ce47d7e8ebf9ca3f: Status 404 returned error can't find the container with id 40b8179c048b373a962558d6532239c17a46dbda7bc8ca66ce47d7e8ebf9ca3f Jul 17 15:18:12.528075 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.528053 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume\") pod \"eb750120-6c51-4e51-ba04-d66f829e0c2e\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " Jul 17 15:18:12.528226 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.528123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2ztm\" (UniqueName: \"kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm\") pod \"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df\" (UID: \"ef2dd675-b1c5-46b4-bf4d-d2d94228b7df\") " Jul 17 15:18:12.528226 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.528178 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5wpt\" (UniqueName: \"kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt\") pod \"eb750120-6c51-4e51-ba04-d66f829e0c2e\" (UID: \"eb750120-6c51-4e51-ba04-d66f829e0c2e\") " Jul 17 15:18:12.528698 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.528646 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eb750120-6c51-4e51-ba04-d66f829e0c2e" (UID: "eb750120-6c51-4e51-ba04-d66f829e0c2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:18:12.528825 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.528802 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb750120-6c51-4e51-ba04-d66f829e0c2e-extensions-socket-volume\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:12.530118 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.530096 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm" (OuterVolumeSpecName: "kube-api-access-q2ztm") pod "ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" (UID: "ef2dd675-b1c5-46b4-bf4d-d2d94228b7df"). InnerVolumeSpecName "kube-api-access-q2ztm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:18:12.530505 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.530481 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt" (OuterVolumeSpecName: "kube-api-access-h5wpt") pod "eb750120-6c51-4e51-ba04-d66f829e0c2e" (UID: "eb750120-6c51-4e51-ba04-d66f829e0c2e"). InnerVolumeSpecName "kube-api-access-h5wpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:18:12.629646 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.629614 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5wpt\" (UniqueName: \"kubernetes.io/projected/eb750120-6c51-4e51-ba04-d66f829e0c2e-kube-api-access-h5wpt\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:12.629646 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:12.629642 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2ztm\" (UniqueName: \"kubernetes.io/projected/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df-kube-api-access-q2ztm\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:13.097691 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.097656 2575 generic.go:356] "Generic (PLEG): container finished" podID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" containerID="8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4" exitCode=0 Jul 17 15:18:13.097858 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.097698 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:13.097858 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.097738 2575 scope.go:117] "RemoveContainer" containerID="8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4" Jul 17 15:18:13.099636 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.099607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" event={"ID":"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf","Type":"ContainerStarted","Data":"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d"} Jul 17 15:18:13.099752 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.099667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:18:13.099752 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.099690 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" event={"ID":"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf","Type":"ContainerStarted","Data":"7fd658741f12faafeaa8a77b829906d6cb28bac944e849d4e4c232b3f2e8cb60"} Jul 17 15:18:13.100664 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.100622 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:13.101099 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.101075 2575 generic.go:356] "Generic (PLEG): container finished" podID="eb750120-6c51-4e51-ba04-d66f829e0c2e" containerID="f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce" exitCode=0 Jul 17 15:18:13.101204 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.101114 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:13.102911 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.102864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" event={"ID":"24c864c1-02a2-493a-bd20-a4a80649617d","Type":"ContainerStarted","Data":"b368eb66ad3d9a2726a905a2cfeba516ce8733f3edd4f6f0553282c640729a2e"} Jul 17 15:18:13.103099 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.103073 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:13.104692 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.104672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" event={"ID":"1abe0412-c3d7-45e4-b5e7-fae821e2ab21","Type":"ContainerStarted","Data":"1e45ead207397601fa27a265f76032eb3c0d7f74358c5b98d3706b861c494fa1"} Jul 17 15:18:13.104776 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.104713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" event={"ID":"1abe0412-c3d7-45e4-b5e7-fae821e2ab21","Type":"ContainerStarted","Data":"40b8179c048b373a962558d6532239c17a46dbda7bc8ca66ce47d7e8ebf9ca3f"} Jul 17 15:18:13.104844 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.104833 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:18:13.107491 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.107472 2575 scope.go:117] "RemoveContainer" containerID="8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4" Jul 17 15:18:13.107777 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.107758 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4\": container with ID starting with 8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4 not found: ID does not exist" containerID="8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4" Jul 17 15:18:13.107852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.107789 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4"} err="failed to get container status \"8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4\": rpc error: code = NotFound desc = could not find container \"8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4\": container with ID starting with 8f458467611e03927413e7794eda00b892c5bbe947b4d42d113af019f33d9ac4 not found: ID does not exist" Jul 17 15:18:13.107852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.107810 2575 scope.go:117] "RemoveContainer" containerID="f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce" Jul 17 15:18:13.116207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.116191 2575 scope.go:117] "RemoveContainer" containerID="f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce" Jul 17 15:18:13.116489 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.116467 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce\": container with ID starting with f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce not found: ID does not exist" containerID="f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce" Jul 17 15:18:13.116537 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.116499 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce"} err="failed to get container status \"f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce\": rpc error: code = NotFound desc = could not find container \"f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce\": container with ID starting with f8db1181b33f1a563a5a7e4935c3f63d56880f6c15095e2015a51292c7cc2bce not found: ID does not exist" Jul 17 15:18:13.125509 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.125472 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxsnf\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxsnf" Jul 17 15:18:13.126501 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.126458 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" podStartSLOduration=15.126429703 podStartE2EDuration="15.126429703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:13.123258163 +0000 UTC m=+551.285012489" watchObservedRunningTime="2026-07-17 15:18:13.126429703 +0000 UTC m=+551.288184028" Jul 17 15:18:13.127904 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:13.127879 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2ch2s\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2ch2s" Jul 17 15:18:13.150648 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.150600 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" podStartSLOduration=15.150584419 podStartE2EDuration="15.150584419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:13.14854917 +0000 UTC m=+551.310303496" watchObservedRunningTime="2026-07-17 15:18:13.150584419 +0000 UTC m=+551.312338745" Jul 17 15:18:13.170461 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:13.170405 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nhc92" podStartSLOduration=1.731937045 podStartE2EDuration="25.170388569s" totalImagesPullingTime="23.438451524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:13.167696105 +0000 UTC m=+551.329450464" watchObservedRunningTime="2026-07-17 15:18:13.170388569 +0000 UTC m=+551.332142893" Jul 17 15:18:14.450139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:14.450107 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb750120-6c51-4e51-ba04-d66f829e0c2e" path="/var/lib/kubelet/pods/eb750120-6c51-4e51-ba04-d66f829e0c2e/volumes" Jul 17 15:18:14.450556 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:14.450428 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2dd675-b1c5-46b4-bf4d-d2d94228b7df" path="/var/lib/kubelet/pods/ef2dd675-b1c5-46b4-bf4d-d2d94228b7df/volumes" Jul 17 15:18:14.881992 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:14.881913 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:18:15.121384 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.121341 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" podUID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" containerName="manager" containerID="cri-o://3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d" gracePeriod=10 Jul 17 15:18:15.364416 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.364395 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:18:15.455802 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.455766 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5czv5\" (UniqueName: \"kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5\") pod \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " Jul 17 15:18:15.456245 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.455876 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume\") pod \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\" (UID: \"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf\") " Jul 17 15:18:15.456245 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.456205 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" (UID: "ccd10f5e-7d25-4b0e-9dea-2a464383d7bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 15:18:15.457854 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.457825 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5" (OuterVolumeSpecName: "kube-api-access-5czv5") pod "ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" (UID: "ccd10f5e-7d25-4b0e-9dea-2a464383d7bf"). InnerVolumeSpecName "kube-api-access-5czv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:18:15.556574 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.556539 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5czv5\" (UniqueName: \"kubernetes.io/projected/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-kube-api-access-5czv5\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:15.556574 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:15.556568 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf-extensions-socket-volume\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:16.128926 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.128890 2575 generic.go:356] "Generic (PLEG): container finished" podID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" containerID="3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d" exitCode=0 Jul 17 15:18:16.129149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.128933 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" Jul 17 15:18:16.129149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.128978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" event={"ID":"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf","Type":"ContainerDied","Data":"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d"} Jul 17 15:18:16.129149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.129036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7" event={"ID":"ccd10f5e-7d25-4b0e-9dea-2a464383d7bf","Type":"ContainerDied","Data":"7fd658741f12faafeaa8a77b829906d6cb28bac944e849d4e4c232b3f2e8cb60"} Jul 17 15:18:16.129149 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.129067 2575 scope.go:117] "RemoveContainer" containerID="3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d" Jul 17 15:18:16.138108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.138092 2575 scope.go:117] "RemoveContainer" containerID="3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d" Jul 17 15:18:16.138371 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:16.138343 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d\": container with ID starting with 3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d not found: ID does not exist" containerID="3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d" Jul 17 15:18:16.138455 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.138377 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d"} err="failed to get container status \"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d\": rpc error: code = NotFound desc = could not find container \"3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d\": container with ID starting with 3bb256f16419389f8079d38ff652a64c89b5cd7a4e2fc3c885b6fb493c1f142d not found: ID does not exist" Jul 17 15:18:16.153742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.153715 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:18:16.161564 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.161541 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5mc7"] Jul 17 15:18:16.449013 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:16.448980 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" path="/var/lib/kubelet/pods/ccd10f5e-7d25-4b0e-9dea-2a464383d7bf/volumes" Jul 17 15:18:24.118488 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:24.118434 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbmpw" Jul 17 15:18:31.209995 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.209958 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s"] Jul 17 15:18:31.210548 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.210528 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" containerName="manager" Jul 17 15:18:31.210640 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.210551 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" containerName="manager" Jul 17 15:18:31.210700 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.210667 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd10f5e-7d25-4b0e-9dea-2a464383d7bf" containerName="manager" Jul 17 15:18:31.223382 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.223350 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.227747 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.227723 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r5795\"" Jul 17 15:18:31.243487 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.243457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s"] Jul 17 15:18:31.399783 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.399969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtqpt\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-kube-api-access-qtqpt\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.399969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.399969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.399969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.400137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.399979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.400137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.400050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.400137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.400076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.400137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.400100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d496021-ffc6-4bda-ba06-8ab990949d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501420 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501420 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d496021-ffc6-4bda-ba06-8ab990949d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtqpt\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-kube-api-access-qtqpt\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.501681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501638 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.502042 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.502042 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501908 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.502042 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.501972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.502211 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.502169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.502211 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.502202 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d496021-ffc6-4bda-ba06-8ab990949d7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.503799 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.503772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.504011 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.503995 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.510852 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.510827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.510972 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.510911 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtqpt\" (UniqueName: \"kubernetes.io/projected/0d496021-ffc6-4bda-ba06-8ab990949d7c-kube-api-access-qtqpt\") pod \"maas-default-gateway-openshift-default-56654dcf7-nqz5s\" (UID: \"0d496021-ffc6-4bda-ba06-8ab990949d7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.533718 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.533687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:31.703866 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.703837 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s"] Jul 17 15:18:31.706142 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:18:31.706110 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d496021_ffc6_4bda_ba06_8ab990949d7c.slice/crio-51df276d82f5e02d8d92af8c6f30edc64422b0a6a34c513dcda2d35737a7b129 WatchSource:0}: Error finding container 51df276d82f5e02d8d92af8c6f30edc64422b0a6a34c513dcda2d35737a7b129: Status 404 returned error can't find the container with id 51df276d82f5e02d8d92af8c6f30edc64422b0a6a34c513dcda2d35737a7b129 Jul 17 15:18:31.708281 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.708249 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:18:31.708376 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.708329 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:18:31.708438 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:31.708372 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:18:32.216813 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:32.216778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" event={"ID":"0d496021-ffc6-4bda-ba06-8ab990949d7c","Type":"ContainerStarted","Data":"899298b58c8ee81e3d9d08cea875f6608560616fcae1ea541b79441a7473e742"} Jul 17 15:18:32.217194 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:32.216860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" event={"ID":"0d496021-ffc6-4bda-ba06-8ab990949d7c","Type":"ContainerStarted","Data":"51df276d82f5e02d8d92af8c6f30edc64422b0a6a34c513dcda2d35737a7b129"} Jul 17 15:18:32.239870 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:32.239821 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" podStartSLOduration=1.239805537 podStartE2EDuration="1.239805537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:32.238389579 +0000 UTC m=+570.400143907" watchObservedRunningTime="2026-07-17 15:18:32.239805537 +0000 UTC m=+570.401559861" Jul 17 15:18:32.534108 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:32.534021 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:32.538820 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:32.538795 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:33.221810 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.221779 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:33.222673 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.222656 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:18:33.239635 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.239600 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:33.290399 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.290366 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:33.290876 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.290523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.293482 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.293442 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 15:18:33.336304 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.336268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:33.418107 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.418072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.418287 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.418139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczfd\" (UniqueName: \"kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.519663 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.519569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cczfd\" (UniqueName: \"kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.519663 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.519661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.520234 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.520216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.535362 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.535333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczfd\" (UniqueName: \"kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd\") pod \"limitador-limitador-64c94fd64f-hsbmn\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.602983 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.602940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:33.762921 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:33.762890 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:33.765169 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:18:33.765139 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5b4ca7_8461_4253_b01f_8ce7b2def686.slice/crio-e7406833fff6a03243b67a0331ca4658c55429ab0870484ffc9551326651977f WatchSource:0}: Error finding container e7406833fff6a03243b67a0331ca4658c55429ab0870484ffc9551326651977f: Status 404 returned error can't find the container with id e7406833fff6a03243b67a0331ca4658c55429ab0870484ffc9551326651977f Jul 17 15:18:34.228121 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.228085 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" event={"ID":"2c5b4ca7-8461-4253-b01f-8ce7b2def686","Type":"ContainerStarted","Data":"e7406833fff6a03243b67a0331ca4658c55429ab0870484ffc9551326651977f"} Jul 17 15:18:34.257974 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.257939 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:18:34.337719 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.337685 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:18:34.337881 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.337782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:18:34.340561 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.340530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2pp5v\"" Jul 17 15:18:34.529675 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.529585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsb9x\" (UniqueName: \"kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x\") pod \"authorino-75d556bd77-5d6hs\" (UID: \"5805e1da-2bb4-41a2-8e1f-a996314275fe\") " pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:18:34.630264 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.630224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsb9x\" (UniqueName: \"kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x\") pod \"authorino-75d556bd77-5d6hs\" (UID: \"5805e1da-2bb4-41a2-8e1f-a996314275fe\") " pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:18:34.640111 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.640081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsb9x\" (UniqueName: \"kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x\") pod \"authorino-75d556bd77-5d6hs\" (UID: \"5805e1da-2bb4-41a2-8e1f-a996314275fe\") " pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:18:34.647672 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.647633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:18:34.840907 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:34.840865 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:18:35.236529 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:35.236491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5d6hs" event={"ID":"5805e1da-2bb4-41a2-8e1f-a996314275fe","Type":"ContainerStarted","Data":"f22530d5a71b0a3c0ddb7fdddf67af1a4ea89562dab3f4d6b2788414d5256b4b"} Jul 17 15:18:41.277713 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:41.277668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" event={"ID":"2c5b4ca7-8461-4253-b01f-8ce7b2def686","Type":"ContainerStarted","Data":"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33"} Jul 17 15:18:41.278188 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:41.277857 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:41.279169 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:41.279146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5d6hs" event={"ID":"5805e1da-2bb4-41a2-8e1f-a996314275fe","Type":"ContainerStarted","Data":"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6"} Jul 17 15:18:41.298691 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:41.298640 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" podStartSLOduration=1.5231233309999999 podStartE2EDuration="8.298626172s" totalImagesPullingTime="6.775502841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:41.29742381 +0000 UTC m=+579.459178137" watchObservedRunningTime="2026-07-17 15:18:41.298626172 +0000 UTC m=+579.460380520" Jul 17 15:18:41.314998 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:41.314956 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5d6hs" podStartSLOduration=1.733820922 podStartE2EDuration="7.314941996s" totalImagesPullingTime="5.581121074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:41.31269315 +0000 UTC m=+579.474447463" watchObservedRunningTime="2026-07-17 15:18:41.314941996 +0000 UTC m=+579.476696320" Jul 17 15:18:49.008608 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:49.008561 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:49.009104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:49.008773 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" podUID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" containerName="limitador" containerID="cri-o://94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33" gracePeriod=30 Jul 17 15:18:49.011378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:49.011354 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:49.961459 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:49.961427 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:50.071359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.071277 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cczfd\" (UniqueName: \"kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd\") pod \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " Jul 17 15:18:50.071736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.071366 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file\") pod \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\" (UID: \"2c5b4ca7-8461-4253-b01f-8ce7b2def686\") " Jul 17 15:18:50.071736 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.071707 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file" (OuterVolumeSpecName: "config-file") pod "2c5b4ca7-8461-4253-b01f-8ce7b2def686" (UID: "2c5b4ca7-8461-4253-b01f-8ce7b2def686"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:18:50.073375 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.073347 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd" (OuterVolumeSpecName: "kube-api-access-cczfd") pod "2c5b4ca7-8461-4253-b01f-8ce7b2def686" (UID: "2c5b4ca7-8461-4253-b01f-8ce7b2def686"). InnerVolumeSpecName "kube-api-access-cczfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:18:50.172005 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.171972 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c5b4ca7-8461-4253-b01f-8ce7b2def686-config-file\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:50.172005 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.172001 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cczfd\" (UniqueName: \"kubernetes.io/projected/2c5b4ca7-8461-4253-b01f-8ce7b2def686-kube-api-access-cczfd\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:18:50.329139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.329056 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" containerID="94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33" exitCode=0 Jul 17 15:18:50.329139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.329100 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" Jul 17 15:18:50.329318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.329100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" event={"ID":"2c5b4ca7-8461-4253-b01f-8ce7b2def686","Type":"ContainerDied","Data":"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33"} Jul 17 15:18:50.329318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.329263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hsbmn" event={"ID":"2c5b4ca7-8461-4253-b01f-8ce7b2def686","Type":"ContainerDied","Data":"e7406833fff6a03243b67a0331ca4658c55429ab0870484ffc9551326651977f"} Jul 17 15:18:50.329318 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.329294 2575 scope.go:117] "RemoveContainer" containerID="94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33" Jul 17 15:18:50.338511 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.338495 2575 scope.go:117] "RemoveContainer" containerID="94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33" Jul 17 15:18:50.338760 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:18:50.338742 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33\": container with ID starting with 94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33 not found: ID does not exist" containerID="94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33" Jul 17 15:18:50.338824 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.338773 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33"} err="failed to get container status \"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33\": rpc error: code = NotFound desc = could not find container \"94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33\": container with ID starting with 94dd6b40016144c458fa9c35102a1cb32b6e127e831b80798c350db651b24c33 not found: ID does not exist" Jul 17 15:18:50.353800 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.353777 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:50.359146 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.359126 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hsbmn"] Jul 17 15:18:50.450426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:18:50.450394 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" path="/var/lib/kubelet/pods/2c5b4ca7-8461-4253-b01f-8ce7b2def686/volumes" Jul 17 15:19:02.324884 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:02.324853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:19:02.325467 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:02.325259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:19:07.470697 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.470649 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2md9k"] Jul 17 15:19:07.471083 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.471070 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" containerName="limitador" Jul 17 15:19:07.471127 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.471084 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" containerName="limitador" Jul 17 15:19:07.471162 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.471154 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5b4ca7-8461-4253-b01f-8ce7b2def686" containerName="limitador" Jul 17 15:19:07.473247 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.473229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:07.482687 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.482666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2md9k"] Jul 17 15:19:07.623129 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.623086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4629l\" (UniqueName: \"kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l\") pod \"authorino-5d4b67c446-2md9k\" (UID: \"d78a6e01-f187-47d8-8f15-4dea0d4efb34\") " pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:07.681691 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.681654 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2md9k"] Jul 17 15:19:07.681958 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:07.681937 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4629l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-2md9k" podUID="d78a6e01-f187-47d8-8f15-4dea0d4efb34" Jul 17 15:19:07.718223 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.718192 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:07.720571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.720553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:07.723699 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.723642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4629l\" (UniqueName: \"kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l\") pod \"authorino-5d4b67c446-2md9k\" (UID: \"d78a6e01-f187-47d8-8f15-4dea0d4efb34\") " pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:07.730890 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.730869 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:07.739257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.739238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4629l\" (UniqueName: \"kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l\") pod \"authorino-5d4b67c446-2md9k\" (UID: \"d78a6e01-f187-47d8-8f15-4dea0d4efb34\") " pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:07.824843 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.824813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7w6\" (UniqueName: \"kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6\") pod \"authorino-58f94d4445-65gfb\" (UID: \"9072ba61-d209-4463-807c-3275efb2de7e\") " pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:07.925637 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.925605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7w6\" (UniqueName: \"kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6\") pod \"authorino-58f94d4445-65gfb\" (UID: \"9072ba61-d209-4463-807c-3275efb2de7e\") " pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:07.935795 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:07.935769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7w6\" (UniqueName: \"kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6\") pod \"authorino-58f94d4445-65gfb\" (UID: \"9072ba61-d209-4463-807c-3275efb2de7e\") " pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:08.013285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.013201 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:08.013497 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.013485 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:08.144970 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.144946 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:08.147032 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:08.146997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9072ba61_d209_4463_807c_3275efb2de7e.slice/crio-d207dfe75c9028d0a4d24b6200912f3891c1a3446874d099c8fbc5c3c25b1b84 WatchSource:0}: Error finding container d207dfe75c9028d0a4d24b6200912f3891c1a3446874d099c8fbc5c3c25b1b84: Status 404 returned error can't find the container with id d207dfe75c9028d0a4d24b6200912f3891c1a3446874d099c8fbc5c3c25b1b84 Jul 17 15:19:08.427403 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.427370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f94d4445-65gfb" event={"ID":"9072ba61-d209-4463-807c-3275efb2de7e","Type":"ContainerStarted","Data":"d207dfe75c9028d0a4d24b6200912f3891c1a3446874d099c8fbc5c3c25b1b84"} Jul 17 15:19:08.427614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.427429 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:08.488174 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.488140 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:08.632862 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.632827 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4629l\" (UniqueName: \"kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l\") pod \"d78a6e01-f187-47d8-8f15-4dea0d4efb34\" (UID: \"d78a6e01-f187-47d8-8f15-4dea0d4efb34\") " Jul 17 15:19:08.634830 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.634802 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l" (OuterVolumeSpecName: "kube-api-access-4629l") pod "d78a6e01-f187-47d8-8f15-4dea0d4efb34" (UID: "d78a6e01-f187-47d8-8f15-4dea0d4efb34"). InnerVolumeSpecName "kube-api-access-4629l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:19:08.733979 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:08.733951 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4629l\" (UniqueName: \"kubernetes.io/projected/d78a6e01-f187-47d8-8f15-4dea0d4efb34-kube-api-access-4629l\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:19:09.434679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.434643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2md9k" Jul 17 15:19:09.434886 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.434673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f94d4445-65gfb" event={"ID":"9072ba61-d209-4463-807c-3275efb2de7e","Type":"ContainerStarted","Data":"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0"} Jul 17 15:19:09.434886 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.434733 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58f94d4445-65gfb" podUID="9072ba61-d209-4463-807c-3275efb2de7e" containerName="authorino" containerID="cri-o://1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0" gracePeriod=30 Jul 17 15:19:09.457716 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.457672 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58f94d4445-65gfb" podStartSLOduration=1.940802371 podStartE2EDuration="2.457658862s" totalImagesPullingTime="516.856491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:09.454669718 +0000 UTC m=+607.616424044" watchObservedRunningTime="2026-07-17 15:19:09.457658862 +0000 UTC m=+607.619413206" Jul 17 15:19:09.480640 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.480615 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2md9k"] Jul 17 15:19:09.485088 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.485066 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2md9k"] Jul 17 15:19:09.731925 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.731889 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:09.843173 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.843135 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c7w6\" (UniqueName: \"kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6\") pod \"9072ba61-d209-4463-807c-3275efb2de7e\" (UID: \"9072ba61-d209-4463-807c-3275efb2de7e\") " Jul 17 15:19:09.845124 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.845097 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6" (OuterVolumeSpecName: "kube-api-access-7c7w6") pod "9072ba61-d209-4463-807c-3275efb2de7e" (UID: "9072ba61-d209-4463-807c-3275efb2de7e"). InnerVolumeSpecName "kube-api-access-7c7w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:19:09.944789 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.944710 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c7w6\" (UniqueName: \"kubernetes.io/projected/9072ba61-d209-4463-807c-3275efb2de7e-kube-api-access-7c7w6\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:19:09.957890 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.957857 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:19:09.958043 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:09.958021 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5d6hs" podUID="5805e1da-2bb4-41a2-8e1f-a996314275fe" containerName="authorino" containerID="cri-o://d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6" gracePeriod=30 Jul 17 15:19:10.240788 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.240762 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:19:10.347589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.347550 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsb9x\" (UniqueName: \"kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x\") pod \"5805e1da-2bb4-41a2-8e1f-a996314275fe\" (UID: \"5805e1da-2bb4-41a2-8e1f-a996314275fe\") " Jul 17 15:19:10.349588 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.349565 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x" (OuterVolumeSpecName: "kube-api-access-dsb9x") pod "5805e1da-2bb4-41a2-8e1f-a996314275fe" (UID: "5805e1da-2bb4-41a2-8e1f-a996314275fe"). InnerVolumeSpecName "kube-api-access-dsb9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:19:10.440884 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.440843 2575 generic.go:356] "Generic (PLEG): container finished" podID="9072ba61-d209-4463-807c-3275efb2de7e" containerID="1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0" exitCode=0 Jul 17 15:19:10.441069 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.440892 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f94d4445-65gfb" Jul 17 15:19:10.441069 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.440915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f94d4445-65gfb" event={"ID":"9072ba61-d209-4463-807c-3275efb2de7e","Type":"ContainerDied","Data":"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0"} Jul 17 15:19:10.441069 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.440956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f94d4445-65gfb" event={"ID":"9072ba61-d209-4463-807c-3275efb2de7e","Type":"ContainerDied","Data":"d207dfe75c9028d0a4d24b6200912f3891c1a3446874d099c8fbc5c3c25b1b84"} Jul 17 15:19:10.441069 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.440976 2575 scope.go:117] "RemoveContainer" containerID="1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0" Jul 17 15:19:10.442396 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.442373 2575 generic.go:356] "Generic (PLEG): container finished" podID="5805e1da-2bb4-41a2-8e1f-a996314275fe" containerID="d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6" exitCode=0 Jul 17 15:19:10.442571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.442415 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5d6hs" Jul 17 15:19:10.442571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.442461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5d6hs" event={"ID":"5805e1da-2bb4-41a2-8e1f-a996314275fe","Type":"ContainerDied","Data":"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6"} Jul 17 15:19:10.442571 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.442508 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5d6hs" event={"ID":"5805e1da-2bb4-41a2-8e1f-a996314275fe","Type":"ContainerDied","Data":"f22530d5a71b0a3c0ddb7fdddf67af1a4ea89562dab3f4d6b2788414d5256b4b"} Jul 17 15:19:10.448165 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.448146 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsb9x\" (UniqueName: \"kubernetes.io/projected/5805e1da-2bb4-41a2-8e1f-a996314275fe-kube-api-access-dsb9x\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:19:10.450607 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.450585 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78a6e01-f187-47d8-8f15-4dea0d4efb34" path="/var/lib/kubelet/pods/d78a6e01-f187-47d8-8f15-4dea0d4efb34/volumes" Jul 17 15:19:10.451678 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.451662 2575 scope.go:117] "RemoveContainer" containerID="1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0" Jul 17 15:19:10.451960 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:10.451926 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0\": container with ID starting with 1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0 not found: ID does not exist" containerID="1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0" Jul 17 15:19:10.452085 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.451970 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0"} err="failed to get container status \"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0\": rpc error: code = NotFound desc = could not find container \"1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0\": container with ID starting with 1b571d44c7b44e1a644e46643f81ac5dc530753c5eeade22be8fd41b484c7da0 not found: ID does not exist" Jul 17 15:19:10.452085 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.451996 2575 scope.go:117] "RemoveContainer" containerID="d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6" Jul 17 15:19:10.460771 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.460753 2575 scope.go:117] "RemoveContainer" containerID="d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6" Jul 17 15:19:10.461014 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:10.460997 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6\": container with ID starting with d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6 not found: ID does not exist" containerID="d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6" Jul 17 15:19:10.461067 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.461021 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6"} err="failed to get container status \"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6\": rpc error: code = NotFound desc = could not find container \"d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6\": container with ID starting with d87b362890bf7b6dedefc4e88aaa2893b8f0ffb13d596f0fae58e013cff672a6 not found: ID does not exist" Jul 17 15:19:10.470997 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.470975 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:19:10.475819 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.475800 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5d6hs"] Jul 17 15:19:10.488782 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.488761 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:10.493247 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:10.493224 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58f94d4445-65gfb"] Jul 17 15:19:12.449075 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:12.449044 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5805e1da-2bb4-41a2-8e1f-a996314275fe" path="/var/lib/kubelet/pods/5805e1da-2bb4-41a2-8e1f-a996314275fe/volumes" Jul 17 15:19:12.449474 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:12.449364 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9072ba61-d209-4463-807c-3275efb2de7e" path="/var/lib/kubelet/pods/9072ba61-d209-4463-807c-3275efb2de7e/volumes" Jul 17 15:19:14.449111 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449077 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449399 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5805e1da-2bb4-41a2-8e1f-a996314275fe" containerName="authorino" Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449409 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5805e1da-2bb4-41a2-8e1f-a996314275fe" containerName="authorino" Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449432 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9072ba61-d209-4463-807c-3275efb2de7e" containerName="authorino" Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449438 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9072ba61-d209-4463-807c-3275efb2de7e" containerName="authorino" Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449516 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9072ba61-d209-4463-807c-3275efb2de7e" containerName="authorino" Jul 17 15:19:14.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.449524 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5805e1da-2bb4-41a2-8e1f-a996314275fe" containerName="authorino" Jul 17 15:19:14.451397 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.451381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.454204 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.454180 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 15:19:14.454340 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.454204 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq24b\"" Jul 17 15:19:14.454340 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.454207 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 15:19:14.463103 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.463072 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:14.587155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.587118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.587326 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.587168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqkg\" (UniqueName: \"kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.632356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.632326 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:19:14.634722 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.634707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:14.647693 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.647670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:19:14.688064 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.688034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqkg\" (UniqueName: \"kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.688203 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.688140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.688256 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:14.688240 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 17 15:19:14.688303 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:14.688297 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert podName:ac75636b-df1d-48b6-bb99-6335b5363045 nodeName:}" failed. No retries permitted until 2026-07-17 15:19:15.188279 +0000 UTC m=+613.350033321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert") pod "maas-controller-5bc7cf685-xwbnr" (UID: "ac75636b-df1d-48b6-bb99-6335b5363045") : secret "maas-controller-webhook-cert" not found Jul 17 15:19:14.697969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.697941 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqkg\" (UniqueName: \"kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:14.788967 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.788878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnfrn\" (UniqueName: \"kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:14.788967 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.788946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:14.890192 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.890146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnfrn\" (UniqueName: \"kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:14.890357 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.890222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:14.890357 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:14.890311 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 17 15:19:14.890357 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:14.890358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert podName:0fd18453-0716-4e71-aa96-ca989ba7cf08 nodeName:}" failed. No retries permitted until 2026-07-17 15:19:15.390344819 +0000 UTC m=+613.552099122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert") pod "maas-controller-5f5df8646b-w7qr2" (UID: "0fd18453-0716-4e71-aa96-ca989ba7cf08") : secret "maas-controller-webhook-cert" not found Jul 17 15:19:14.901843 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:14.901819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnfrn\" (UniqueName: \"kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:15.192969 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.192932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:15.195438 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.195418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") pod \"maas-controller-5bc7cf685-xwbnr\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:15.363021 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.362980 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:15.394405 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.394374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:15.396900 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.396867 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") pod \"maas-controller-5f5df8646b-w7qr2\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:15.497617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.497591 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:15.499212 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:15.499185 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac75636b_df1d_48b6_bb99_6335b5363045.slice/crio-6c457b769cb4b38cd4f7c46cb5d970303fb33de8ddd2eb6497fadf2bd344592a WatchSource:0}: Error finding container 6c457b769cb4b38cd4f7c46cb5d970303fb33de8ddd2eb6497fadf2bd344592a: Status 404 returned error can't find the container with id 6c457b769cb4b38cd4f7c46cb5d970303fb33de8ddd2eb6497fadf2bd344592a Jul 17 15:19:15.500377 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.500360 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:19:15.544665 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.544635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:15.679636 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:15.679605 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:19:15.680643 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:15.680622 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd18453_0716_4e71_aa96_ca989ba7cf08.slice/crio-eef6196de54b6546151cd19b1b75c565b8fd1a853490d7c81cc435d2947fa738 WatchSource:0}: Error finding container eef6196de54b6546151cd19b1b75c565b8fd1a853490d7c81cc435d2947fa738: Status 404 returned error can't find the container with id eef6196de54b6546151cd19b1b75c565b8fd1a853490d7c81cc435d2947fa738 Jul 17 15:19:16.481997 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:16.481916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" event={"ID":"0fd18453-0716-4e71-aa96-ca989ba7cf08","Type":"ContainerStarted","Data":"eef6196de54b6546151cd19b1b75c565b8fd1a853490d7c81cc435d2947fa738"} Jul 17 15:19:16.484849 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:16.484771 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" event={"ID":"ac75636b-df1d-48b6-bb99-6335b5363045","Type":"ContainerStarted","Data":"6c457b769cb4b38cd4f7c46cb5d970303fb33de8ddd2eb6497fadf2bd344592a"} Jul 17 15:19:18.498632 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.498589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" event={"ID":"ac75636b-df1d-48b6-bb99-6335b5363045","Type":"ContainerStarted","Data":"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629"} Jul 17 15:19:18.499104 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.498756 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:18.500014 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.499993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" event={"ID":"0fd18453-0716-4e71-aa96-ca989ba7cf08","Type":"ContainerStarted","Data":"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052"} Jul 17 15:19:18.500128 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.500117 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:18.542742 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.542639 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" podStartSLOduration=1.78152196 podStartE2EDuration="4.542625035s" totalImagesPullingTime="2.761103075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:18.540625484 +0000 UTC m=+616.702379808" watchObservedRunningTime="2026-07-17 15:19:18.542625035 +0000 UTC m=+616.704379363" Jul 17 15:19:18.575729 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:18.575673 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" podStartSLOduration=1.991335643 podStartE2EDuration="4.575655989s" totalImagesPullingTime="2.584320346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:18.575288721 +0000 UTC m=+616.737043046" watchObservedRunningTime="2026-07-17 15:19:18.575655989 +0000 UTC m=+616.737410314" Jul 17 15:19:29.507576 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.507544 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:19:29.508005 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.507710 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:29.580244 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.580213 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:29.580482 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.580433 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" podUID="ac75636b-df1d-48b6-bb99-6335b5363045" containerName="manager" containerID="cri-o://d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629" gracePeriod=30 Jul 17 15:19:29.829380 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.829355 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:29.931013 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.930979 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") pod \"ac75636b-df1d-48b6-bb99-6335b5363045\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " Jul 17 15:19:29.931179 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.931040 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwqkg\" (UniqueName: \"kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg\") pod \"ac75636b-df1d-48b6-bb99-6335b5363045\" (UID: \"ac75636b-df1d-48b6-bb99-6335b5363045\") " Jul 17 15:19:29.933109 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.933074 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg" (OuterVolumeSpecName: "kube-api-access-xwqkg") pod "ac75636b-df1d-48b6-bb99-6335b5363045" (UID: "ac75636b-df1d-48b6-bb99-6335b5363045"). InnerVolumeSpecName "kube-api-access-xwqkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:19:29.933221 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:29.933149 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ac75636b-df1d-48b6-bb99-6335b5363045" (UID: "ac75636b-df1d-48b6-bb99-6335b5363045"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:19:30.032553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.032521 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwqkg\" (UniqueName: \"kubernetes.io/projected/ac75636b-df1d-48b6-bb99-6335b5363045-kube-api-access-xwqkg\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:19:30.032553 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.032548 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac75636b-df1d-48b6-bb99-6335b5363045-webhook-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:19:30.566141 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.566105 2575 generic.go:356] "Generic (PLEG): container finished" podID="ac75636b-df1d-48b6-bb99-6335b5363045" containerID="d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629" exitCode=0 Jul 17 15:19:30.566617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.566162 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" Jul 17 15:19:30.566617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.566189 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" event={"ID":"ac75636b-df1d-48b6-bb99-6335b5363045","Type":"ContainerDied","Data":"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629"} Jul 17 15:19:30.566617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.566243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc7cf685-xwbnr" event={"ID":"ac75636b-df1d-48b6-bb99-6335b5363045","Type":"ContainerDied","Data":"6c457b769cb4b38cd4f7c46cb5d970303fb33de8ddd2eb6497fadf2bd344592a"} Jul 17 15:19:30.566617 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.566265 2575 scope.go:117] "RemoveContainer" containerID="d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629" Jul 17 15:19:30.575136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.575118 2575 scope.go:117] "RemoveContainer" containerID="d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629" Jul 17 15:19:30.575408 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:19:30.575382 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629\": container with ID starting with d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629 not found: ID does not exist" containerID="d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629" Jul 17 15:19:30.575483 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.575416 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629"} err="failed to get container status \"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629\": rpc error: code = NotFound desc = could not find container \"d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629\": container with ID starting with d5e3f8ffb7565ce5978623d76ef7293c71d1f2708d96e9edd7e44dc81ef07629 not found: ID does not exist" Jul 17 15:19:30.586597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.586565 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:30.589133 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:30.589116 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bc7cf685-xwbnr"] Jul 17 15:19:32.450554 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:32.450521 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac75636b-df1d-48b6-bb99-6335b5363045" path="/var/lib/kubelet/pods/ac75636b-df1d-48b6-bb99-6335b5363045/volumes" Jul 17 15:19:49.588514 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.588472 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf"] Jul 17 15:19:49.588944 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.588889 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac75636b-df1d-48b6-bb99-6335b5363045" containerName="manager" Jul 17 15:19:49.588944 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.588902 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac75636b-df1d-48b6-bb99-6335b5363045" containerName="manager" Jul 17 15:19:49.589020 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.588961 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac75636b-df1d-48b6-bb99-6335b5363045" containerName="manager" Jul 17 15:19:49.593565 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.593546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.596294 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.596268 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 17 15:19:49.596421 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.596271 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 15:19:49.596421 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.596277 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 15:19:49.603856 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.603834 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf"] Jul 17 15:19:49.710545 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.710507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6686c41-78a7-49c2-9bd6-809ee043acb5-maas-api-tls\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.710545 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.710545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6686c41-78a7-49c2-9bd6-809ee043acb5-openshift-service-ca\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.710790 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.710572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcjj\" (UniqueName: \"kubernetes.io/projected/f6686c41-78a7-49c2-9bd6-809ee043acb5-kube-api-access-tzcjj\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.811317 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.811282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6686c41-78a7-49c2-9bd6-809ee043acb5-maas-api-tls\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.811545 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.811327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6686c41-78a7-49c2-9bd6-809ee043acb5-openshift-service-ca\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.811545 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.811361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcjj\" (UniqueName: \"kubernetes.io/projected/f6686c41-78a7-49c2-9bd6-809ee043acb5-kube-api-access-tzcjj\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.811993 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.811970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6686c41-78a7-49c2-9bd6-809ee043acb5-openshift-service-ca\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.813833 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.813810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6686c41-78a7-49c2-9bd6-809ee043acb5-maas-api-tls\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.821845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.821817 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcjj\" (UniqueName: \"kubernetes.io/projected/f6686c41-78a7-49c2-9bd6-809ee043acb5-kube-api-access-tzcjj\") pod \"maas-api-6cb4dc4f79-hw2rf\" (UID: \"f6686c41-78a7-49c2-9bd6-809ee043acb5\") " pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:49.905356 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:49.905327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:50.048845 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.048815 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf"] Jul 17 15:19:50.050723 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:50.050688 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6686c41_78a7_49c2_9bd6_809ee043acb5.slice/crio-cc4e73dd3b1b92bd78f6789cb7a3ff5c079f3ce63b4d10b7771f2260ecf9d798 WatchSource:0}: Error finding container cc4e73dd3b1b92bd78f6789cb7a3ff5c079f3ce63b4d10b7771f2260ecf9d798: Status 404 returned error can't find the container with id cc4e73dd3b1b92bd78f6789cb7a3ff5c079f3ce63b4d10b7771f2260ecf9d798 Jul 17 15:19:50.207508 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.207422 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-9rkpt"] Jul 17 15:19:50.212027 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.212010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.214980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.214959 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 15:19:50.215116 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.214981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bqxw2\"" Jul 17 15:19:50.221520 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.221440 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-9rkpt"] Jul 17 15:19:50.262581 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.262546 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jz4cv"] Jul 17 15:19:50.265828 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.265812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.278347 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.278326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jz4cv"] Jul 17 15:19:50.317139 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.317106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqv2w\" (UniqueName: \"kubernetes.io/projected/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-kube-api-access-gqv2w\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.317321 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.317148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be687c9-eb69-4079-9e70-23f0ff7e94b3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.317321 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.317174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2pbf\" (UniqueName: \"kubernetes.io/projected/5be687c9-eb69-4079-9e70-23f0ff7e94b3-kube-api-access-p2pbf\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.317321 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.317226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-plugins-config-volume\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.418365 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.418326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqv2w\" (UniqueName: \"kubernetes.io/projected/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-kube-api-access-gqv2w\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.418365 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.418369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be687c9-eb69-4079-9e70-23f0ff7e94b3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.418643 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.418385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2pbf\" (UniqueName: \"kubernetes.io/projected/5be687c9-eb69-4079-9e70-23f0ff7e94b3-kube-api-access-p2pbf\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.418643 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.418503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-plugins-config-volume\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.419093 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.419074 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be687c9-eb69-4079-9e70-23f0ff7e94b3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.419427 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.419403 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-plugins-config-volume\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.429169 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.429142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqv2w\" (UniqueName: \"kubernetes.io/projected/6c4a55ec-ef40-4d86-a9e9-d116d21c25eb-kube-api-access-gqv2w\") pod \"payload-processing-5bf47cd988-9rkpt\" (UID: \"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb\") " pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.429293 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.429189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2pbf\" (UniqueName: \"kubernetes.io/projected/5be687c9-eb69-4079-9e70-23f0ff7e94b3-kube-api-access-p2pbf\") pod \"payload-pre-processing-7677b774bb-jz4cv\" (UID: \"5be687c9-eb69-4079-9e70-23f0ff7e94b3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.524322 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.524244 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:50.575396 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.575332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:50.677143 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.677101 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-9rkpt"] Jul 17 15:19:50.681580 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.681433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" event={"ID":"f6686c41-78a7-49c2-9bd6-809ee043acb5","Type":"ContainerStarted","Data":"cc4e73dd3b1b92bd78f6789cb7a3ff5c079f3ce63b4d10b7771f2260ecf9d798"} Jul 17 15:19:50.681836 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:50.681805 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4a55ec_ef40_4d86_a9e9_d116d21c25eb.slice/crio-c9363eecae30d151e67a5b733e0a4df9747c7b7de1ca4caa35ae296d045b249c WatchSource:0}: Error finding container c9363eecae30d151e67a5b733e0a4df9747c7b7de1ca4caa35ae296d045b249c: Status 404 returned error can't find the container with id c9363eecae30d151e67a5b733e0a4df9747c7b7de1ca4caa35ae296d045b249c Jul 17 15:19:50.725346 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:50.725318 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jz4cv"] Jul 17 15:19:50.726172 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:19:50.726136 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be687c9_eb69_4079_9e70_23f0ff7e94b3.slice/crio-0c104487ef8f56588a25cc718f65fe1d71820962fa407697f1e00c982790845c WatchSource:0}: Error finding container 0c104487ef8f56588a25cc718f65fe1d71820962fa407697f1e00c982790845c: Status 404 returned error can't find the container with id 0c104487ef8f56588a25cc718f65fe1d71820962fa407697f1e00c982790845c Jul 17 15:19:51.693426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:51.693263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" event={"ID":"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb","Type":"ContainerStarted","Data":"c9363eecae30d151e67a5b733e0a4df9747c7b7de1ca4caa35ae296d045b249c"} Jul 17 15:19:51.695626 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:51.695099 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" event={"ID":"5be687c9-eb69-4079-9e70-23f0ff7e94b3","Type":"ContainerStarted","Data":"0c104487ef8f56588a25cc718f65fe1d71820962fa407697f1e00c982790845c"} Jul 17 15:19:53.707552 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.707488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" event={"ID":"6c4a55ec-ef40-4d86-a9e9-d116d21c25eb","Type":"ContainerStarted","Data":"be5e21eedacaf70063bdee62d9d2389ab5cea9714f9733a9d31470f1c102e3a2"} Jul 17 15:19:53.707991 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.707690 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:19:53.709007 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.708982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" event={"ID":"f6686c41-78a7-49c2-9bd6-809ee043acb5","Type":"ContainerStarted","Data":"33dbfb7b6ffdeba7cc815aba4e3c7401452fc584c1cb13acf76aeadd5a040a3f"} Jul 17 15:19:53.709145 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.709075 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:53.710367 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.710346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" event={"ID":"5be687c9-eb69-4079-9e70-23f0ff7e94b3","Type":"ContainerStarted","Data":"7e20aa890cb1aa9edd7c22f43eef9a94a603ed756fa8c5309213326a85b2d908"} Jul 17 15:19:53.710499 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.710395 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:19:53.726967 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.726930 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" podStartSLOduration=1.2720168539999999 podStartE2EDuration="3.726918175s" totalImagesPullingTime="2.454901321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:53.723884432 +0000 UTC m=+651.885638758" watchObservedRunningTime="2026-07-17 15:19:53.726918175 +0000 UTC m=+651.888672544" Jul 17 15:19:53.814219 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.814164 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" podStartSLOduration=1.727088188 podStartE2EDuration="4.814140336s" totalImagesPullingTime="3.087052148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:53.813108648 +0000 UTC m=+651.974862975" watchObservedRunningTime="2026-07-17 15:19:53.814140336 +0000 UTC m=+651.975895104" Jul 17 15:19:53.816026 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:53.815994 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" podStartSLOduration=1.371014805 podStartE2EDuration="3.815984554s" totalImagesPullingTime="2.444969749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:19:53.762320487 +0000 UTC m=+651.924074812" watchObservedRunningTime="2026-07-17 15:19:53.815984554 +0000 UTC m=+651.977738878" Jul 17 15:19:58.742137 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.742106 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d496021-ffc6-4bda-ba06-8ab990949d7c" containerID="899298b58c8ee81e3d9d08cea875f6608560616fcae1ea541b79441a7473e742" exitCode=0 Jul 17 15:19:58.742589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.742190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" event={"ID":"0d496021-ffc6-4bda-ba06-8ab990949d7c","Type":"ContainerDied","Data":"899298b58c8ee81e3d9d08cea875f6608560616fcae1ea541b79441a7473e742"} Jul 17 15:19:58.742638 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.742617 2575 scope.go:117] "RemoveContainer" containerID="899298b58c8ee81e3d9d08cea875f6608560616fcae1ea541b79441a7473e742" Jul 17 15:19:58.743627 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.743597 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:19:58.743755 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.743678 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:19:58.743755 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:58.743729 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 15:19:59.721798 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:59.721769 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6cb4dc4f79-hw2rf" Jul 17 15:19:59.755628 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:19:59.754744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" event={"ID":"0d496021-ffc6-4bda-ba06-8ab990949d7c","Type":"ContainerStarted","Data":"44ec909c2baba1a3bbb8ae5301a9c09b84a3fb54d8fb6bc9d9f417661e9c6b6f"} Jul 17 15:20:00.534433 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:00.534402 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:20:00.535349 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:00.535325 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nqz5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 15:20:00.535484 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:00.535370 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" podUID="0d496021-ffc6-4bda-ba06-8ab990949d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 15:20:01.534755 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:01.534713 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nqz5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 15:20:01.535236 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:01.534774 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" podUID="0d496021-ffc6-4bda-ba06-8ab990949d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 15:20:02.534166 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:02.534125 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nqz5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 15:20:02.534353 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:02.534203 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" podUID="0d496021-ffc6-4bda-ba06-8ab990949d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 15:20:03.222277 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:03.222223 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:20:03.534912 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:03.534825 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nqz5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 15:20:03.534912 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:03.534889 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" podUID="0d496021-ffc6-4bda-ba06-8ab990949d7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 15:20:04.538426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:04.538393 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:20:04.539679 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:04.539654 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nqz5s" Jul 17 15:20:04.719162 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:04.719134 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jz4cv" Jul 17 15:20:04.719359 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:04.719213 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-9rkpt" Jul 17 15:20:08.716790 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.716761 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt"] Jul 17 15:20:08.719547 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.719522 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.722346 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.722322 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 15:20:08.723434 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.723410 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 15:20:08.723547 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.723414 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 17 15:20:08.723547 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.723465 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fwpbb\"" Jul 17 15:20:08.734558 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.734537 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt"] Jul 17 15:20:08.817857 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.817822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.818053 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.817897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.818053 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.817933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fggnv\" (UniqueName: \"kubernetes.io/projected/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-kube-api-access-fggnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.818188 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.818161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.818302 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.818284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.818378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.818336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919515 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919670 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fggnv\" (UniqueName: \"kubernetes.io/projected/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-kube-api-access-fggnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919702 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.919989 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.919956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.920037 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.920018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.920080 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.920049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.921760 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.921740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.922022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.922005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:08.929794 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:08.929769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fggnv\" (UniqueName: \"kubernetes.io/projected/40395eb6-3f7c-477d-9bcf-e69bc9d5220d-kube-api-access-fggnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt\" (UID: \"40395eb6-3f7c-477d-9bcf-e69bc9d5220d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:09.030370 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:09.030281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:09.167704 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:09.167676 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt"] Jul 17 15:20:09.171503 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:20:09.171418 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40395eb6_3f7c_477d_9bcf_e69bc9d5220d.slice/crio-b97017d6c0873ca6cb9b943d036321c4ae546d5a02ca5f70d2d73bef1b11a13b WatchSource:0}: Error finding container b97017d6c0873ca6cb9b943d036321c4ae546d5a02ca5f70d2d73bef1b11a13b: Status 404 returned error can't find the container with id b97017d6c0873ca6cb9b943d036321c4ae546d5a02ca5f70d2d73bef1b11a13b Jul 17 15:20:09.820601 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:09.820562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" event={"ID":"40395eb6-3f7c-477d-9bcf-e69bc9d5220d","Type":"ContainerStarted","Data":"b97017d6c0873ca6cb9b943d036321c4ae546d5a02ca5f70d2d73bef1b11a13b"} Jul 17 15:20:10.827096 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:10.827058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" event={"ID":"40395eb6-3f7c-477d-9bcf-e69bc9d5220d","Type":"ContainerStarted","Data":"591b994bfe1f8259c9adfff47b7db637af1a24d84a4d528c3e3cfc49b6b99ff3"} Jul 17 15:20:10.850769 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:10.850721 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" podStartSLOduration=1.685210576 podStartE2EDuration="2.850704909s" totalImagesPullingTime="1.165494333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:20:10.849030995 +0000 UTC m=+669.010785321" watchObservedRunningTime="2026-07-17 15:20:10.850704909 +0000 UTC m=+669.012459234" Jul 17 15:20:19.031071 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:19.031039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:19.031555 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:19.031185 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:19.043510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:19.043489 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:19.887182 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:19.887152 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt" Jul 17 15:20:40.214499 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.214440 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4"] Jul 17 15:20:40.218179 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.218150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.221022 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.221003 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 15:20:40.229854 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.229829 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4"] Jul 17 15:20:40.305179 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npglj\" (UniqueName: \"kubernetes.io/projected/2d00835d-5d59-426e-8d6b-83e11593658d-kube-api-access-npglj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.305179 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.305423 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.305423 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.305423 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.305597 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.305513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d00835d-5d59-426e-8d6b-83e11593658d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.406800 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d00835d-5d59-426e-8d6b-83e11593658d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npglj\" (UniqueName: \"kubernetes.io/projected/2d00835d-5d59-426e-8d6b-83e11593658d-kube-api-access-npglj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407008 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.406957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407349 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.407328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407411 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.407393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.407510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.407472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.409175 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.409153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d00835d-5d59-426e-8d6b-83e11593658d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.409494 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.409469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d00835d-5d59-426e-8d6b-83e11593658d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.415601 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.415579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npglj\" (UniqueName: \"kubernetes.io/projected/2d00835d-5d59-426e-8d6b-83e11593658d-kube-api-access-npglj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gld4\" (UID: \"2d00835d-5d59-426e-8d6b-83e11593658d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.529478 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.529363 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:40.668086 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.668049 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4"] Jul 17 15:20:40.669367 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:20:40.669341 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d00835d_5d59_426e_8d6b_83e11593658d.slice/crio-eb37f6f1bab3af9360f3f25e4748879d793c1db62e9f582a3d8ff1755c432683 WatchSource:0}: Error finding container eb37f6f1bab3af9360f3f25e4748879d793c1db62e9f582a3d8ff1755c432683: Status 404 returned error can't find the container with id eb37f6f1bab3af9360f3f25e4748879d793c1db62e9f582a3d8ff1755c432683 Jul 17 15:20:40.996747 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:40.996708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" event={"ID":"2d00835d-5d59-426e-8d6b-83e11593658d","Type":"ContainerStarted","Data":"eb37f6f1bab3af9360f3f25e4748879d793c1db62e9f582a3d8ff1755c432683"} Jul 17 15:20:43.010036 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:43.010001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" event={"ID":"2d00835d-5d59-426e-8d6b-83e11593658d","Type":"ContainerStarted","Data":"f7becf38156f45c930e2a595d21c0d09ec9cade828f6159c152dd18ff46989b1"} Jul 17 15:20:43.031833 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:43.031781 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" podStartSLOduration=1.078588479 podStartE2EDuration="3.031758854s" totalImagesPullingTime="1.953170375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:20:43.02965641 +0000 UTC m=+701.191410760" watchObservedRunningTime="2026-07-17 15:20:43.031758854 +0000 UTC m=+701.193513178" Jul 17 15:20:50.530337 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:50.530305 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:50.530819 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:50.530359 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:50.543038 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:50.543008 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:51.065340 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:51.065313 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gld4" Jul 17 15:20:56.016171 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.016089 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w"] Jul 17 15:20:56.018723 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.018706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.022077 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.022056 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 17 15:20:56.030072 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.030047 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w"] Jul 17 15:20:56.053723 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl9bw\" (UniqueName: \"kubernetes.io/projected/4f42d92f-bc1f-46cb-89a7-933e83471ee1-kube-api-access-pl9bw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.053905 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.053905 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.053905 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.054050 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.054050 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.053984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155083 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl9bw\" (UniqueName: \"kubernetes.io/projected/4f42d92f-bc1f-46cb-89a7-933e83471ee1-kube-api-access-pl9bw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155640 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155713 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.155763 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.155715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.157366 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.157349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f42d92f-bc1f-46cb-89a7-933e83471ee1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.157739 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.157722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f42d92f-bc1f-46cb-89a7-933e83471ee1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.165173 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.165149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl9bw\" (UniqueName: \"kubernetes.io/projected/4f42d92f-bc1f-46cb-89a7-933e83471ee1-kube-api-access-pl9bw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-znw5w\" (UID: \"4f42d92f-bc1f-46cb-89a7-933e83471ee1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.329222 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.329127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:20:56.476300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:56.476274 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w"] Jul 17 15:20:56.478418 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:20:56.478393 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f42d92f_bc1f_46cb_89a7_933e83471ee1.slice/crio-75d6dab68e4aa809c9d5a4ae2a36d06a80c6b8bcf3e89faeda898a567bce6f88 WatchSource:0}: Error finding container 75d6dab68e4aa809c9d5a4ae2a36d06a80c6b8bcf3e89faeda898a567bce6f88: Status 404 returned error can't find the container with id 75d6dab68e4aa809c9d5a4ae2a36d06a80c6b8bcf3e89faeda898a567bce6f88 Jul 17 15:20:57.088725 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:57.088611 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" event={"ID":"4f42d92f-bc1f-46cb-89a7-933e83471ee1","Type":"ContainerStarted","Data":"0acc6797ec3e6296cb13ae065269192fa4d4dc3595bf7cc494e5c7a927f3eda6"} Jul 17 15:20:57.089088 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:57.088721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" event={"ID":"4f42d92f-bc1f-46cb-89a7-933e83471ee1","Type":"ContainerStarted","Data":"75d6dab68e4aa809c9d5a4ae2a36d06a80c6b8bcf3e89faeda898a567bce6f88"} Jul 17 15:20:57.111949 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:20:57.111892 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" podStartSLOduration=1.8981397800000002 podStartE2EDuration="2.111875221s" totalImagesPullingTime="213.735441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:20:57.110070974 +0000 UTC m=+715.271825333" watchObservedRunningTime="2026-07-17 15:20:57.111875221 +0000 UTC m=+715.273629545" Jul 17 15:21:06.329355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:21:06.329313 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:21:06.329868 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:21:06.329383 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:21:06.342000 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:21:06.341975 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:21:07.156458 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:21:07.156419 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-znw5w" Jul 17 15:22:14.082415 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.082376 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd9766896-jk9jw"] Jul 17 15:22:14.086253 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.086225 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.090803 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.090778 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2pp5v\"" Jul 17 15:22:14.090980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.090864 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 15:22:14.094720 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.094696 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd9766896-jk9jw"] Jul 17 15:22:14.107150 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.107125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99033c3c-fa06-4fa1-8e34-e90de00b63f5-tls-cert\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.107283 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.107169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxc2\" (UniqueName: \"kubernetes.io/projected/99033c3c-fa06-4fa1-8e34-e90de00b63f5-kube-api-access-4dxc2\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.208274 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.208240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99033c3c-fa06-4fa1-8e34-e90de00b63f5-tls-cert\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.208484 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.208283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxc2\" (UniqueName: \"kubernetes.io/projected/99033c3c-fa06-4fa1-8e34-e90de00b63f5-kube-api-access-4dxc2\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.210627 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.210605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99033c3c-fa06-4fa1-8e34-e90de00b63f5-tls-cert\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.223641 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.223620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxc2\" (UniqueName: \"kubernetes.io/projected/99033c3c-fa06-4fa1-8e34-e90de00b63f5-kube-api-access-4dxc2\") pod \"authorino-5dd9766896-jk9jw\" (UID: \"99033c3c-fa06-4fa1-8e34-e90de00b63f5\") " pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.397630 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.397591 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd9766896-jk9jw" Jul 17 15:22:14.534811 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:14.534787 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd9766896-jk9jw"] Jul 17 15:22:14.536160 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:22:14.536135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99033c3c_fa06_4fa1_8e34_e90de00b63f5.slice/crio-479593f996ef95b27a0436625cfa7ffd92b61905ce00c10d2f6674c29caa69e1 WatchSource:0}: Error finding container 479593f996ef95b27a0436625cfa7ffd92b61905ce00c10d2f6674c29caa69e1: Status 404 returned error can't find the container with id 479593f996ef95b27a0436625cfa7ffd92b61905ce00c10d2f6674c29caa69e1 Jul 17 15:22:15.522369 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:15.522327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd9766896-jk9jw" event={"ID":"99033c3c-fa06-4fa1-8e34-e90de00b63f5","Type":"ContainerStarted","Data":"949a96f233196a5faf432c279285e218bf820e74f90f4d80335b14640cfedba8"} Jul 17 15:22:15.522836 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:15.522381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd9766896-jk9jw" event={"ID":"99033c3c-fa06-4fa1-8e34-e90de00b63f5","Type":"ContainerStarted","Data":"479593f996ef95b27a0436625cfa7ffd92b61905ce00c10d2f6674c29caa69e1"} Jul 17 15:22:15.544096 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:15.544031 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dd9766896-jk9jw" podStartSLOduration=1.121985077 podStartE2EDuration="1.544013647s" totalImagesPullingTime="422.02857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:22:15.541545904 +0000 UTC m=+793.703300244" watchObservedRunningTime="2026-07-17 15:22:15.544013647 +0000 UTC m=+793.705767972" Jul 17 15:22:59.031558 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:22:59.031522 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:23:00.127809 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.127765 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:23:00.128233 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.128023 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" podUID="0fd18453-0716-4e71-aa96-ca989ba7cf08" containerName="manager" containerID="cri-o://3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052" gracePeriod=30 Jul 17 15:23:00.397685 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.397661 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:23:00.462944 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.462908 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnfrn\" (UniqueName: \"kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn\") pod \"0fd18453-0716-4e71-aa96-ca989ba7cf08\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " Jul 17 15:23:00.463114 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.462969 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") pod \"0fd18453-0716-4e71-aa96-ca989ba7cf08\" (UID: \"0fd18453-0716-4e71-aa96-ca989ba7cf08\") " Jul 17 15:23:00.464965 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.464933 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0fd18453-0716-4e71-aa96-ca989ba7cf08" (UID: "0fd18453-0716-4e71-aa96-ca989ba7cf08"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:23:00.465184 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.465163 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn" (OuterVolumeSpecName: "kube-api-access-pnfrn") pod "0fd18453-0716-4e71-aa96-ca989ba7cf08" (UID: "0fd18453-0716-4e71-aa96-ca989ba7cf08"). InnerVolumeSpecName "kube-api-access-pnfrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:23:00.563986 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.563940 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnfrn\" (UniqueName: \"kubernetes.io/projected/0fd18453-0716-4e71-aa96-ca989ba7cf08-kube-api-access-pnfrn\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:00.563986 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.563977 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fd18453-0716-4e71-aa96-ca989ba7cf08-webhook-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:00.791492 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.791437 2575 generic.go:356] "Generic (PLEG): container finished" podID="0fd18453-0716-4e71-aa96-ca989ba7cf08" containerID="3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052" exitCode=0 Jul 17 15:23:00.791492 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.791485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" event={"ID":"0fd18453-0716-4e71-aa96-ca989ba7cf08","Type":"ContainerDied","Data":"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052"} Jul 17 15:23:00.791721 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.791543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" event={"ID":"0fd18453-0716-4e71-aa96-ca989ba7cf08","Type":"ContainerDied","Data":"eef6196de54b6546151cd19b1b75c565b8fd1a853490d7c81cc435d2947fa738"} Jul 17 15:23:00.791721 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.791565 2575 scope.go:117] "RemoveContainer" containerID="3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052" Jul 17 15:23:00.791721 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.791494 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-w7qr2" Jul 17 15:23:00.801041 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.801019 2575 scope.go:117] "RemoveContainer" containerID="3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052" Jul 17 15:23:00.801297 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:23:00.801279 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052\": container with ID starting with 3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052 not found: ID does not exist" containerID="3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052" Jul 17 15:23:00.801346 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.801308 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052"} err="failed to get container status \"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052\": rpc error: code = NotFound desc = could not find container \"3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052\": container with ID starting with 3aeb109737e683df9873827d28478c252d450f0d8eb5d184c0fd6c7e5fddc052 not found: ID does not exist" Jul 17 15:23:00.818894 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.818858 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:23:00.828624 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:00.828587 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-w7qr2"] Jul 17 15:23:02.449858 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:02.449826 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd18453-0716-4e71-aa96-ca989ba7cf08" path="/var/lib/kubelet/pods/0fd18453-0716-4e71-aa96-ca989ba7cf08/volumes" Jul 17 15:23:24.053891 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.053856 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66d8455559-2d29b" podUID="4fc1e516-097a-4e26-b8ad-9ceee236726d" containerName="console" containerID="cri-o://d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16" gracePeriod=15 Jul 17 15:23:24.317891 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.317818 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:23:24.399426 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399393 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399631 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399432 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fpxw\" (UniqueName: \"kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399631 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399493 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399631 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399515 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399697 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399859 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399829 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399859 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399838 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:23:24.399957 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399865 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config\") pod \"4fc1e516-097a-4e26-b8ad-9ceee236726d\" (UID: \"4fc1e516-097a-4e26-b8ad-9ceee236726d\") " Jul 17 15:23:24.399957 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.399947 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca" (OuterVolumeSpecName: "service-ca") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:23:24.400055 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.400029 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:23:24.400257 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.400237 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-trusted-ca-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.400329 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.400260 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-service-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.400329 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.400269 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-oauth-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.400402 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.400347 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config" (OuterVolumeSpecName: "console-config") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 15:23:24.401918 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.401896 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:23:24.402184 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.402156 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw" (OuterVolumeSpecName: "kube-api-access-5fpxw") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "kube-api-access-5fpxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:23:24.402184 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.402152 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4fc1e516-097a-4e26-b8ad-9ceee236726d" (UID: "4fc1e516-097a-4e26-b8ad-9ceee236726d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:23:24.501589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.501559 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.501589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.501586 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.501589 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.501595 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fc1e516-097a-4e26-b8ad-9ceee236726d-console-oauth-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.501812 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.501605 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fpxw\" (UniqueName: \"kubernetes.io/projected/4fc1e516-097a-4e26-b8ad-9ceee236726d-kube-api-access-5fpxw\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:23:24.939548 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.939510 2575 generic.go:356] "Generic (PLEG): container finished" podID="4fc1e516-097a-4e26-b8ad-9ceee236726d" containerID="d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16" exitCode=0 Jul 17 15:23:24.939548 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.939556 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8455559-2d29b" Jul 17 15:23:24.939766 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.939588 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8455559-2d29b" event={"ID":"4fc1e516-097a-4e26-b8ad-9ceee236726d","Type":"ContainerDied","Data":"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16"} Jul 17 15:23:24.939766 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.939638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8455559-2d29b" event={"ID":"4fc1e516-097a-4e26-b8ad-9ceee236726d","Type":"ContainerDied","Data":"cad2ed2bacd5d23739d55eee4bc119c58e8cfab1b1080938fc394e41675e81b5"} Jul 17 15:23:24.939766 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.939658 2575 scope.go:117] "RemoveContainer" containerID="d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16" Jul 17 15:23:24.950491 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.950432 2575 scope.go:117] "RemoveContainer" containerID="d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16" Jul 17 15:23:24.950749 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:23:24.950725 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16\": container with ID starting with d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16 not found: ID does not exist" containerID="d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16" Jul 17 15:23:24.950807 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.950756 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16"} err="failed to get container status \"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16\": rpc error: code = NotFound desc = could not find container \"d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16\": container with ID starting with d5a237227ec4fd3557b6c4fceafa9f56eaf9825ca37a93d37fbd2048066d7b16 not found: ID does not exist" Jul 17 15:23:24.965655 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.965633 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:23:24.971155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:24.971134 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66d8455559-2d29b"] Jul 17 15:23:26.450136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:23:26.450101 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc1e516-097a-4e26-b8ad-9ceee236726d" path="/var/lib/kubelet/pods/4fc1e516-097a-4e26-b8ad-9ceee236726d/volumes" Jul 17 15:24:01.587168 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587088 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587497 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc1e516-097a-4e26-b8ad-9ceee236726d" containerName="console" Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587508 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc1e516-097a-4e26-b8ad-9ceee236726d" containerName="console" Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587530 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd18453-0716-4e71-aa96-ca989ba7cf08" containerName="manager" Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587535 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd18453-0716-4e71-aa96-ca989ba7cf08" containerName="manager" Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587599 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc1e516-097a-4e26-b8ad-9ceee236726d" containerName="console" Jul 17 15:24:01.587657 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.587608 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd18453-0716-4e71-aa96-ca989ba7cf08" containerName="manager" Jul 17 15:24:01.590704 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.590683 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.594395 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.594374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 15:24:01.594587 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.594374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq24b\"" Jul 17 15:24:01.594587 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.594398 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 15:24:01.602094 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.602066 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:01.762510 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.762437 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6jm\" (UniqueName: \"kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.762694 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.762575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.863378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.863289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6jm\" (UniqueName: \"kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.863378 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.863374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.865863 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.865835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.874639 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.874614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6jm\" (UniqueName: \"kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm\") pod \"maas-controller-5f5df8646b-55cjg\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:01.920929 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:01.920901 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:02.065529 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:02.065496 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:02.066654 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:24:02.066630 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a5d3ce1_c8e0_411b_8c29_e725be4aa5f3.slice/crio-9d1feaba53685b56bb74bfc713ef7a16111408eaafaa49ed17a77732a93c4659 WatchSource:0}: Error finding container 9d1feaba53685b56bb74bfc713ef7a16111408eaafaa49ed17a77732a93c4659: Status 404 returned error can't find the container with id 9d1feaba53685b56bb74bfc713ef7a16111408eaafaa49ed17a77732a93c4659 Jul 17 15:24:02.153170 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:02.153137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-55cjg" event={"ID":"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3","Type":"ContainerStarted","Data":"9d1feaba53685b56bb74bfc713ef7a16111408eaafaa49ed17a77732a93c4659"} Jul 17 15:24:02.362434 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:02.362401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:24:02.363738 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:02.363718 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:24:02.561680 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:02.561652 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 15:24:03.161285 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:03.161248 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-55cjg" event={"ID":"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3","Type":"ContainerStarted","Data":"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b"} Jul 17 15:24:03.161771 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:03.161367 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:03.180355 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:03.180294 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5df8646b-55cjg" podStartSLOduration=1.689569012 podStartE2EDuration="2.180277289s" totalImagesPullingTime="490.708277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:24:03.179859149 +0000 UTC m=+901.341613475" watchObservedRunningTime="2026-07-17 15:24:03.180277289 +0000 UTC m=+901.342031614" Jul 17 15:24:14.169384 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:14.169350 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:18.834194 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:18.834157 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:18.834724 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:18.834398 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f5df8646b-55cjg" podUID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" containerName="manager" containerID="cri-o://3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b" gracePeriod=30 Jul 17 15:24:19.084780 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.084720 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:19.122804 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.122778 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert\") pod \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " Jul 17 15:24:19.122980 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.122822 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk6jm\" (UniqueName: \"kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm\") pod \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\" (UID: \"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3\") " Jul 17 15:24:19.124773 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.124746 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" (UID: "0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 15:24:19.125230 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.125197 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm" (OuterVolumeSpecName: "kube-api-access-gk6jm") pod "0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" (UID: "0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3"). InnerVolumeSpecName "kube-api-access-gk6jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 15:24:19.223956 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.223923 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-webhook-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:24:19.223956 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.223951 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk6jm\" (UniqueName: \"kubernetes.io/projected/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3-kube-api-access-gk6jm\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 15:24:19.252083 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.252048 2575 generic.go:356] "Generic (PLEG): container finished" podID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" containerID="3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b" exitCode=0 Jul 17 15:24:19.252218 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.252100 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-55cjg" Jul 17 15:24:19.252218 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.252104 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-55cjg" event={"ID":"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3","Type":"ContainerDied","Data":"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b"} Jul 17 15:24:19.252218 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.252197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-55cjg" event={"ID":"0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3","Type":"ContainerDied","Data":"9d1feaba53685b56bb74bfc713ef7a16111408eaafaa49ed17a77732a93c4659"} Jul 17 15:24:19.252353 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.252220 2575 scope.go:117] "RemoveContainer" containerID="3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b" Jul 17 15:24:19.262129 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.262111 2575 scope.go:117] "RemoveContainer" containerID="3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b" Jul 17 15:24:19.262400 ip-10-0-140-166 kubenswrapper[2575]: E0717 15:24:19.262378 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b\": container with ID starting with 3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b not found: ID does not exist" containerID="3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b" Jul 17 15:24:19.262535 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.262412 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b"} err="failed to get container status \"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b\": rpc error: code = NotFound desc = could not find container \"3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b\": container with ID starting with 3675f5022c47930a95f83cbd19376d389f4fead368c3f17bdb7b317aeeccec8b not found: ID does not exist" Jul 17 15:24:19.277463 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.277428 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:19.284883 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:19.284862 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-55cjg"] Jul 17 15:24:20.063003 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.062964 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5df8646b-65fw9"] Jul 17 15:24:20.063404 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.063377 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" containerName="manager" Jul 17 15:24:20.063404 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.063390 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" containerName="manager" Jul 17 15:24:20.063526 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.063472 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" containerName="manager" Jul 17 15:24:20.067859 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.067843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.070782 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.070760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq24b\"" Jul 17 15:24:20.070909 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.070875 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 15:24:20.071024 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.071007 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 15:24:20.080508 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.080480 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-65fw9"] Jul 17 15:24:20.132722 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.132685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmz6\" (UniqueName: \"kubernetes.io/projected/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-kube-api-access-mmmz6\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.132899 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.132742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-webhook-cert\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.233869 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.233829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmz6\" (UniqueName: \"kubernetes.io/projected/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-kube-api-access-mmmz6\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.234050 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.233895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-webhook-cert\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.236287 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.236265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-webhook-cert\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.245237 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.245215 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmz6\" (UniqueName: \"kubernetes.io/projected/f38f70d0-6a6f-443d-a8b1-0178f7f575b7-kube-api-access-mmmz6\") pod \"maas-controller-5f5df8646b-65fw9\" (UID: \"f38f70d0-6a6f-443d-a8b1-0178f7f575b7\") " pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.379927 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.379833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:20.449962 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.449931 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3" path="/var/lib/kubelet/pods/0a5d3ce1-c8e0-411b-8c29-e725be4aa5f3/volumes" Jul 17 15:24:20.515207 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.515178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5df8646b-65fw9"] Jul 17 15:24:20.516182 ip-10-0-140-166 kubenswrapper[2575]: W0717 15:24:20.516154 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38f70d0_6a6f_443d_a8b1_0178f7f575b7.slice/crio-f4fb5fa45bd4efc9220c4ecd4e4d8fdf7ae2c5ce0bdfb1774f5ac64de4b873f3 WatchSource:0}: Error finding container f4fb5fa45bd4efc9220c4ecd4e4d8fdf7ae2c5ce0bdfb1774f5ac64de4b873f3: Status 404 returned error can't find the container with id f4fb5fa45bd4efc9220c4ecd4e4d8fdf7ae2c5ce0bdfb1774f5ac64de4b873f3 Jul 17 15:24:20.517440 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:20.517423 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 15:24:21.267187 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:21.267144 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-65fw9" event={"ID":"f38f70d0-6a6f-443d-a8b1-0178f7f575b7","Type":"ContainerStarted","Data":"e9d711949322d17983039159408a6df9a5e11c0684e56fb0b461fe0127fa7808"} Jul 17 15:24:21.267593 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:21.267204 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:24:21.267593 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:21.267221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5df8646b-65fw9" event={"ID":"f38f70d0-6a6f-443d-a8b1-0178f7f575b7","Type":"ContainerStarted","Data":"f4fb5fa45bd4efc9220c4ecd4e4d8fdf7ae2c5ce0bdfb1774f5ac64de4b873f3"} Jul 17 15:24:21.292295 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:21.292246 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5df8646b-65fw9" podStartSLOduration=0.920289726 podStartE2EDuration="1.292231639s" totalImagesPullingTime="371.941913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:24:21.290188666 +0000 UTC m=+919.451943020" watchObservedRunningTime="2026-07-17 15:24:21.292231639 +0000 UTC m=+919.453985964" Jul 17 15:24:32.275534 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:24:32.275504 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5df8646b-65fw9" Jul 17 15:29:02.401300 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:29:02.401266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:29:02.403951 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:29:02.403920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:34:02.440953 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:34:02.440921 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:34:02.460681 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:34:02.460654 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:39:02.485885 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:39:02.485861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:39:02.500136 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:39:02.500113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:44:02.526148 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:44:02.526119 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:44:02.539715 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:44:02.539693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:49:02.566614 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:49:02.566585 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:49:02.582155 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:49:02.582127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:54:02.607505 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:54:02.607424 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:54:02.622256 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:54:02.622231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:59:02.646539 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:59:02.646506 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 15:59:02.661135 ip-10-0-140-166 kubenswrapper[2575]: I0717 15:59:02.661108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 16:00:00.143615 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.143536 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq"] Jul 17 16:00:00.146749 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.146731 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" Jul 17 16:00:00.149591 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.149569 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\"" Jul 17 16:00:00.157386 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.157357 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" Jul 17 16:00:00.157968 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.157945 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq"] Jul 17 16:00:00.300686 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.300652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq"] Jul 17 16:00:00.301653 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:00.301621 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fa6053_d6cd_4a4a_86d4_faa2ea0f954a.slice/crio-1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962 WatchSource:0}: Error finding container 1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962: Status 404 returned error can't find the container with id 1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962 Jul 17 16:00:00.303642 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.303623 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 16:00:00.324508 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.324480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" event={"ID":"26fa6053-d6cd-4a4a-86d4-faa2ea0f954a","Type":"ContainerStarted","Data":"1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962"} Jul 17 16:00:00.727233 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.727198 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926943219760"] Jul 17 16:00:00.732067 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.732051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:00.735121 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.735089 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wwtdb\"" Jul 17 16:00:00.738346 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.738323 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926943219760"] Jul 17 16:00:00.850953 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.850922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gpc\" (UniqueName: \"kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc\") pod \"test-curl-7290-139926943219760\" (UID: \"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6\") " pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:00.951720 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.951687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gpc\" (UniqueName: \"kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc\") pod \"test-curl-7290-139926943219760\" (UID: \"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6\") " pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:00.961055 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:00.961029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gpc\" (UniqueName: \"kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc\") pod \"test-curl-7290-139926943219760\" (UID: \"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6\") " pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:01.043294 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:01.043200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:01.178392 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:01.178366 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926943219760"] Jul 17 16:00:01.179425 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:01.179402 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9374d4f4_3a7a_4f4a_b003_3ab3001f9eb6.slice/crio-3be8a7720db3248a757350679281da2a9cef9d7e14c2a90cb9631c06589af69f WatchSource:0}: Error finding container 3be8a7720db3248a757350679281da2a9cef9d7e14c2a90cb9631c06589af69f: Status 404 returned error can't find the container with id 3be8a7720db3248a757350679281da2a9cef9d7e14c2a90cb9631c06589af69f Jul 17 16:00:01.330972 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:01.330885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926943219760" event={"ID":"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6","Type":"ContainerStarted","Data":"3be8a7720db3248a757350679281da2a9cef9d7e14c2a90cb9631c06589af69f"} Jul 17 16:00:03.346478 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:03.346380 2575 generic.go:356] "Generic (PLEG): container finished" podID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" containerID="3a12904c81828e8d9fe8a9c6e1537f2bbd8076b85925a5c0944e2f401bb1b493" exitCode=0 Jul 17 16:00:03.346830 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:03.346482 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926943219760" event={"ID":"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6","Type":"ContainerDied","Data":"3a12904c81828e8d9fe8a9c6e1537f2bbd8076b85925a5c0944e2f401bb1b493"} Jul 17 16:00:04.489668 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.489646 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:04.532143 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.532113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926943219760_9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6/test-curl-7290-139926943219760/0.log" Jul 17 16:00:04.557497 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.557470 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926943219760"] Jul 17 16:00:04.563136 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.563116 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926943219760"] Jul 17 16:00:04.585963 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.585941 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7gpc\" (UniqueName: \"kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc\") pod \"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6\" (UID: \"9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6\") " Jul 17 16:00:04.587910 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.587891 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc" (OuterVolumeSpecName: "kube-api-access-m7gpc") pod "9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" (UID: "9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6"). InnerVolumeSpecName "kube-api-access-m7gpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:04.679097 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.679062 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926943187632"] Jul 17 16:00:04.679580 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.679561 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" containerName="test-curl-7290-139926943219760" Jul 17 16:00:04.679683 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.679581 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" containerName="test-curl-7290-139926943219760" Jul 17 16:00:04.679750 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.679690 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" containerName="test-curl-7290-139926943219760" Jul 17 16:00:04.682970 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.682951 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:04.686893 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.686869 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7gpc\" (UniqueName: \"kubernetes.io/projected/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6-kube-api-access-m7gpc\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:04.689901 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.689876 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926943187632"] Jul 17 16:00:04.787820 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.787787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkf58\" (UniqueName: \"kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58\") pod \"test-curl-7290-139926943187632\" (UID: \"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2\") " pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:04.888584 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.888547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkf58\" (UniqueName: \"kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58\") pod \"test-curl-7290-139926943187632\" (UID: \"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2\") " pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:04.898598 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.898571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkf58\" (UniqueName: \"kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58\") pod \"test-curl-7290-139926943187632\" (UID: \"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2\") " pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:04.993615 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:04.993537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:05.131811 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:05.131779 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926943187632"] Jul 17 16:00:05.133033 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:05.133010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3db50ed1_6e6b_4517_9171_4c1e2e5e3cc2.slice/crio-c4788fc4838b30b282ef8177c33fb87ccb1e41ae94aadf67de3cbbfa264d939f WatchSource:0}: Error finding container c4788fc4838b30b282ef8177c33fb87ccb1e41ae94aadf67de3cbbfa264d939f: Status 404 returned error can't find the container with id c4788fc4838b30b282ef8177c33fb87ccb1e41ae94aadf67de3cbbfa264d939f Jul 17 16:00:05.359562 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:05.359478 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3be8a7720db3248a757350679281da2a9cef9d7e14c2a90cb9631c06589af69f" Jul 17 16:00:05.359562 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:05.359498 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:05.360709 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:05.360683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926943187632" event={"ID":"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2","Type":"ContainerStarted","Data":"c4788fc4838b30b282ef8177c33fb87ccb1e41ae94aadf67de3cbbfa264d939f"} Jul 17 16:00:05.370599 ip-10-0-140-166 kubenswrapper[2575]: E0717 16:00:05.370573 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7290-139926943219760\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:06.367649 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:06.367560 2575 generic.go:356] "Generic (PLEG): container finished" podID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" containerID="114feaa19f6d8c1ec734b081472757bd2604d0bee175a353beaae65d4f9bbf62" exitCode=0 Jul 17 16:00:06.368041 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:06.367652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926943187632" event={"ID":"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2","Type":"ContainerDied","Data":"114feaa19f6d8c1ec734b081472757bd2604d0bee175a353beaae65d4f9bbf62"} Jul 17 16:00:06.370136 ip-10-0-140-166 kubenswrapper[2575]: E0717 16:00:06.370112 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7290-139926943219760\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" pod="opendatahub/test-curl-7290-139926943219760" Jul 17 16:00:06.449570 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:06.449539 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6" path="/var/lib/kubelet/pods/9374d4f4-3a7a-4f4a-b003-3ab3001f9eb6/volumes" Jul 17 16:00:07.505844 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.505820 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:07.535577 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.532113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926943187632_3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2/test-curl-7290-139926943187632/0.log" Jul 17 16:00:07.560933 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.560897 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926943187632"] Jul 17 16:00:07.566943 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.566917 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926943187632"] Jul 17 16:00:07.612987 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.612963 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkf58\" (UniqueName: \"kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58\") pod \"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2\" (UID: \"3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2\") " Jul 17 16:00:07.615005 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.614978 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58" (OuterVolumeSpecName: "kube-api-access-zkf58") pod "3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" (UID: "3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2"). InnerVolumeSpecName "kube-api-access-zkf58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:07.714258 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.714212 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkf58\" (UniqueName: \"kubernetes.io/projected/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2-kube-api-access-zkf58\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:07.729467 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.729426 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:07.729889 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.729875 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" containerName="test-curl-7290-139926943187632" Jul 17 16:00:07.729934 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.729891 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" containerName="test-curl-7290-139926943187632" Jul 17 16:00:07.729974 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.729960 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" containerName="test-curl-7290-139926943187632" Jul 17 16:00:07.733028 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.733013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:07.742147 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.742123 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:07.815271 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.815235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhjc8\" (UniqueName: \"kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8\") pod \"test-curl-7290-139926941181680\" (UID: \"0f532905-5a3f-43ac-9560-11d10ef58104\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:07.916300 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.916267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhjc8\" (UniqueName: \"kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8\") pod \"test-curl-7290-139926941181680\" (UID: \"0f532905-5a3f-43ac-9560-11d10ef58104\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:07.925170 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:07.925145 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhjc8\" (UniqueName: \"kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8\") pod \"test-curl-7290-139926941181680\" (UID: \"0f532905-5a3f-43ac-9560-11d10ef58104\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:08.042711 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.042627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:08.175369 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.175338 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:08.176573 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:08.176546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f532905_5a3f_43ac_9560_11d10ef58104.slice/crio-8b9f683303ca975f235090e6140d13257c1240ab74f04aa806e16ef2b6e30f69 WatchSource:0}: Error finding container 8b9f683303ca975f235090e6140d13257c1240ab74f04aa806e16ef2b6e30f69: Status 404 returned error can't find the container with id 8b9f683303ca975f235090e6140d13257c1240ab74f04aa806e16ef2b6e30f69 Jul 17 16:00:08.380516 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.380401 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4788fc4838b30b282ef8177c33fb87ccb1e41ae94aadf67de3cbbfa264d939f" Jul 17 16:00:08.380516 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.380403 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:08.381700 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.381669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941181680" event={"ID":"0f532905-5a3f-43ac-9560-11d10ef58104","Type":"ContainerStarted","Data":"8b9f683303ca975f235090e6140d13257c1240ab74f04aa806e16ef2b6e30f69"} Jul 17 16:00:08.392007 ip-10-0-140-166 kubenswrapper[2575]: E0717 16:00:08.391979 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7290-139926943187632\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" pod="opendatahub/test-curl-7290-139926943187632" Jul 17 16:00:08.449290 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:08.449260 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2" path="/var/lib/kubelet/pods/3db50ed1-6e6b-4517-9171-4c1e2e5e3cc2/volumes" Jul 17 16:00:09.389187 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:09.389155 2575 generic.go:356] "Generic (PLEG): container finished" podID="0f532905-5a3f-43ac-9560-11d10ef58104" containerID="76a36dea7370fea0776f9cee7407c43f602a0edf5531abd795c009e55f18ec23" exitCode=0 Jul 17 16:00:09.389657 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:09.389237 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941181680" event={"ID":"0f532905-5a3f-43ac-9560-11d10ef58104","Type":"ContainerDied","Data":"76a36dea7370fea0776f9cee7407c43f602a0edf5531abd795c009e55f18ec23"} Jul 17 16:00:10.548197 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.548172 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:10.571297 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.571273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926941181680_0f532905-5a3f-43ac-9560-11d10ef58104/test-curl-7290-139926941181680/0.log" Jul 17 16:00:10.595199 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.595160 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:10.599258 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.599236 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:10.642281 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.642258 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhjc8\" (UniqueName: \"kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8\") pod \"0f532905-5a3f-43ac-9560-11d10ef58104\" (UID: \"0f532905-5a3f-43ac-9560-11d10ef58104\") " Jul 17 16:00:10.644086 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.644068 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8" (OuterVolumeSpecName: "kube-api-access-xhjc8") pod "0f532905-5a3f-43ac-9560-11d10ef58104" (UID: "0f532905-5a3f-43ac-9560-11d10ef58104"). InnerVolumeSpecName "kube-api-access-xhjc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:10.719582 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.719549 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:10.720004 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.719988 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f532905-5a3f-43ac-9560-11d10ef58104" containerName="test-curl-7290-139926941181680" Jul 17 16:00:10.720058 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.720007 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f532905-5a3f-43ac-9560-11d10ef58104" containerName="test-curl-7290-139926941181680" Jul 17 16:00:10.720094 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.720075 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f532905-5a3f-43ac-9560-11d10ef58104" containerName="test-curl-7290-139926941181680" Jul 17 16:00:10.723153 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.723134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:10.729680 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.729652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:10.743048 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.743019 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhjc8\" (UniqueName: \"kubernetes.io/projected/0f532905-5a3f-43ac-9560-11d10ef58104-kube-api-access-xhjc8\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:10.843904 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.843869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xltjt\" (UniqueName: \"kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt\") pod \"test-curl-7290-139926941181680\" (UID: \"ebc7de01-6849-4983-9fba-cbf7509f1d94\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:10.944945 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.944863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xltjt\" (UniqueName: \"kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt\") pod \"test-curl-7290-139926941181680\" (UID: \"ebc7de01-6849-4983-9fba-cbf7509f1d94\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:10.953651 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:10.953624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xltjt\" (UniqueName: \"kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt\") pod \"test-curl-7290-139926941181680\" (UID: \"ebc7de01-6849-4983-9fba-cbf7509f1d94\") " pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:11.034812 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.034774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:11.170680 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.170649 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:11.172025 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:11.172000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebc7de01_6849_4983_9fba_cbf7509f1d94.slice/crio-df5c5894e890106ede1ded7031996be905028461baa09bb6c8acf36269fff969 WatchSource:0}: Error finding container df5c5894e890106ede1ded7031996be905028461baa09bb6c8acf36269fff969: Status 404 returned error can't find the container with id df5c5894e890106ede1ded7031996be905028461baa09bb6c8acf36269fff969 Jul 17 16:00:11.401888 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.401854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941181680" event={"ID":"ebc7de01-6849-4983-9fba-cbf7509f1d94","Type":"ContainerStarted","Data":"df5c5894e890106ede1ded7031996be905028461baa09bb6c8acf36269fff969"} Jul 17 16:00:11.403084 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.403065 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:11.403200 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.403095 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b9f683303ca975f235090e6140d13257c1240ab74f04aa806e16ef2b6e30f69" Jul 17 16:00:11.415624 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:11.415595 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7290-139926941181680" oldPodUID="0f532905-5a3f-43ac-9560-11d10ef58104" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" Jul 17 16:00:12.411064 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:12.411029 2575 generic.go:356] "Generic (PLEG): container finished" podID="ebc7de01-6849-4983-9fba-cbf7509f1d94" containerID="1cee345ca96d6afbf585afe0aed39c6db3d098272cdb32c7c1e613c235052aa5" exitCode=0 Jul 17 16:00:12.411493 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:12.411128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941181680" event={"ID":"ebc7de01-6849-4983-9fba-cbf7509f1d94","Type":"ContainerDied","Data":"1cee345ca96d6afbf585afe0aed39c6db3d098272cdb32c7c1e613c235052aa5"} Jul 17 16:00:12.451632 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:12.451594 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f532905-5a3f-43ac-9560-11d10ef58104" path="/var/lib/kubelet/pods/0f532905-5a3f-43ac-9560-11d10ef58104/volumes" Jul 17 16:00:14.133345 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.133312 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:14.155639 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.155607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926941181680_ebc7de01-6849-4983-9fba-cbf7509f1d94/test-curl-7290-139926941181680/0.log" Jul 17 16:00:14.180381 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.180358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:14.187204 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.187171 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926941181680"] Jul 17 16:00:14.277324 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.277292 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xltjt\" (UniqueName: \"kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt\") pod \"ebc7de01-6849-4983-9fba-cbf7509f1d94\" (UID: \"ebc7de01-6849-4983-9fba-cbf7509f1d94\") " Jul 17 16:00:14.279489 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.279461 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt" (OuterVolumeSpecName: "kube-api-access-xltjt") pod "ebc7de01-6849-4983-9fba-cbf7509f1d94" (UID: "ebc7de01-6849-4983-9fba-cbf7509f1d94"). InnerVolumeSpecName "kube-api-access-xltjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:14.303038 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.303008 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:14.303461 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.303434 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" containerName="test-curl-7290-139926941181680" Jul 17 16:00:14.303461 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.303460 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" containerName="test-curl-7290-139926941181680" Jul 17 16:00:14.303538 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.303529 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" containerName="test-curl-7290-139926941181680" Jul 17 16:00:14.307865 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.307847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:14.314793 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.314763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:14.378681 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.378650 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xltjt\" (UniqueName: \"kubernetes.io/projected/ebc7de01-6849-4983-9fba-cbf7509f1d94-kube-api-access-xltjt\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:14.424045 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.424020 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:14.424217 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.424064 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5c5894e890106ede1ded7031996be905028461baa09bb6c8acf36269fff969" Jul 17 16:00:14.434779 ip-10-0-140-166 kubenswrapper[2575]: E0717 16:00:14.434751 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7290-139926941181680\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" pod="opendatahub/test-curl-7290-139926941181680" Jul 17 16:00:14.450800 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.450773 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc7de01-6849-4983-9fba-cbf7509f1d94" path="/var/lib/kubelet/pods/ebc7de01-6849-4983-9fba-cbf7509f1d94/volumes" Jul 17 16:00:14.480141 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.480112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbcg\" (UniqueName: \"kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg\") pod \"test-curl-7290-139926941037888\" (UID: \"c1c47630-2b68-44b8-b51b-b3cacef53d77\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:14.581569 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.581516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbcg\" (UniqueName: \"kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg\") pod \"test-curl-7290-139926941037888\" (UID: \"c1c47630-2b68-44b8-b51b-b3cacef53d77\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:14.592015 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.591981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbcg\" (UniqueName: \"kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg\") pod \"test-curl-7290-139926941037888\" (UID: \"c1c47630-2b68-44b8-b51b-b3cacef53d77\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:14.619926 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.619854 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:14.760876 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:14.760848 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:14.762039 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:14.762014 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1c47630_2b68_44b8_b51b_b3cacef53d77.slice/crio-3e06c9ddaf05e8a48998ce58d6f52fbe926a469eb2ddf08c52f5852b06fa5963 WatchSource:0}: Error finding container 3e06c9ddaf05e8a48998ce58d6f52fbe926a469eb2ddf08c52f5852b06fa5963: Status 404 returned error can't find the container with id 3e06c9ddaf05e8a48998ce58d6f52fbe926a469eb2ddf08c52f5852b06fa5963 Jul 17 16:00:15.430998 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:15.430958 2575 generic.go:356] "Generic (PLEG): container finished" podID="c1c47630-2b68-44b8-b51b-b3cacef53d77" containerID="39c20a36353575edfa592ac44e55c232c401cd9d80104ab21ca2ab5a034ce34c" exitCode=0 Jul 17 16:00:15.431486 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:15.431046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941037888" event={"ID":"c1c47630-2b68-44b8-b51b-b3cacef53d77","Type":"ContainerDied","Data":"39c20a36353575edfa592ac44e55c232c401cd9d80104ab21ca2ab5a034ce34c"} Jul 17 16:00:15.431486 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:15.431087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941037888" event={"ID":"c1c47630-2b68-44b8-b51b-b3cacef53d77","Type":"ContainerStarted","Data":"3e06c9ddaf05e8a48998ce58d6f52fbe926a469eb2ddf08c52f5852b06fa5963"} Jul 17 16:00:15.432468 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:15.432422 2575 generic.go:356] "Generic (PLEG): container finished" podID="26fa6053-d6cd-4a4a-86d4-faa2ea0f954a" containerID="fab4b2891514744f7ba4b60685d0158e8ca05a76a45ccb44a2318ed72bdca536" exitCode=0 Jul 17 16:00:15.432571 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:15.432502 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" event={"ID":"26fa6053-d6cd-4a4a-86d4-faa2ea0f954a","Type":"ContainerDied","Data":"fab4b2891514744f7ba4b60685d0158e8ca05a76a45ccb44a2318ed72bdca536"} Jul 17 16:00:16.593023 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.592988 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" Jul 17 16:00:16.618019 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.617994 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:16.640731 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.640698 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926941037888_c1c47630-2b68-44b8-b51b-b3cacef53d77/test-curl-7290-139926941037888/0.log" Jul 17 16:00:16.662982 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.662945 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:16.667512 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.667477 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:16.784163 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784077 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:16.784523 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784509 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1c47630-2b68-44b8-b51b-b3cacef53d77" containerName="test-curl-7290-139926941037888" Jul 17 16:00:16.784567 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784525 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1c47630-2b68-44b8-b51b-b3cacef53d77" containerName="test-curl-7290-139926941037888" Jul 17 16:00:16.784567 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784536 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa6053-d6cd-4a4a-86d4-faa2ea0f954a" containerName="cleanup" Jul 17 16:00:16.784567 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784542 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa6053-d6cd-4a4a-86d4-faa2ea0f954a" containerName="cleanup" Jul 17 16:00:16.784670 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784608 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fa6053-d6cd-4a4a-86d4-faa2ea0f954a" containerName="cleanup" Jul 17 16:00:16.784670 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.784619 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1c47630-2b68-44b8-b51b-b3cacef53d77" containerName="test-curl-7290-139926941037888" Jul 17 16:00:16.787956 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.787937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:16.794487 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.794457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:16.801560 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.801528 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqbcg\" (UniqueName: \"kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg\") pod \"c1c47630-2b68-44b8-b51b-b3cacef53d77\" (UID: \"c1c47630-2b68-44b8-b51b-b3cacef53d77\") " Jul 17 16:00:16.803624 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.803592 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg" (OuterVolumeSpecName: "kube-api-access-wqbcg") pod "c1c47630-2b68-44b8-b51b-b3cacef53d77" (UID: "c1c47630-2b68-44b8-b51b-b3cacef53d77"). InnerVolumeSpecName "kube-api-access-wqbcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:16.903240 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.903203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwd6j\" (UniqueName: \"kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j\") pod \"test-curl-7290-139926941037888\" (UID: \"ff3c27f3-dd77-43f2-9e94-c02d31c46210\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:16.903422 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:16.903263 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqbcg\" (UniqueName: \"kubernetes.io/projected/c1c47630-2b68-44b8-b51b-b3cacef53d77-kube-api-access-wqbcg\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:17.004047 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.004002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwd6j\" (UniqueName: \"kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j\") pod \"test-curl-7290-139926941037888\" (UID: \"ff3c27f3-dd77-43f2-9e94-c02d31c46210\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:17.014511 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.014489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwd6j\" (UniqueName: \"kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j\") pod \"test-curl-7290-139926941037888\" (UID: \"ff3c27f3-dd77-43f2-9e94-c02d31c46210\") " pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:17.100400 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.100304 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:17.241400 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.241369 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:17.243166 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:00:17.243138 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3c27f3_dd77_43f2_9e94_c02d31c46210.slice/crio-ee9ca8b086104b1144d6b05a2bee15e30d94dc7957fdf0734200a2a634ce3fd1 WatchSource:0}: Error finding container ee9ca8b086104b1144d6b05a2bee15e30d94dc7957fdf0734200a2a634ce3fd1: Status 404 returned error can't find the container with id ee9ca8b086104b1144d6b05a2bee15e30d94dc7957fdf0734200a2a634ce3fd1 Jul 17 16:00:17.446966 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.446928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941037888" event={"ID":"ff3c27f3-dd77-43f2-9e94-c02d31c46210","Type":"ContainerStarted","Data":"ee9ca8b086104b1144d6b05a2bee15e30d94dc7957fdf0734200a2a634ce3fd1"} Jul 17 16:00:17.448231 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.448208 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:17.448349 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.448211 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e06c9ddaf05e8a48998ce58d6f52fbe926a469eb2ddf08c52f5852b06fa5963" Jul 17 16:00:17.449362 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.449341 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" event={"ID":"26fa6053-d6cd-4a4a-86d4-faa2ea0f954a","Type":"ContainerDied","Data":"1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962"} Jul 17 16:00:17.449469 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.449377 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f60da388e59faba86f5275f37d305ddc4e66a13549c6dbb3fffed8c6ce06962" Jul 17 16:00:17.449469 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.449379 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738400-vcvzq" Jul 17 16:00:17.465175 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:17.465145 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7290-139926941037888" oldPodUID="c1c47630-2b68-44b8-b51b-b3cacef53d77" podUID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" Jul 17 16:00:18.450347 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:18.450315 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1c47630-2b68-44b8-b51b-b3cacef53d77" path="/var/lib/kubelet/pods/c1c47630-2b68-44b8-b51b-b3cacef53d77/volumes" Jul 17 16:00:18.456763 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:18.456730 2575 generic.go:356] "Generic (PLEG): container finished" podID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" containerID="053103713be8793b121cd688ce5dabf5e91ebf1c1fa57133567ee0e24288e0f3" exitCode=0 Jul 17 16:00:18.456941 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:18.456816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-139926941037888" event={"ID":"ff3c27f3-dd77-43f2-9e94-c02d31c46210","Type":"ContainerDied","Data":"053103713be8793b121cd688ce5dabf5e91ebf1c1fa57133567ee0e24288e0f3"} Jul 17 16:00:19.623348 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.623319 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:19.626802 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.626781 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwd6j\" (UniqueName: \"kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j\") pod \"ff3c27f3-dd77-43f2-9e94-c02d31c46210\" (UID: \"ff3c27f3-dd77-43f2-9e94-c02d31c46210\") " Jul 17 16:00:19.628830 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.628799 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j" (OuterVolumeSpecName: "kube-api-access-jwd6j") pod "ff3c27f3-dd77-43f2-9e94-c02d31c46210" (UID: "ff3c27f3-dd77-43f2-9e94-c02d31c46210"). InnerVolumeSpecName "kube-api-access-jwd6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 16:00:19.646691 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.646598 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7290-139926941037888_ff3c27f3-dd77-43f2-9e94-c02d31c46210/test-curl-7290-139926941037888/0.log" Jul 17 16:00:19.668867 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.668818 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:19.675436 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.675405 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-139926941037888"] Jul 17 16:00:19.728264 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:19.728175 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwd6j\" (UniqueName: \"kubernetes.io/projected/ff3c27f3-dd77-43f2-9e94-c02d31c46210-kube-api-access-jwd6j\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jul 17 16:00:20.450860 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:20.450816 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" path="/var/lib/kubelet/pods/ff3c27f3-dd77-43f2-9e94-c02d31c46210/volumes" Jul 17 16:00:20.472295 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:20.472267 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-139926941037888" Jul 17 16:00:20.472295 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:00:20.472297 2575 scope.go:117] "RemoveContainer" containerID="053103713be8793b121cd688ce5dabf5e91ebf1c1fa57133567ee0e24288e0f3" Jul 17 16:01:12.544853 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:12.544821 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd9766896-jk9jw_99033c3c-fa06-4fa1-8e34-e90de00b63f5/authorino/0.log" Jul 17 16:01:18.202654 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:18.202603 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f5df8646b-65fw9_f38f70d0-6a6f-443d-a8b1-0178f7f575b7/manager/0.log" Jul 17 16:01:18.542492 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:18.542394 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-8mrkd_57f3f8d2-7f38-49ff-91fc-8fc7e235f991/copy-manifests/0.log" Jul 17 16:01:18.549866 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:18.549842 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-8mrkd_57f3f8d2-7f38-49ff-91fc-8fc7e235f991/manager/0.log" Jul 17 16:01:19.156785 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:19.156756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6cb4dc4f79-hw2rf_f6686c41-78a7-49c2-9bd6-809ee043acb5/maas-api/0.log" Jul 17 16:01:19.486051 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:19.485938 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738400-vcvzq_26fa6053-d6cd-4a4a-86d4-faa2ea0f954a/cleanup/0.log" Jul 17 16:01:21.320053 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.320018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/util/0.log" Jul 17 16:01:21.326133 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.326109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/pull/0.log" Jul 17 16:01:21.332563 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.332545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/extract/0.log" Jul 17 16:01:21.455554 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.455524 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/util/0.log" Jul 17 16:01:21.462188 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.462157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/pull/0.log" Jul 17 16:01:21.468376 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.468359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/extract/0.log" Jul 17 16:01:21.580020 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.579958 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/util/0.log" Jul 17 16:01:21.586824 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.586801 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/pull/0.log" Jul 17 16:01:21.593639 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.593623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/extract/0.log" Jul 17 16:01:21.701196 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.701167 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/util/0.log" Jul 17 16:01:21.707723 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.707704 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/pull/0.log" Jul 17 16:01:21.714130 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.714111 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/extract/0.log" Jul 17 16:01:21.828533 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:21.828502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd9766896-jk9jw_99033c3c-fa06-4fa1-8e34-e90de00b63f5/authorino/0.log" Jul 17 16:01:22.176411 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:22.176382 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nhc92_24c864c1-02a2-493a-bd20-a4a80649617d/kuadrant-console-plugin/0.log" Jul 17 16:01:22.298032 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:22.298003 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wrdsf_22f47c18-051e-4db5-ac14-00c09f5cac02/registry-server/0.log" Jul 17 16:01:22.659111 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:22.659074 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gbmpw_1abe0412-c3d7-45e4-b5e7-fae821e2ab21/manager/0.log" Jul 17 16:01:23.022796 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:23.022719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cbkv6_13e980db-2905-4e71-94e4-285d091c34c9/istio-proxy/0.log" Jul 17 16:01:23.504638 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:23.504608 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/1.log" Jul 17 16:01:23.625024 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:23.624957 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jz4cv_5be687c9-eb69-4079-9e70-23f0ff7e94b3/payload-pre-processing/0.log" Jul 17 16:01:23.740043 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:23.740018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-9rkpt_6c4a55ec-ef40-4d86-a9e9-d116d21c25eb/payload-processing/0.log" Jul 17 16:01:23.863847 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:23.863773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5cb98776-wgkcp_b9a7c92b-64f8-4378-aaf0-5ae0f491a484/router/0.log" Jul 17 16:01:24.193085 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:24.193058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vt5gt_40395eb6-3f7c-477d-9bcf-e69bc9d5220d/main/0.log" Jul 17 16:01:24.442359 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:24.442334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7gld4_2d00835d-5d59-426e-8d6b-83e11593658d/main/0.log" Jul 17 16:01:24.665487 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:24.665438 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-znw5w_4f42d92f-bc1f-46cb-89a7-933e83471ee1/main/0.log" Jul 17 16:01:33.186529 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:33.186494 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s928z_61eee7cb-47a3-4f54-aeba-96476b4d790b/global-pull-secret-syncer/0.log" Jul 17 16:01:33.365921 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:33.365889 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swkm7_20e45cd6-4c6c-43e1-aec1-97d4db007b95/konnectivity-agent/0.log" Jul 17 16:01:33.453631 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:33.453544 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-166.ec2.internal_0fe8286928bc8a8cd15cc674793185cf/haproxy/0.log" Jul 17 16:01:37.777262 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.777179 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/extract/0.log" Jul 17 16:01:37.807921 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.807887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/util/0.log" Jul 17 16:01:37.835804 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.835761 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598ctzn_c75d6041-739f-4bb7-955e-8e9ff25b530a/pull/0.log" Jul 17 16:01:37.877521 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.877476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/extract/0.log" Jul 17 16:01:37.937962 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.937936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/util/0.log" Jul 17 16:01:37.969280 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:37.969239 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bn9wn_66523d24-562a-4f78-9d79-538329268e78/pull/0.log" Jul 17 16:01:38.003702 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.003674 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/extract/0.log" Jul 17 16:01:38.034559 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.034485 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/util/0.log" Jul 17 16:01:38.059389 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.059362 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7322l6s_3fbaf184-3ea1-42ab-aa42-de5f8fde76fa/pull/0.log" Jul 17 16:01:38.092250 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.092220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/extract/0.log" Jul 17 16:01:38.120784 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.120755 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/util/0.log" Jul 17 16:01:38.147070 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.147045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pdrld_cc14a1a0-143f-424a-8875-2e77cb8f52a7/pull/0.log" Jul 17 16:01:38.451750 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.451717 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd9766896-jk9jw_99033c3c-fa06-4fa1-8e34-e90de00b63f5/authorino/0.log" Jul 17 16:01:38.560699 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.560669 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nhc92_24c864c1-02a2-493a-bd20-a4a80649617d/kuadrant-console-plugin/0.log" Jul 17 16:01:38.614035 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.613997 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wrdsf_22f47c18-051e-4db5-ac14-00c09f5cac02/registry-server/0.log" Jul 17 16:01:38.867834 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:38.867753 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gbmpw_1abe0412-c3d7-45e4-b5e7-fae821e2ab21/manager/0.log" Jul 17 16:01:40.542251 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.542211 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/alertmanager/0.log" Jul 17 16:01:40.575469 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.575420 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/config-reloader/0.log" Jul 17 16:01:40.608333 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.608309 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/kube-rbac-proxy-web/0.log" Jul 17 16:01:40.643539 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.643495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/kube-rbac-proxy/0.log" Jul 17 16:01:40.688654 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.688624 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/kube-rbac-proxy-metric/0.log" Jul 17 16:01:40.720731 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.720706 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/prom-label-proxy/0.log" Jul 17 16:01:40.758544 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.758469 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a122c035-214e-482d-8c8b-c0a50ea7f202/init-config-reloader/0.log" Jul 17 16:01:40.806396 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.806371 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-58cs9_21301730-b3f2-474e-a8ab-aadff4916b69/cluster-monitoring-operator/0.log" Jul 17 16:01:40.973385 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:40.973358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-p9dcb_cd003d00-9bbb-4b90-bb79-6073e756e71a/monitoring-plugin/0.log" Jul 17 16:01:41.222760 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.222733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn4ql_512677ea-a9cd-4637-82ef-2e2dd91c1d5f/node-exporter/0.log" Jul 17 16:01:41.249529 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.249503 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn4ql_512677ea-a9cd-4637-82ef-2e2dd91c1d5f/kube-rbac-proxy/0.log" Jul 17 16:01:41.276398 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.276370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn4ql_512677ea-a9cd-4637-82ef-2e2dd91c1d5f/init-textfile/0.log" Jul 17 16:01:41.707010 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.706976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-5n92x_73b403dd-8b82-450e-97ab-35b69ff1db13/prometheus-operator-admission-webhook/0.log" Jul 17 16:01:41.741309 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.741284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb848d65-rzd8w_6160547f-4fc1-4423-ae65-b65726ae9e1d/telemeter-client/0.log" Jul 17 16:01:41.769208 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.769180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb848d65-rzd8w_6160547f-4fc1-4423-ae65-b65726ae9e1d/reload/0.log" Jul 17 16:01:41.799351 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:41.799324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bb848d65-rzd8w_6160547f-4fc1-4423-ae65-b65726ae9e1d/kube-rbac-proxy/0.log" Jul 17 16:01:43.886099 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.886057 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj"] Jul 17 16:01:43.886732 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.886710 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" containerName="test-curl-7290-139926941037888" Jul 17 16:01:43.886819 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.886734 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" containerName="test-curl-7290-139926941037888" Jul 17 16:01:43.886874 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.886848 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3c27f3-dd77-43f2-9e94-c02d31c46210" containerName="test-curl-7290-139926941037888" Jul 17 16:01:43.889884 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.889861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:43.892823 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.892802 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvc44\"/\"openshift-service-ca.crt\"" Jul 17 16:01:43.892944 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.892813 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fvc44\"/\"default-dockercfg-txbgf\"" Jul 17 16:01:43.893938 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.893921 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvc44\"/\"kube-root-ca.crt\"" Jul 17 16:01:43.903408 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.903377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/1.log" Jul 17 16:01:43.904067 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.904038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj"] Jul 17 16:01:43.908213 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.908186 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xfnd4_322213ec-d848-4955-918c-1144fa103e51/console-operator/2.log" Jul 17 16:01:43.920695 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.920651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-lib-modules\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:43.920695 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.920714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-podres\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:43.920973 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.920749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-sys\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:43.920973 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.920832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-proc\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:43.920973 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:43.920877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj9gs\" (UniqueName: \"kubernetes.io/projected/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-kube-api-access-mj9gs\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022299 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-proc\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj9gs\" (UniqueName: \"kubernetes.io/projected/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-kube-api-access-mj9gs\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-lib-modules\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-podres\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-proc\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-sys\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-lib-modules\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022561 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-sys\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.022593 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.022561 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-podres\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.032546 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.032525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj9gs\" (UniqueName: \"kubernetes.io/projected/6e7c85d0-5e20-4012-8b64-f36d7d2c474a-kube-api-access-mj9gs\") pod \"perf-node-gather-daemonset-2qwdj\" (UID: \"6e7c85d0-5e20-4012-8b64-f36d7d2c474a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.199382 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.199356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.341842 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.341818 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj"] Jul 17 16:01:44.343404 ip-10-0-140-166 kubenswrapper[2575]: W0717 16:01:44.343374 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6e7c85d0_5e20_4012_8b64_f36d7d2c474a.slice/crio-2a3ab4c4228c11dbb2b6341ace55ab2244771f84bde6e682d2ac4c997c464cf9 WatchSource:0}: Error finding container 2a3ab4c4228c11dbb2b6341ace55ab2244771f84bde6e682d2ac4c997c464cf9: Status 404 returned error can't find the container with id 2a3ab4c4228c11dbb2b6341ace55ab2244771f84bde6e682d2ac4c997c464cf9 Jul 17 16:01:44.972257 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.972220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" event={"ID":"6e7c85d0-5e20-4012-8b64-f36d7d2c474a","Type":"ContainerStarted","Data":"f3a2d015d5e2a267664924f9cad2360184cd9adbea655da9bfe5d2cb8dc2fb61"} Jul 17 16:01:44.972712 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.972272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" event={"ID":"6e7c85d0-5e20-4012-8b64-f36d7d2c474a","Type":"ContainerStarted","Data":"2a3ab4c4228c11dbb2b6341ace55ab2244771f84bde6e682d2ac4c997c464cf9"} Jul 17 16:01:44.972712 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.972354 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:44.990896 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:44.990849 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" podStartSLOduration=1.990833382 podStartE2EDuration="1.990833382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:01:44.99019004 +0000 UTC m=+3163.151944364" watchObservedRunningTime="2026-07-17 16:01:44.990833382 +0000 UTC m=+3163.152587708" Jul 17 16:01:45.314674 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:45.314593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-vt7dn_26f2b144-50b5-4078-a9c2-217ac52279d4/volume-data-source-validator/0.log" Jul 17 16:01:46.593746 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:46.593712 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wskcr_94dbad65-8322-438c-88df-a20f8ec7319c/dns/0.log" Jul 17 16:01:46.621575 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:46.621535 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wskcr_94dbad65-8322-438c-88df-a20f8ec7319c/kube-rbac-proxy/0.log" Jul 17 16:01:46.682074 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:46.682052 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57xpr_b2472fb3-bf41-492f-ac70-764d612f02c8/dns-node-resolver/0.log" Jul 17 16:01:47.407263 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:47.407236 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rbnn_9ea79044-bd0d-4114-8820-159fe7c6ecad/node-ca/0.log" Jul 17 16:01:48.540671 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.540641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cbkv6_13e980db-2905-4e71-94e4-285d091c34c9/istio-proxy/0.log" Jul 17 16:01:48.772457 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.772402 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/0.log" Jul 17 16:01:48.800704 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.800628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/1.log" Jul 17 16:01:48.829628 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.829595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jz4cv_5be687c9-eb69-4079-9e70-23f0ff7e94b3/payload-pre-processing/0.log" Jul 17 16:01:48.860669 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.860644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-9rkpt_6c4a55ec-ef40-4d86-a9e9-d116d21c25eb/payload-processing/0.log" Jul 17 16:01:48.887801 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:48.887777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5cb98776-wgkcp_b9a7c92b-64f8-4378-aaf0-5ae0f491a484/router/0.log" Jul 17 16:01:49.711706 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:49.711675 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tt5xh_09676aab-64eb-41b6-9964-a2e8a902d100/serve-healthcheck-canary/0.log" Jul 17 16:01:50.229358 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.229330 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-st868_374da249-1db7-4b1a-9206-5541d98a35bc/insights-operator/0.log" Jul 17 16:01:50.229974 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.229959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-st868_374da249-1db7-4b1a-9206-5541d98a35bc/insights-operator/1.log" Jul 17 16:01:50.348833 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.348807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chgkv_3cf22707-b708-4c51-85ac-bc59e676db8e/kube-rbac-proxy/0.log" Jul 17 16:01:50.377121 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.377094 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chgkv_3cf22707-b708-4c51-85ac-bc59e676db8e/exporter/0.log" Jul 17 16:01:50.407291 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.407268 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chgkv_3cf22707-b708-4c51-85ac-bc59e676db8e/extractor/0.log" Jul 17 16:01:50.988533 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:50.988506 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-2qwdj" Jul 17 16:01:53.201940 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:53.201909 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f5df8646b-65fw9_f38f70d0-6a6f-443d-a8b1-0178f7f575b7/manager/0.log" Jul 17 16:01:53.343853 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:53.343773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-8mrkd_57f3f8d2-7f38-49ff-91fc-8fc7e235f991/manager/0.log" Jul 17 16:01:53.412692 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:53.412665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-8mrkd_57f3f8d2-7f38-49ff-91fc-8fc7e235f991/copy-manifests/0.log" Jul 17 16:01:54.529832 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.529801 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cbkv6_13e980db-2905-4e71-94e4-285d091c34c9/istio-proxy/0.log" Jul 17 16:01:54.685509 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.685477 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/0.log" Jul 17 16:01:54.714143 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.714110 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/1.log" Jul 17 16:01:54.732162 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.732134 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jz4cv_5be687c9-eb69-4079-9e70-23f0ff7e94b3/payload-pre-processing/0.log" Jul 17 16:01:54.751243 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.751223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-9rkpt_6c4a55ec-ef40-4d86-a9e9-d116d21c25eb/payload-processing/0.log" Jul 17 16:01:54.764867 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.764841 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5cb98776-wgkcp_b9a7c92b-64f8-4378-aaf0-5ae0f491a484/router/0.log" Jul 17 16:01:54.968562 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:54.968537 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76c68485bc-4grdx_ed8f9686-1f2e-4c87-9f3d-0038bd317599/manager/0.log" Jul 17 16:01:56.107012 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.106983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cbkv6_13e980db-2905-4e71-94e4-285d091c34c9/istio-proxy/0.log" Jul 17 16:01:56.295833 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.295802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/0.log" Jul 17 16:01:56.324024 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.323997 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nqz5s_0d496021-ffc6-4bda-ba06-8ab990949d7c/istio-proxy/1.log" Jul 17 16:01:56.350944 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.350910 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jz4cv_5be687c9-eb69-4079-9e70-23f0ff7e94b3/payload-pre-processing/0.log" Jul 17 16:01:56.375827 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.375749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-9rkpt_6c4a55ec-ef40-4d86-a9e9-d116d21c25eb/payload-processing/0.log" Jul 17 16:01:56.391719 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:01:56.391693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5cb98776-wgkcp_b9a7c92b-64f8-4378-aaf0-5ae0f491a484/router/0.log" Jul 17 16:02:00.780327 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:02:00.780299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-pw6t9_83e41028-8a86-4ac9-b1f6-a17964a63f71/kube-storage-version-migrator-operator/1.log" Jul 17 16:02:00.781371 ip-10-0-140-166 kubenswrapper[2575]: I0717 16:02:00.781351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-pw6t9_83e41028-8a86-4ac9-b1f6-a17964a63f71/kube-storage-version-migrator-operator/0.log"