Jul 07 13:14:11.757388 ip-10-0-131-128 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 13:14:11.757401 ip-10-0-131-128 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 13:14:11.757411 ip-10-0-131-128 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 13:14:11.757720 ip-10-0-131-128 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 13:14:23.179947 ip-10-0-131-128 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 13:14:23.179964 ip-10-0-131-128 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1ce986b67dea4eefbcb3e9a08482769a -- Jul 07 13:16:20.693800 ip-10-0-131-128 systemd[1]: Starting Kubernetes Kubelet... Jul 07 13:16:21.057312 ip-10-0-131-128 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:16:21.057312 ip-10-0-131-128 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 13:16:21.057312 ip-10-0-131-128 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:16:21.057977 ip-10-0-131-128 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 13:16:21.057977 ip-10-0-131-128 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:16:21.058608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.058418 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 13:16:21.061905 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061890 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.061905 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061904 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061908 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061911 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061914 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061917 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061919 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061922 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061925 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061928 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061931 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061933 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061936 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061940 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061945 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061948 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061951 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061954 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061957 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061961 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.061968 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061971 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061974 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061977 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061981 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061984 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061987 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061990 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061992 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061995 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.061998 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062001 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062004 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062007 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062009 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062012 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062015 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062017 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062019 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062022 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062024 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.062455 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062027 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062032 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062034 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062037 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062039 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062043 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062048 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062052 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062055 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062058 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062061 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062064 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062067 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062070 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062073 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062077 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062080 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062082 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.062920 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062085 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062087 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062090 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062093 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062095 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062098 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062100 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062103 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062105 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062107 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062110 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062112 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062115 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062117 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062120 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062123 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062133 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062137 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062139 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062142 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.063400 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062145 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062154 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062157 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062159 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062162 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062166 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062169 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062171 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062174 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062177 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062180 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062182 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062185 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062187 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062203 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062206 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062208 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062211 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062214 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062216 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.063860 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062914 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062919 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062923 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062925 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062928 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062931 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062935 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062939 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062942 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062944 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062947 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062950 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062953 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062955 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062961 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062964 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062966 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062969 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062971 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062974 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.064365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062976 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062979 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062981 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062984 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062986 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062989 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062991 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062994 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062996 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.062999 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063001 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063004 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063007 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063009 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063011 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063014 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063017 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063019 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063021 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.064845 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063024 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063027 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063030 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063032 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063036 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063038 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063041 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063043 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063046 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063049 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063051 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063054 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063057 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063059 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063062 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063066 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063069 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063074 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063077 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.065359 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063080 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063083 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063086 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063089 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063092 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063094 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063097 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063100 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063102 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063105 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063108 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063112 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063116 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063119 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063122 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063125 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063128 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063133 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063135 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063138 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.065827 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063140 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063143 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063146 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063149 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063151 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063154 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063156 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063159 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063162 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063164 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063167 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063169 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063172 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063175 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063178 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063181 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063183 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063186 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063203 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.066327 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063206 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063209 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063559 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063564 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063567 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063570 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063573 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063576 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063579 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063582 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063584 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063587 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063589 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063592 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063595 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063598 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063601 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063603 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063606 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063608 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.066793 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063611 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063614 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063616 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063619 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063621 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063624 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063627 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063630 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063633 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063636 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063638 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063643 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063647 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063650 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063652 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063656 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063660 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063663 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063665 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.067286 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063668 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063671 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063674 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063676 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063679 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063682 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063685 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063687 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063690 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063693 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063695 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063698 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063700 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063704 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063707 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063710 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063713 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063715 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063718 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.067735 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063720 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063723 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063725 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063728 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063730 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063733 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063735 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063738 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063740 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063742 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063747 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063750 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063753 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063755 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063758 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063760 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063763 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063765 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063768 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063771 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.068186 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063774 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063776 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063779 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063782 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063785 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063787 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063790 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063792 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063795 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063797 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063800 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063803 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063805 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063811 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063813 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063816 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063818 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063821 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063823 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063826 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.068665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063828 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063831 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.063835 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063902 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063909 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063915 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063919 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063923 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063926 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063930 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063933 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063937 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063939 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063943 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063946 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063949 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063952 2577 flags.go:64] FLAG: --cgroup-root="" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063955 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063958 2577 flags.go:64] FLAG: --client-ca-file="" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063961 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063964 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063968 2577 flags.go:64] FLAG: --cluster-domain="" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063970 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 13:16:21.069126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063974 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063977 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063982 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063986 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063993 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.063997 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064000 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064003 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064006 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064009 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064012 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064017 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064020 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064023 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064026 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064029 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064032 2577 flags.go:64] FLAG: --enable-server="true" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064035 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064039 2577 flags.go:64] FLAG: --event-burst="100" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064042 2577 flags.go:64] FLAG: --event-qps="50" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064045 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064048 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064051 2577 flags.go:64] FLAG: --eviction-hard="" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064054 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 13:16:21.069676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064057 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064060 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064063 2577 flags.go:64] FLAG: --eviction-soft="" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064066 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064069 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064072 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064075 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064077 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064080 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064083 2577 flags.go:64] FLAG: --feature-gates="" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064088 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064091 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064093 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064096 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064100 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064103 2577 flags.go:64] FLAG: --help="false" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064106 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064109 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064112 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064117 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064120 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064123 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064126 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 13:16:21.070379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064129 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064132 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064134 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064137 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064140 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064143 2577 flags.go:64] FLAG: --kube-reserved="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064146 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064148 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064151 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064154 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064157 2577 flags.go:64] FLAG: --lock-file="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064160 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064163 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064166 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064171 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064174 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064177 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064180 2577 flags.go:64] FLAG: --logging-format="text" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064182 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064187 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064203 2577 flags.go:64] FLAG: --manifest-url="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064206 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064210 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064213 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064217 2577 flags.go:64] FLAG: --max-pods="110" Jul 07 13:16:21.070980 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064220 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064223 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064226 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064230 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064233 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064236 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064239 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064246 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064249 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064252 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064255 2577 flags.go:64] FLAG: --pod-cidr="" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064258 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064264 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064266 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064270 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064272 2577 flags.go:64] FLAG: --port="10250" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064276 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064278 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0035a7f727c13a30d" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064282 2577 flags.go:64] FLAG: --qos-reserved="" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064284 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064288 2577 flags.go:64] FLAG: --register-node="true" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064291 2577 flags.go:64] FLAG: --register-with-taints="" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064294 2577 flags.go:64] FLAG: --registry-burst="10" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064297 2577 flags.go:64] FLAG: --registry-qps="5" Jul 07 13:16:21.071595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064300 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064302 2577 flags.go:64] FLAG: --reserved-memory="" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064307 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064310 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064313 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064316 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064318 2577 flags.go:64] FLAG: --runonce="false" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064321 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064325 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064327 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064330 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064333 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064338 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064341 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064343 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064346 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064349 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064352 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064354 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064358 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064361 2577 flags.go:64] FLAG: --system-cgroups="" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064363 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064369 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064371 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064374 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 13:16:21.072210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064378 2577 flags.go:64] FLAG: --tls-min-version="" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064381 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064384 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064387 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064391 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064393 2577 flags.go:64] FLAG: --v="2" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064397 2577 flags.go:64] FLAG: --version="false" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064401 2577 flags.go:64] FLAG: --vmodule="" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064404 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.064409 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064526 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064530 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064533 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064536 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064539 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064542 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064544 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064547 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064550 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064554 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064556 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064559 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.072805 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064562 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064565 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064567 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064570 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064572 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064575 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064577 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064580 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064583 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064585 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064588 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064591 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064593 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064596 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064599 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064602 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064604 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064607 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064609 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064613 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.073339 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064616 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064619 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064622 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064626 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064628 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064632 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064636 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064639 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064641 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064646 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064649 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064651 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064654 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064656 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064659 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064662 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064664 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064667 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064670 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.073823 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064672 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064675 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064677 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064680 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064682 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064685 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064688 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064690 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064694 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064697 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064700 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064702 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064706 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064709 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064711 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064714 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064717 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064719 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064722 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064725 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.074352 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064727 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064730 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064735 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064738 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064741 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064744 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064747 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064750 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064753 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064755 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064758 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064761 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064763 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064766 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064769 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064771 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064774 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064776 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064779 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064781 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.075365 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064784 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064787 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064790 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064793 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064796 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064799 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064801 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.064804 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.065341 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.073259 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.073272 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.073291 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.073296 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073362 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073367 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.075848 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073371 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073374 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073377 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073379 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073383 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073387 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073391 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073394 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073397 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073400 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073404 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073408 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073411 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073414 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073417 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073419 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073422 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073425 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073440 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.076270 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073447 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073450 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073454 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073456 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073459 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073462 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073465 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073467 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073470 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073473 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073475 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073478 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073482 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073486 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073489 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073492 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073495 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073498 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073501 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.076760 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073504 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073507 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073509 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073512 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073514 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073517 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073519 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073522 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073525 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073527 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073529 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073532 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073535 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073538 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073541 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073544 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073546 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073549 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073551 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073554 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.077244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073556 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073559 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073562 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073565 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073568 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073570 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073573 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073576 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073578 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073581 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073584 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073586 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073589 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073592 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073595 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073597 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073600 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073603 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073605 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073608 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.077740 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073611 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073614 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073617 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073620 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073624 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073626 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073629 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073632 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073635 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073637 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073640 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073642 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073645 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073648 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073650 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073653 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073656 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073659 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.078244 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073661 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.073666 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073768 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073772 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073775 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073779 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073782 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073784 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073787 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073790 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073794 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073797 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073800 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073803 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:16:21.078681 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073806 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073809 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073812 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073816 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073819 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073821 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073823 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073826 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073829 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073832 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073835 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073837 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073840 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073843 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073846 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073849 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073851 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073854 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073857 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073859 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:16:21.079020 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073862 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073864 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073867 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073869 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073872 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073875 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073877 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073880 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073882 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073885 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073887 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073890 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073892 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073895 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073897 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073900 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073904 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073907 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073910 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:16:21.079609 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073914 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073917 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073921 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073923 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073926 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073928 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073931 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073934 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073936 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073939 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073941 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073944 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073947 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073949 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073952 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073954 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073957 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073959 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073962 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073964 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:16:21.080085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073967 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073969 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073972 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073974 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073977 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073980 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073982 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073985 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073987 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073990 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073992 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073995 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.073997 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074000 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074002 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074005 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074008 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074011 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074013 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074016 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:16:21.080579 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074018 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074021 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074023 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074026 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074028 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074031 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074033 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:21.074036 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.074041 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.074137 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.076070 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.077535 2577 server.go:1019] "Starting client certificate rotation" Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.077627 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.077660 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:16:21.081064 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.079923 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:16:21.082740 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.082719 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:16:21.092554 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.092535 2577 log.go:25] "Validated CRI v1 runtime API" Jul 07 13:16:21.094478 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.094465 2577 log.go:25] "Validated CRI v1 image API" Jul 07 13:16:21.095993 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.095978 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 13:16:21.098235 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.098217 2577 fs.go:135] Filesystem UUIDs: map[1225cd3a-1fa6-4b66-8b71-385c194eed4c:/dev/nvme0n1p3 3946cb6a-255c-4b7d-a8e6-0743528f6417:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 07 13:16:21.098296 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.098235 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 13:16:21.102346 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.102240 2577 manager.go:216] Machine: {Timestamp:2026-07-07 13:16:21.101764727 +0000 UTC m=+0.297401942 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099221 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5fa4e1a2c0ffc6581ec7e341c105 SystemUUID:ec2b5fa4-e1a2-c0ff-c658-1ec7e341c105 BootID:1ce986b6-7dea-4eef-bcb3-e9a08482769a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:33:26:2c:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:33:26:2c:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:7d:7b:c4:30:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 13:16:21.102346 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.102344 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 13:16:21.102437 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.102411 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 13:16:21.105939 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.105914 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 13:16:21.106059 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.105942 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 13:16:21.106551 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.106540 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 13:16:21.106584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.106554 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 13:16:21.106584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.106561 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:16:21.106845 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.106829 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:16:21.107131 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.107120 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:16:21.108710 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.108701 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 13:16:21.111772 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111761 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:16:21.111885 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111876 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 13:16:21.111918 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111904 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 07 13:16:21.111948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111917 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 13:16:21.111948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111931 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 13:16:21.111948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111940 2577 kubelet.go:398] "Adding apiserver pod source" Jul 07 13:16:21.111948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.111949 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 13:16:21.112281 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.112267 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:16:21.112327 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.112297 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:16:21.114349 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.114334 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 13:16:21.123660 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.123646 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 13:16:21.123728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.123676 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 13:16:21.124826 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124815 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 13:16:21.124864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124831 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 13:16:21.124864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124837 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 13:16:21.124864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124842 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 13:16:21.124864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124851 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 13:16:21.124864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124857 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124870 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124883 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124890 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124895 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124907 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 13:16:21.124991 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.124913 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 13:16:21.125586 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.125571 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 13:16:21.125630 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.125590 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 13:16:21.129712 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.129694 2577 server.go:1268] "Started kubelet" Jul 07 13:16:21.129806 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.129768 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 13:16:21.129806 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.129779 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 13:16:21.129945 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.129812 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 13:16:21.130781 ip-10-0-131-128 systemd[1]: Started Kubernetes Kubelet. Jul 07 13:16:21.131497 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.131375 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 13:16:21.134798 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.134758 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 13:16:21.134910 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.134809 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 13:16:21.134910 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.134852 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 13:16:21.134981 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.134930 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 07 13:16:21.135551 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.135528 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 13:16:21.140292 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140272 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 13:16:21.140292 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140281 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 13:16:21.140456 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.140347 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.140856 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140838 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 13:16:21.140856 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140857 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 13:16:21.141019 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140837 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 13:16:21.141019 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140941 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 07 13:16:21.141019 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.140949 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 07 13:16:21.141260 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141243 2577 factory.go:153] Registering CRI-O factory Jul 07 13:16:21.141260 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141261 2577 factory.go:223] Registration of the crio container factory successfully Jul 07 13:16:21.141359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141310 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 13:16:21.141359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141321 2577 factory.go:55] Registering systemd factory Jul 07 13:16:21.141359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141328 2577 factory.go:223] Registration of the systemd container factory successfully Jul 07 13:16:21.141359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141350 2577 factory.go:103] Registering Raw factory Jul 07 13:16:21.141544 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141365 2577 manager.go:1196] Started watching for new ooms in manager Jul 07 13:16:21.141684 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.140798 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-128.ec2.internal.18c0044cfbf1a084 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-128.ec2.internal,UID:ip-10-0-131-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-128.ec2.internal,},FirstTimestamp:2026-07-07 13:16:21.1296585 +0000 UTC m=+0.325295698,LastTimestamp:2026-07-07 13:16:21.1296585 +0000 UTC m=+0.325295698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-128.ec2.internal,}" Jul 07 13:16:21.141831 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.141819 2577 manager.go:349] Starting recovery of all containers Jul 07 13:16:21.147777 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.147603 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 13:16:21.147777 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.147741 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 13:16:21.151430 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.151413 2577 manager.go:354] Recovery completed Jul 07 13:16:21.152352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.152336 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-882qv" Jul 07 13:16:21.156844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.156830 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.157511 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.157495 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-882qv" Jul 07 13:16:21.158708 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.158693 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.158758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.158723 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.158758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.158736 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.159364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.159264 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 13:16:21.159364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.159277 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 13:16:21.159364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.159287 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.159364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.159294 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:16:21.159998 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.159985 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.160052 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.160008 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.160052 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.160017 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.160329 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.160265 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-128.ec2.internal.18c0044cfdace6c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-128.ec2.internal,UID:ip-10-0-131-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-128.ec2.internal,},FirstTimestamp:2026-07-07 13:16:21.15870893 +0000 UTC m=+0.354346133,LastTimestamp:2026-07-07 13:16:21.15870893 +0000 UTC m=+0.354346133,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-128.ec2.internal,}" Jul 07 13:16:21.160813 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.160801 2577 policy_none.go:49] "None policy: Start" Jul 07 13:16:21.160864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.160817 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 13:16:21.160864 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.160827 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 13:16:21.162091 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.162081 2577 policy_none.go:47] "Start" Jul 07 13:16:21.199822 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.199705 2577 manager.go:337] "Starting Device Plugin manager" Jul 07 13:16:21.199913 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.199833 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 13:16:21.199913 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.199846 2577 server.go:87] "Starting device plugin registration server" Jul 07 13:16:21.200070 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.200057 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 13:16:21.200128 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.200072 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 13:16:21.200178 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.200158 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 13:16:21.200268 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.200257 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 13:16:21.200268 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.200268 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 13:16:21.200703 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.200682 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 13:16:21.200775 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.200736 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.288330 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.288303 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 13:16:21.289535 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.289521 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 13:16:21.289594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.289553 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 13:16:21.289594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.289571 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 13:16:21.289672 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.289608 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 13:16:21.291882 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.291866 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:21.300682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.300663 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.301805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.301789 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.301896 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.301821 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.301896 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.301835 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.301896 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.301863 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.312102 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.312058 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.312102 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.312082 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-128.ec2.internal\": node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.336163 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.336141 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.389803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.389780 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"] Jul 07 13:16:21.389882 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.389849 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.391186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.391170 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.391285 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.391211 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.391285 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.391223 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.392532 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.392520 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.392659 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.392646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.392696 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.392675 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.393267 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393250 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.393267 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393261 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.393370 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393277 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.393370 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393282 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.393370 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393288 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.393370 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.393292 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.394518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.394503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.394571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.394533 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:16:21.395155 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.395140 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:16:21.395246 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.395160 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:16:21.395246 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.395169 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:16:21.415850 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.415829 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-128.ec2.internal\" not found" node="ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.420158 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.420144 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-128.ec2.internal\" not found" node="ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.437001 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.436984 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.443044 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.443029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.443117 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.443053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.443117 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.443070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80af575249a2d128086706deb675b402-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"80af575249a2d128086706deb675b402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.538290 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.538263 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.544035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.544096 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.544096 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80af575249a2d128086706deb675b402-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"80af575249a2d128086706deb675b402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.544170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80af575249a2d128086706deb675b402-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"80af575249a2d128086706deb675b402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.544170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.544170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.544145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8923710175ad41f201d0500fcc137d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"8c8923710175ad41f201d0500fcc137d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.639681 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.639601 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.724480 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.724455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.724586 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.724513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:21.740689 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.740665 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.841717 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.841692 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.948205 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:21.948137 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found" Jul 07 13:16:21.985806 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:21.985785 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:22.042111 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.042087 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" Jul 07 13:16:22.052233 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.052213 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:16:22.053922 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.053910 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" Jul 07 13:16:22.065510 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.065494 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:16:22.076418 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.076397 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 13:16:22.076527 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.076507 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:16:22.076567 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.076537 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:16:22.114587 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.114567 2577 apiserver.go:52] "Watching apiserver" Jul 07 13:16:22.140388 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.140358 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 13:16:22.140489 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.140404 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 13:16:22.140723 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.140701 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-htntq","openshift-network-operator/iptables-alerter-c26j6","openshift-ovn-kubernetes/ovnkube-node-pkcmn","kube-system/global-pull-secret-syncer-69bps","kube-system/konnectivity-agent-cx68l","kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7","openshift-dns/node-resolver-2pc5c","openshift-image-registry/node-ca-m255s","openshift-multus/multus-additional-cni-plugins-5gsqm","openshift-network-diagnostics/network-check-target-j8mw5","openshift-cluster-node-tuning-operator/tuned-v7xh5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal","openshift-multus/multus-8crtf"] Jul 07 13:16:22.142389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.142374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.143654 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.143634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.144901 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.144880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.145474 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.145459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hgp5\"" Jul 07 13:16:22.145936 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.145916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 13:16:22.146050 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.146035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:22.146134 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.146104 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:22.146394 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.146378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 13:16:22.146442 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.146423 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 13:16:22.146481 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.146452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.147570 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.147556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.148883 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.148867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-konnectivity-ca\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.148930 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.148896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-agent-certs\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.148930 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.148868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.148996 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.148964 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:22.150359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.150344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.151652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.151634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.153159 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.153142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.154494 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.154474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.154581 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.154559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:22.156011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.155996 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.157605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.157585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.157605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.157596 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.157766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.157610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.157766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.157600 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 13:16:22.159404 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.159378 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:11:21 +0000 UTC" deadline="2028-04-14 09:16:54.17740387 +0000 UTC" Jul 07 13:16:22.159404 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.159400 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15524h0m32.018005929s" Jul 07 13:16:22.161948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.161924 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.162219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.162158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 13:16:22.162219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.162178 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hbkg\"" Jul 07 13:16:22.162219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.162218 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.162371 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.162355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.165272 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.165363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.165363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svtlw\"" Jul 07 13:16:22.165363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165321 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 13:16:22.165363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165347 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 13:16:22.165363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165357 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.165615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.165615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165385 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-srdcm\"" Jul 07 13:16:22.165615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165248 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 13:16:22.165615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165327 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvqnd\"" Jul 07 13:16:22.165615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.165515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 13:16:22.166538 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.166516 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 13:16:22.167352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.167194 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.167352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.167348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.167638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76m5v\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168231 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-slpd7\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d7vmg\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168656 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.168762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 13:16:22.169443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.169124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:22.169866 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.169556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zm4fg\"" Jul 07 13:16:22.181047 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.181025 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:16:22.200333 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.200284 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rch2n" Jul 07 13:16:22.209453 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.209381 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rch2n" Jul 07 13:16:22.222073 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.222051 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:22.242342 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.242325 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 13:16:22.249887 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-ovn\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.249968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnqkc\" (UniqueName: \"kubernetes.io/projected/9d0ededf-3572-45b0-b03b-a41cca78ae36-kube-api-access-fnqkc\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.249968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-host\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.249968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e5170a-098f-448e-996d-b7c039c2b3a9-tmp-dir\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.249968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-sys-fs\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.249993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-kubelet-config\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-slash\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-config\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9mdm\" (UniqueName: \"kubernetes.io/projected/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-kube-api-access-l9mdm\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-os-release\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cni-binary-copy\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-bin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-systemd\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfpn\" (UniqueName: \"kubernetes.io/projected/8e89071b-1cee-41b0-8da7-55fc65345799-kube-api-access-qlfpn\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-env-overrides\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-k8s-cni-cncf-io\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-daemon-config\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-lib-modules\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-device-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-socket-dir-parent\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-multus\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprp5\" (UniqueName: \"kubernetes.io/projected/97b5df38-5aa2-4080-8485-5a8038a2534a-kube-api-access-fprp5\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-system-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-multus-certs\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-script-lib\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q4fx\" (UniqueName: \"kubernetes.io/projected/12f67de4-c51e-4393-b311-0c5828b64463-kube-api-access-8q4fx\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cnibin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-hostroot\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d0ededf-3572-45b0-b03b-a41cca78ae36-host-slash\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.250844 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-node-log\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-netd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-conf-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-run\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-var-lib-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.250998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957zq\" (UniqueName: \"kubernetes.io/projected/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-kube-api-access-957zq\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-os-release\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-modprobe-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-tuned\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e5170a-098f-448e-996d-b7c039c2b3a9-hosts-file\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-dbus\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-bin\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcs86\" (UniqueName: \"kubernetes.io/projected/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-kube-api-access-wcs86\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysconfig\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-etc-selinux\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.251463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-socket-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-kubelet\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-netns\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-log-socket\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-netns\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-konnectivity-ca\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-system-cni-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-registration-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-etc-kubernetes\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-conf\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-sys\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrggl\" (UniqueName: \"kubernetes.io/projected/01a8182e-fec4-4b1b-a227-db8201f496b4-kube-api-access-vrggl\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-systemd-units\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-systemd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-host\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252186 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-serviceca\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-etc-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-kubelet\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-kubernetes\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-agent-certs\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-konnectivity-ca\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/a5e5170a-098f-448e-996d-b7c039c2b3a9-kube-api-access-8fd92\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.251976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-tmp\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d0ededf-3572-45b0-b03b-a41cca78ae36-iptables-alerter-script\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-cnibin\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-var-lib-kubelet\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.252832 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.252240 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 13:16:22.255413 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.255394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ddc2fa0-10aa-40a1-96eb-56064b6a187f-agent-certs\") pod \"konnectivity-agent-cx68l\" (UID: \"4ddc2fa0-10aa-40a1-96eb-56064b6a187f\") " pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.350057 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.350035 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:22.353070 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-device-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.353173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-socket-dir-parent\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-multus\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-device-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.353173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.353173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-multus\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprp5\" (UniqueName: \"kubernetes.io/projected/97b5df38-5aa2-4080-8485-5a8038a2534a-kube-api-access-fprp5\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-socket-dir-parent\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-system-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-system-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-multus-certs\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-script-lib\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q4fx\" (UniqueName: \"kubernetes.io/projected/12f67de4-c51e-4393-b311-0c5828b64463-kube-api-access-8q4fx\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cnibin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-hostroot\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d0ededf-3572-45b0-b03b-a41cca78ae36-host-slash\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-multus-certs\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-node-log\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-cni-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.353759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-netd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d0ededf-3572-45b0-b03b-a41cca78ae36-host-slash\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-conf-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-run\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-conf-dir\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-var-lib-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-node-log\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957zq\" (UniqueName: \"kubernetes.io/projected/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-kube-api-access-957zq\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-os-release\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-var-lib-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cnibin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353857 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-netd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-run\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.353971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-hostroot\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-modprobe-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.354653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-tuned\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e5170a-098f-448e-996d-b7c039c2b3a9-hosts-file\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-script-lib\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-modprobe-d\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-os-release\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-dbus\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-bin\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e5170a-098f-448e-996d-b7c039c2b3a9-hosts-file\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-dbus\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcs86\" (UniqueName: \"kubernetes.io/projected/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-kube-api-access-wcs86\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-cni-bin\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysconfig\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-etc-selinux\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysconfig\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-socket-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-kubelet\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.355571 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-netns\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-etc-selinux\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-log-socket\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-kubelet\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-netns\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-netns\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-socket-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-log-socket\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-netns\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-system-cni-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-registration-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-etc-kubernetes\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-system-cni-dir\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-conf\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-sys\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-etc-kubernetes\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.356477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-registration-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggl\" (UniqueName: \"kubernetes.io/projected/01a8182e-fec4-4b1b-a227-db8201f496b4-kube-api-access-vrggl\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-sys\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-systemd-units\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-systemd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-host\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-serviceca\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-systemd-units\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-etc-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-systemd\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-host\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-etc-openvswitch\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-sysctl-conf\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-kubelet\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-kubernetes\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-kubelet\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.354984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-kubernetes\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/a5e5170a-098f-448e-996d-b7c039c2b3a9-kube-api-access-8fd92\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.355068 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-tmp\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.355141 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:22.855120273 +0000 UTC m=+2.050757481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-serviceca\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d0ededf-3572-45b0-b03b-a41cca78ae36-iptables-alerter-script\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-cnibin\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-var-lib-kubelet\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-ovn\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.355412 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-run-ovn\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b5df38-5aa2-4080-8485-5a8038a2534a-cnibin\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.357908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-var-lib-kubelet\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnqkc\" (UniqueName: \"kubernetes.io/projected/9d0ededf-3572-45b0-b03b-a41cca78ae36-kube-api-access-fnqkc\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.355479 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:22.855460709 +0000 UTC m=+2.051097911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-host\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e5170a-098f-448e-996d-b7c039c2b3a9-tmp-dir\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-sys-fs\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-kubelet-config\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-slash\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-config\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9mdm\" (UniqueName: \"kubernetes.io/projected/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-kube-api-access-l9mdm\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-os-release\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cni-binary-copy\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9d0ededf-3572-45b0-b03b-a41cca78ae36-iptables-alerter-script\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-bin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-host-slash\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-systemd\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfpn\" (UniqueName: \"kubernetes.io/projected/8e89071b-1cee-41b0-8da7-55fc65345799-kube-api-access-qlfpn\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.358448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-os-release\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-env-overrides\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.355835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50ce6155-474e-4f48-b121-f02cc920ce9a-kubelet-config\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-k8s-cni-cncf-io\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-daemon-config\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-lib-modules\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-systemd\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-run-k8s-cni-cncf-io\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-host\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a8182e-fec4-4b1b-a227-db8201f496b4-lib-modules\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovnkube-config\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-host-var-lib-cni-bin\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-cni-binary-copy\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e5170a-098f-448e-996d-b7c039c2b3a9-tmp-dir\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12f67de4-c51e-4393-b311-0c5828b64463-sys-fs\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.356753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-multus-daemon-config\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.358947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.357065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-env-overrides\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.359487 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.357151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5df38-5aa2-4080-8485-5a8038a2534a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.359487 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.357270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-etc-tuned\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.359487 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.357469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01a8182e-fec4-4b1b-a227-db8201f496b4-tmp\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.364979 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.364799 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:22.364979 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.364823 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:22.364979 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.364838 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:22.364979 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.364890 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:22.864874943 +0000 UTC m=+2.060512153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:22.366951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.366923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q4fx\" (UniqueName: \"kubernetes.io/projected/12f67de4-c51e-4393-b311-0c5828b64463-kube-api-access-8q4fx\") pod \"aws-ebs-csi-driver-node-wllt7\" (UID: \"12f67de4-c51e-4393-b311-0c5828b64463\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.367435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.367405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprp5\" (UniqueName: \"kubernetes.io/projected/97b5df38-5aa2-4080-8485-5a8038a2534a-kube-api-access-fprp5\") pod \"multus-additional-cni-plugins-5gsqm\" (UID: \"97b5df38-5aa2-4080-8485-5a8038a2534a\") " pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.367435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.367426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-957zq\" (UniqueName: \"kubernetes.io/projected/43a92b87-4acc-4aec-99f6-f75ea3ae7de9-kube-api-access-957zq\") pod \"node-ca-m255s\" (UID: \"43a92b87-4acc-4aec-99f6-f75ea3ae7de9\") " pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.367646 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.367626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrggl\" (UniqueName: \"kubernetes.io/projected/01a8182e-fec4-4b1b-a227-db8201f496b4-kube-api-access-vrggl\") pod \"tuned-v7xh5\" (UID: \"01a8182e-fec4-4b1b-a227-db8201f496b4\") " pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.368129 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.368108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9mdm\" (UniqueName: \"kubernetes.io/projected/06e902d4-0cd8-43ab-a74d-5e8cff5b96b1-kube-api-access-l9mdm\") pod \"ovnkube-node-pkcmn\" (UID: \"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.368317 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.368299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcs86\" (UniqueName: \"kubernetes.io/projected/f18c5b9d-5ed6-42ba-be8c-d53af50fe308-kube-api-access-wcs86\") pod \"multus-8crtf\" (UID: \"f18c5b9d-5ed6-42ba-be8c-d53af50fe308\") " pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.368403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.368382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnqkc\" (UniqueName: \"kubernetes.io/projected/9d0ededf-3572-45b0-b03b-a41cca78ae36-kube-api-access-fnqkc\") pod \"iptables-alerter-c26j6\" (UID: \"9d0ededf-3572-45b0-b03b-a41cca78ae36\") " pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.368560 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.368546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfpn\" (UniqueName: \"kubernetes.io/projected/8e89071b-1cee-41b0-8da7-55fc65345799-kube-api-access-qlfpn\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.369110 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.369090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/a5e5170a-098f-448e-996d-b7c039c2b3a9-kube-api-access-8fd92\") pod \"node-resolver-2pc5c\" (UID: \"a5e5170a-098f-448e-996d-b7c039c2b3a9\") " pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.473342 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.473288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:22.479469 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.479445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8crtf" Jul 07 13:16:22.496588 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.496570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" Jul 07 13:16:22.514449 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.514430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" Jul 07 13:16:22.529274 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.529243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2pc5c" Jul 07 13:16:22.544053 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.544032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m255s" Jul 07 13:16:22.566011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.565986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" Jul 07 13:16:22.579876 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.579835 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80af575249a2d128086706deb675b402.slice/crio-8159d1228f32e7d00ddb2a0e2e1f3f83fa15ff97a86f84c0a518ecb0c74aff02 WatchSource:0}: Error finding container 8159d1228f32e7d00ddb2a0e2e1f3f83fa15ff97a86f84c0a518ecb0c74aff02: Status 404 returned error can't find the container with id 8159d1228f32e7d00ddb2a0e2e1f3f83fa15ff97a86f84c0a518ecb0c74aff02 Jul 07 13:16:22.580353 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.580333 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a92b87_4acc_4aec_99f6_f75ea3ae7de9.slice/crio-4fe10342663ef81207f4a29eae8ff687e28e22593afb7abc7e6efdb6581e8109 WatchSource:0}: Error finding container 4fe10342663ef81207f4a29eae8ff687e28e22593afb7abc7e6efdb6581e8109: Status 404 returned error can't find the container with id 4fe10342663ef81207f4a29eae8ff687e28e22593afb7abc7e6efdb6581e8109 Jul 07 13:16:22.581395 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.581369 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8923710175ad41f201d0500fcc137d.slice/crio-92725bbc650e72e1a82a5f713de1a3d4eee6d88d9a851d2b99b14f7d5272e79d WatchSource:0}: Error finding container 92725bbc650e72e1a82a5f713de1a3d4eee6d88d9a851d2b99b14f7d5272e79d: Status 404 returned error can't find the container with id 92725bbc650e72e1a82a5f713de1a3d4eee6d88d9a851d2b99b14f7d5272e79d Jul 07 13:16:22.582062 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.582038 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b5df38_5aa2_4080_8485_5a8038a2534a.slice/crio-e66159adc4cc492ca7182272fca2293975b12f42ab1348cc33ec8fbcc37c13ab WatchSource:0}: Error finding container e66159adc4cc492ca7182272fca2293975b12f42ab1348cc33ec8fbcc37c13ab: Status 404 returned error can't find the container with id e66159adc4cc492ca7182272fca2293975b12f42ab1348cc33ec8fbcc37c13ab Jul 07 13:16:22.584106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.584087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:22.585171 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.585155 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:16:22.590256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.590240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c26j6" Jul 07 13:16:22.592970 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.592948 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e902d4_0cd8_43ab_a74d_5e8cff5b96b1.slice/crio-62bf9616adda81c427735c51ca0ed495b9d4c4aa9ac12b59d2c3003ceda6f507 WatchSource:0}: Error finding container 62bf9616adda81c427735c51ca0ed495b9d4c4aa9ac12b59d2c3003ceda6f507: Status 404 returned error can't find the container with id 62bf9616adda81c427735c51ca0ed495b9d4c4aa9ac12b59d2c3003ceda6f507 Jul 07 13:16:22.598085 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.598065 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0ededf_3572_45b0_b03b_a41cca78ae36.slice/crio-57967a4d516ff695b59738178a339b150317fc7412d684e220fac60138c13eed WatchSource:0}: Error finding container 57967a4d516ff695b59738178a339b150317fc7412d684e220fac60138c13eed: Status 404 returned error can't find the container with id 57967a4d516ff695b59738178a339b150317fc7412d684e220fac60138c13eed Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.859292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.859337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.859450 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.859500 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:23.859480926 +0000 UTC m=+3.055118113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.859831 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:22.860158 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.859876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:23.859861149 +0000 UTC m=+3.055498338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:22.888704 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.888684 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddc2fa0_10aa_40a1_96eb_56064b6a187f.slice/crio-32b08d05a811f9d02ca6ff9eef117e93ccb8efe3373a9c103d7423a74e52ee65 WatchSource:0}: Error finding container 32b08d05a811f9d02ca6ff9eef117e93ccb8efe3373a9c103d7423a74e52ee65: Status 404 returned error can't find the container with id 32b08d05a811f9d02ca6ff9eef117e93ccb8efe3373a9c103d7423a74e52ee65 Jul 07 13:16:22.889335 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.889311 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a8182e_fec4_4b1b_a227_db8201f496b4.slice/crio-cef35b6096ce2753a210ba2f44f76a96f97f3e130b9a7a91a15dc8b4cb03722c WatchSource:0}: Error finding container cef35b6096ce2753a210ba2f44f76a96f97f3e130b9a7a91a15dc8b4cb03722c: Status 404 returned error can't find the container with id cef35b6096ce2753a210ba2f44f76a96f97f3e130b9a7a91a15dc8b4cb03722c Jul 07 13:16:22.902534 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.902514 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18c5b9d_5ed6_42ba_be8c_d53af50fe308.slice/crio-9e2ebb99895cd36688db88947c93a51a97dea4d8bf109b072b07e57a25615d4c WatchSource:0}: Error finding container 9e2ebb99895cd36688db88947c93a51a97dea4d8bf109b072b07e57a25615d4c: Status 404 returned error can't find the container with id 9e2ebb99895cd36688db88947c93a51a97dea4d8bf109b072b07e57a25615d4c Jul 07 13:16:22.951009 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.950983 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e5170a_098f_448e_996d_b7c039c2b3a9.slice/crio-a890b2f3f986621f17388f4ff4efd5be9b1a468d61c314029ecc9fda9316e1f5 WatchSource:0}: Error finding container a890b2f3f986621f17388f4ff4efd5be9b1a468d61c314029ecc9fda9316e1f5: Status 404 returned error can't find the container with id a890b2f3f986621f17388f4ff4efd5be9b1a468d61c314029ecc9fda9316e1f5 Jul 07 13:16:22.951338 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:22.951322 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f67de4_c51e_4393_b311_0c5828b64463.slice/crio-cf83a17ee207eba7ed32f1eb15bd68e608b0d230927896e5a603688b3311f2aa WatchSource:0}: Error finding container cf83a17ee207eba7ed32f1eb15bd68e608b0d230927896e5a603688b3311f2aa: Status 404 returned error can't find the container with id cf83a17ee207eba7ed32f1eb15bd68e608b0d230927896e5a603688b3311f2aa Jul 07 13:16:22.959888 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:22.959870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:22.959977 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.959966 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:22.960015 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.959981 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:22.960015 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.959991 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:22.960121 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:22.960033 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:23.960018121 +0000 UTC m=+3.155655312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:23.211547 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.211470 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:11:22 +0000 UTC" deadline="2028-03-25 02:54:27.699913368 +0000 UTC" Jul 07 13:16:23.211547 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.211512 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15037h38m4.488404062s" Jul 07 13:16:23.290465 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.290445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:23.290592 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.290564 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:23.294521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.294479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" event={"ID":"80af575249a2d128086706deb675b402","Type":"ContainerStarted","Data":"8159d1228f32e7d00ddb2a0e2e1f3f83fa15ff97a86f84c0a518ecb0c74aff02"} Jul 07 13:16:23.295805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.295778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8crtf" event={"ID":"f18c5b9d-5ed6-42ba-be8c-d53af50fe308","Type":"ContainerStarted","Data":"9e2ebb99895cd36688db88947c93a51a97dea4d8bf109b072b07e57a25615d4c"} Jul 07 13:16:23.297161 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.297110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" event={"ID":"01a8182e-fec4-4b1b-a227-db8201f496b4","Type":"ContainerStarted","Data":"cef35b6096ce2753a210ba2f44f76a96f97f3e130b9a7a91a15dc8b4cb03722c"} Jul 07 13:16:23.298410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.298386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx68l" event={"ID":"4ddc2fa0-10aa-40a1-96eb-56064b6a187f","Type":"ContainerStarted","Data":"32b08d05a811f9d02ca6ff9eef117e93ccb8efe3373a9c103d7423a74e52ee65"} Jul 07 13:16:23.299866 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.299834 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"62bf9616adda81c427735c51ca0ed495b9d4c4aa9ac12b59d2c3003ceda6f507"} Jul 07 13:16:23.301290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.301257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"8c8923710175ad41f201d0500fcc137d","Type":"ContainerStarted","Data":"92725bbc650e72e1a82a5f713de1a3d4eee6d88d9a851d2b99b14f7d5272e79d"} Jul 07 13:16:23.304042 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.303973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" event={"ID":"12f67de4-c51e-4393-b311-0c5828b64463","Type":"ContainerStarted","Data":"cf83a17ee207eba7ed32f1eb15bd68e608b0d230927896e5a603688b3311f2aa"} Jul 07 13:16:23.306035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.306006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2pc5c" event={"ID":"a5e5170a-098f-448e-996d-b7c039c2b3a9","Type":"ContainerStarted","Data":"a890b2f3f986621f17388f4ff4efd5be9b1a468d61c314029ecc9fda9316e1f5"} Jul 07 13:16:23.307320 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.307295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c26j6" event={"ID":"9d0ededf-3572-45b0-b03b-a41cca78ae36","Type":"ContainerStarted","Data":"57967a4d516ff695b59738178a339b150317fc7412d684e220fac60138c13eed"} Jul 07 13:16:23.308669 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.308643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerStarted","Data":"e66159adc4cc492ca7182272fca2293975b12f42ab1348cc33ec8fbcc37c13ab"} Jul 07 13:16:23.309950 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.309928 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m255s" event={"ID":"43a92b87-4acc-4aec-99f6-f75ea3ae7de9","Type":"ContainerStarted","Data":"4fe10342663ef81207f4a29eae8ff687e28e22593afb7abc7e6efdb6581e8109"} Jul 07 13:16:23.326783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.326759 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:23.866175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.866126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:23.866175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.866188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:23.866445 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.866333 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:23.866791 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.866716 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:23.866915 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.866806 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:25.866778643 +0000 UTC m=+5.062415830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:23.866915 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.866833 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:25.866821969 +0000 UTC m=+5.062459164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:23.968339 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:23.968307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:23.968561 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.968521 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:23.968561 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.968549 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:23.968707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.968564 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:23.968707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:23.968639 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:25.968620128 +0000 UTC m=+5.164257318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:24.212350 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:24.212106 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:11:22 +0000 UTC" deadline="2028-01-13 23:34:20.506055614 +0000 UTC" Jul 07 13:16:24.212350 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:24.212147 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13330h17m56.29391321s" Jul 07 13:16:24.290871 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:24.290837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:24.291032 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:24.290978 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:24.291433 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:24.291411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:24.291550 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:24.291517 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:25.157036 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:25.157004 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:16:25.293146 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:25.293077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:25.293620 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.293221 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:25.888726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:25.888784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.888953 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.889017 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:29.888998147 +0000 UTC m=+9.084635337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.889450 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:25.889541 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.889502 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:29.88948535 +0000 UTC m=+9.085122540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:25.989848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:25.989169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:25.989848 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.989408 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:25.989848 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.989432 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:25.989848 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.989445 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:25.989848 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:25.989503 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:29.989484202 +0000 UTC m=+9.185121393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:26.289969 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:26.289797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:26.289969 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:26.289959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:26.290256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:26.290125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:26.290387 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:26.290357 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:27.290364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:27.290332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:27.290831 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:27.290468 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:28.291355 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:28.290648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:28.291355 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:28.290784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:28.291355 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:28.291167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:28.291355 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:28.291290 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:29.290327 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:29.290263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:29.290466 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:29.290389 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:29.918752 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:29.918718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:29.918752 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:29.918765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:29.919300 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:29.918899 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:29.919300 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:29.918904 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:29.919300 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:29.918958 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:37.918940484 +0000 UTC m=+17.114577675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:29.919300 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:29.918976 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:37.918966793 +0000 UTC m=+17.114603984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:30.019405 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:30.019379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:30.019563 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.019538 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:30.019563 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.019559 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:30.019636 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.019568 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:30.019636 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.019615 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:38.019602339 +0000 UTC m=+17.215239524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:30.291148 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:30.290658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:30.291148 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.290792 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:30.291148 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:30.290944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:30.291148 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:30.291034 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:31.291076 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:31.291041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:31.291522 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:31.291174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:32.290414 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:32.290375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:32.290562 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:32.290380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:32.290562 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:32.290504 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:32.290686 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:32.290562 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:33.290556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:33.290523 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:33.291001 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:33.290663 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:34.290518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:34.290424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:34.290747 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:34.290563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:34.291294 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:34.291154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:34.291561 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:34.291511 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:35.290578 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:35.290546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:35.290740 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:35.290660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:36.289976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:36.289939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:36.290445 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:36.290075 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:36.290445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:36.290122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:36.290445 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:36.290245 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:37.290358 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:37.290323 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:37.290748 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:37.290454 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:37.981865 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:37.981833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:37.982034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:37.981877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:37.982034 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:37.981987 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:37.982034 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:37.981990 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:37.982152 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:37.982048 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:16:53.982030632 +0000 UTC m=+33.177667823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:37.982152 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:37.982068 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:53.982057824 +0000 UTC m=+33.177695010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:38.082934 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:38.082904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:38.083103 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.083082 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:38.083150 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.083109 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:38.083150 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.083123 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:38.083266 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.083181 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:16:54.083164122 +0000 UTC m=+33.278801321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:38.290530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:38.290453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:38.290530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:38.290475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:38.290937 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.290587 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:38.290937 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:38.290718 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:39.290579 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:39.290549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:39.291037 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:39.290679 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:40.290413 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:40.290382 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:40.290594 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:40.290502 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:40.290594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:40.290574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:40.290972 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:40.290699 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:41.290949 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:41.290708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:41.291422 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:41.291034 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:42.290595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:42.290556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:42.290595 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:42.290594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:42.290828 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:42.290694 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:42.290892 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:42.290845 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:43.290175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:43.290156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:43.290518 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:43.290284 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:43.400035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:43.400006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" event={"ID":"80af575249a2d128086706deb675b402","Type":"ContainerStarted","Data":"4c7e5cd8dfb99d8748296504d861fb98bc765d227f70790847048b2ebfe79213"} Jul 07 13:16:44.290690 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.290558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:44.291188 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.290615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:44.291188 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:44.290763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:44.291188 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:44.290836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:44.403432 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.403400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c26j6" event={"ID":"9d0ededf-3572-45b0-b03b-a41cca78ae36","Type":"ContainerStarted","Data":"788968b7056661e81d297c62b3146617473b6aa19c7a22d06a5edfaec9bbb398"} Jul 07 13:16:44.405317 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.405293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8crtf" event={"ID":"f18c5b9d-5ed6-42ba-be8c-d53af50fe308","Type":"ContainerStarted","Data":"5397e24ca3c2a7f17ef26b983ef9b2ea252d8f0d21c34ec6eb1d675622992f1d"} Jul 07 13:16:44.406920 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.406895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" event={"ID":"01a8182e-fec4-4b1b-a227-db8201f496b4","Type":"ContainerStarted","Data":"d36631538fa4318ca71fe71c75f02577c2467750592eb7f5ffdd067c4d43d6a3"} Jul 07 13:16:44.416475 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.415149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:16:44.417161 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417131 2577 generic.go:356] "Generic (PLEG): container finished" podID="06e902d4-0cd8-43ab-a74d-5e8cff5b96b1" containerID="d3d44fb11d0aea3bb43b7abb5720f1bc7b4224cec48cdc3e8d09e9dba351ce37" exitCode=1 Jul 07 13:16:44.417278 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"50ed250e299e447da69394593935e3f749a7d9bbf1d84103ba969bb0d8db7203"} Jul 07 13:16:44.417338 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"19c7414eeef8eb65905991192b03efee493ae8cc86e0f1b8c9bc2786d042da0e"} Jul 07 13:16:44.417393 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"de6f35995bfb83b1f685cd53b09ac7e398c38c919d21ecbcfd5174ea61d9258d"} Jul 07 13:16:44.417438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"dab70edc95d3298f0b64ef386bc3d2e50bf117ba794b1ff6a72cbccfd6f6868e"} Jul 07 13:16:44.417502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerDied","Data":"d3d44fb11d0aea3bb43b7abb5720f1bc7b4224cec48cdc3e8d09e9dba351ce37"} Jul 07 13:16:44.417564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.417505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"173c483b1b208e3f3bf241fe21e8616aae22676e90a4522653e4ef1f0a5d4c29"} Jul 07 13:16:44.418377 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.418319 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c26j6" podStartSLOduration=10.241051266 podStartE2EDuration="22.418304569s" totalImagesPullingTime="12.177253303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:44.418152494 +0000 UTC m=+23.613789723" watchObservedRunningTime="2026-07-07 13:16:44.418304569 +0000 UTC m=+23.613941781" Jul 07 13:16:44.436889 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.436818 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8crtf" podStartSLOduration=3.105898202 podStartE2EDuration="23.436804601s" totalImagesPullingTime="20.330906399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:44.436618187 +0000 UTC m=+23.632255395" watchObservedRunningTime="2026-07-07 13:16:44.436804601 +0000 UTC m=+23.632441810" Jul 07 13:16:44.457218 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:44.457166 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" podStartSLOduration=22.4571544 podStartE2EDuration="22.4571544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:44.456624697 +0000 UTC m=+23.652261901" watchObservedRunningTime="2026-07-07 13:16:44.4571544 +0000 UTC m=+23.652791608" Jul 07 13:16:45.290821 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.290794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:45.291313 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:45.290891 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:45.421266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.421232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx68l" event={"ID":"4ddc2fa0-10aa-40a1-96eb-56064b6a187f","Type":"ContainerStarted","Data":"ee1404ab3eace8d5671a450c96fdaf6c79146046999a92278d621a17dfe830da"} Jul 07 13:16:45.423057 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.423028 2577 generic.go:356] "Generic (PLEG): container finished" podID="8c8923710175ad41f201d0500fcc137d" containerID="7692df6e820d6c71f77ecec7f26a9ec2365267941aac9bd10791ab63d9d26314" exitCode=0 Jul 07 13:16:45.423228 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.423121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"8c8923710175ad41f201d0500fcc137d","Type":"ContainerDied","Data":"7692df6e820d6c71f77ecec7f26a9ec2365267941aac9bd10791ab63d9d26314"} Jul 07 13:16:45.425175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.425151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" event={"ID":"12f67de4-c51e-4393-b311-0c5828b64463","Type":"ContainerStarted","Data":"d53a0d01fb90d2c0720e017ef40178078525b7e35d6bf4a7459008fcff283b52"} Jul 07 13:16:45.426861 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.426835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2pc5c" event={"ID":"a5e5170a-098f-448e-996d-b7c039c2b3a9","Type":"ContainerStarted","Data":"018d5751e321b986ef827a6c1936a8e7606aed0f99f4463e13fca18e88048c50"} Jul 07 13:16:45.428484 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.428461 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="9efa80e822198dca506e85326879889b13a176dab9a15793aa7f7ef85eade39e" exitCode=0 Jul 07 13:16:45.428577 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.428528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"9efa80e822198dca506e85326879889b13a176dab9a15793aa7f7ef85eade39e"} Jul 07 13:16:45.430322 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.430247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m255s" event={"ID":"43a92b87-4acc-4aec-99f6-f75ea3ae7de9","Type":"ContainerStarted","Data":"687e114f8b94639fcea77609bfb1390f5e76dab6d2e83cc8b96147736f3cebe3"} Jul 07 13:16:45.435574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.435539 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v7xh5" podStartSLOduration=4.128763534 podStartE2EDuration="24.435526385s" totalImagesPullingTime="20.306762851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:44.479435463 +0000 UTC m=+23.675072688" watchObservedRunningTime="2026-07-07 13:16:45.435526385 +0000 UTC m=+24.631163621" Jul 07 13:16:45.436012 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.435981 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cx68l" podStartSLOduration=4.152459943 podStartE2EDuration="24.435972403s" totalImagesPullingTime="20.28351246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:45.435608048 +0000 UTC m=+24.631245257" watchObservedRunningTime="2026-07-07 13:16:45.435972403 +0000 UTC m=+24.631609611" Jul 07 13:16:45.470860 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.470802 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2pc5c" podStartSLOduration=3.245074306 podStartE2EDuration="23.470790968s" totalImagesPullingTime="20.225716662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:45.470661574 +0000 UTC m=+24.666298783" watchObservedRunningTime="2026-07-07 13:16:45.470790968 +0000 UTC m=+24.666428176" Jul 07 13:16:45.483958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.483916 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m255s" podStartSLOduration=2.891865275 podStartE2EDuration="23.483901822s" totalImagesPullingTime="20.592036547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:45.483672151 +0000 UTC m=+24.679309362" watchObservedRunningTime="2026-07-07 13:16:45.483901822 +0000 UTC m=+24.679539032" Jul 07 13:16:45.664036 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.664014 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:45.664532 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:45.664518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:46.035430 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.035405 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 13:16:46.212493 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.212387 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:16:46.03542656Z","UUID":"917592e4-f583-4eb2-9a99-180533aa9bb9","Handler":null,"Name":"","Endpoint":""} Jul 07 13:16:46.213555 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.213534 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 13:16:46.213647 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.213566 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 13:16:46.290480 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.290448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:46.290599 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.290480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:46.290599 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:46.290577 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:46.290741 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:46.290720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:46.435938 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.435913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"8c8923710175ad41f201d0500fcc137d","Type":"ContainerStarted","Data":"d6afd8b114f78f89d0965f79d485333ea8efdaaec3cb43b1d8c5bb5e2209224d"} Jul 07 13:16:46.437843 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.437816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" event={"ID":"12f67de4-c51e-4393-b311-0c5828b64463","Type":"ContainerStarted","Data":"78e0a542ab9e83798c93a4b43b70da0c9b2e66bb0e64d3fb1ab9eb2a14cd87d9"} Jul 07 13:16:46.449756 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:46.449720 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" podStartSLOduration=24.449707266 podStartE2EDuration="24.449707266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:46.449636348 +0000 UTC m=+25.645273555" watchObservedRunningTime="2026-07-07 13:16:46.449707266 +0000 UTC m=+25.645344474" Jul 07 13:16:47.289948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:47.289919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:47.290120 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:47.290037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:47.443486 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:47.443459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:16:47.443897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:47.443868 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 13:16:47.444043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:47.444013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"926cfe3f2dd18febd16c6da1838c8b16fb7e178ce5d4dd7b8ed255a65d37beee"} Jul 07 13:16:48.290507 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:48.290475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:48.290686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:48.290475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:48.290686 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:48.290583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:48.290686 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:48.290668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:48.448297 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:48.448258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" event={"ID":"12f67de4-c51e-4393-b311-0c5828b64463","Type":"ContainerStarted","Data":"4c90d2dc927071525e8171ece573265d1eb97e01d8c58d6b98eebfd6c00992d9"} Jul 07 13:16:48.464584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:48.464526 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wllt7" podStartSLOduration=3.298719544 podStartE2EDuration="26.464506535s" totalImagesPullingTime="23.165786991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:48.463760278 +0000 UTC m=+27.659397505" watchObservedRunningTime="2026-07-07 13:16:48.464506535 +0000 UTC m=+27.660143744" Jul 07 13:16:49.290580 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:49.290508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:49.290713 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:49.290629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:49.453010 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:49.452986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:16:49.453664 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:49.453339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"7f6b90e05fad27032eb746c02a205a08734dcc7924de438390f231b93ed9b709"} Jul 07 13:16:49.453889 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:49.453873 2577 scope.go:117] "RemoveContainer" containerID="d3d44fb11d0aea3bb43b7abb5720f1bc7b4224cec48cdc3e8d09e9dba351ce37" Jul 07 13:16:50.290462 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.290234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:50.290636 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.290285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:50.290636 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:50.290569 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:50.290768 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:50.290636 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:50.460784 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.460763 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:16:50.461204 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.461163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" event={"ID":"06e902d4-0cd8-43ab-a74d-5e8cff5b96b1","Type":"ContainerStarted","Data":"33eeddc6f0513fcd755c9d6c9ee7a73dc85a4d6e73331f359610c23bc5383962"} Jul 07 13:16:50.461509 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.461490 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:50.461609 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.461587 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:50.461773 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.461748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:50.479783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.479759 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:50.480327 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.480310 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:16:50.489101 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.489061 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" podStartSLOduration=7.419292785 podStartE2EDuration="28.489048392s" totalImagesPullingTime="21.069755607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:16:50.487583306 +0000 UTC m=+29.683220512" watchObservedRunningTime="2026-07-07 13:16:50.489048392 +0000 UTC m=+29.684685600" Jul 07 13:16:50.564391 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.564295 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:50.564509 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.564462 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 13:16:50.564948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.564922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cx68l" Jul 07 13:16:50.604531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.604503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-69bps"] Jul 07 13:16:50.604640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.604602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:50.604700 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:50.604683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:50.612577 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.612420 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-htntq"] Jul 07 13:16:50.612577 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.612521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:50.612711 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:50.612616 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:50.613239 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.613206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8mw5"] Jul 07 13:16:50.613335 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:50.613304 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:50.613418 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:50.613392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:52.290169 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:52.290137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:52.290585 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:52.290137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:52.290585 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:52.290266 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:52.290585 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:52.290136 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:52.290585 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:52.290321 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:52.290585 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:52.290379 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:52.467838 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:52.467809 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="a35ef542087a427ebf54f203055e9a6a0c97c04471d22ec2ab27e8e5dbe703d3" exitCode=0 Jul 07 13:16:52.467985 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:52.467867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"a35ef542087a427ebf54f203055e9a6a0c97c04471d22ec2ab27e8e5dbe703d3"} Jul 07 13:16:53.472138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:53.472102 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="14e28cba37a8469e088e083c21fc70a0efb15fc589d2349a2ebac707ebc502cf" exitCode=0 Jul 07 13:16:53.472435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:53.472165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"14e28cba37a8469e088e083c21fc70a0efb15fc589d2349a2ebac707ebc502cf"} Jul 07 13:16:54.006008 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.005983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:54.006164 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.006015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:54.006164 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.006115 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:54.006164 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.006117 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:54.006271 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.006166 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret podName:50ce6155-474e-4f48-b121-f02cc920ce9a nodeName:}" failed. No retries permitted until 2026-07-07 13:17:26.006150445 +0000 UTC m=+65.201787633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret") pod "global-pull-secret-syncer-69bps" (UID: "50ce6155-474e-4f48-b121-f02cc920ce9a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:16:54.006271 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.006181 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs podName:8e89071b-1cee-41b0-8da7-55fc65345799 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:26.006174411 +0000 UTC m=+65.201811597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs") pod "network-metrics-daemon-htntq" (UID: "8e89071b-1cee-41b0-8da7-55fc65345799") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:16:54.106305 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.106279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:54.106458 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.106440 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:16:54.106548 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.106464 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:16:54.106548 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.106474 2577 projected.go:196] Error preparing data for projected volume kube-api-access-c26z8 for pod openshift-network-diagnostics/network-check-target-j8mw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:54.106548 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.106528 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8 podName:d858c505-ac45-406f-a19c-cff71dc0b55b nodeName:}" failed. No retries permitted until 2026-07-07 13:17:26.106510608 +0000 UTC m=+65.302147820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c26z8" (UniqueName: "kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8") pod "network-check-target-j8mw5" (UID: "d858c505-ac45-406f-a19c-cff71dc0b55b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:16:54.290628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.290548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:54.290628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.290572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:54.290780 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.290653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:54.290780 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.290661 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69bps" podUID="50ce6155-474e-4f48-b121-f02cc920ce9a" Jul 07 13:16:54.290780 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.290720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8mw5" podUID="d858c505-ac45-406f-a19c-cff71dc0b55b" Jul 07 13:16:54.290879 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:54.290786 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htntq" podUID="8e89071b-1cee-41b0-8da7-55fc65345799" Jul 07 13:16:54.476526 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.476500 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="d395938af65dd0330d4e110b4db790578a0c34a5bdfbd863399294c32c202b14" exitCode=0 Jul 07 13:16:54.476783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:54.476553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"d395938af65dd0330d4e110b4db790578a0c34a5bdfbd863399294c32c202b14"} Jul 07 13:16:56.155558 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.155533 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeReady" Jul 07 13:16:56.155829 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.155638 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 13:16:56.186413 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.186390 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8k5xf"] Jul 07 13:16:56.188756 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.188737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.191174 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.190818 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z"] Jul 07 13:16:56.192072 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.191832 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 13:16:56.192072 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.191872 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.192590 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.192494 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 13:16:56.192671 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.192622 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.193874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.193728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k926f\"" Jul 07 13:16:56.193874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.193814 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx"] Jul 07 13:16:56.194629 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.194122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.196515 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.196495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 13:16:56.196730 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.196712 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:16:56.196865 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.196847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" Jul 07 13:16:56.197518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.197402 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.197518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.197419 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.197692 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.197676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mx56r\"" Jul 07 13:16:56.198367 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.198308 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 13:16:56.199626 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.199602 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.199789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.199770 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p"] Jul 07 13:16:56.199907 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.199865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.200256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.200236 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h68sz\"" Jul 07 13:16:56.200783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.200742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.202821 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.202803 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl"] Jul 07 13:16:56.202954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.202926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.204238 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.204216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 13:16:56.204341 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.204281 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 13:16:56.204341 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.204320 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x9hsn\"" Jul 07 13:16:56.204454 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.204221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 13:16:56.206426 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.206404 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.206688 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.206667 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.208638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.206673 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 13:16:56.210014 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.209711 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f45kt\"" Jul 07 13:16:56.211277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.211256 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 13:16:56.211557 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.211540 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42"] Jul 07 13:16:56.212290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.212234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.219657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.219635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.219852 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5874b88bf5-twgml"] Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.220277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.220375 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.220493 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.220691 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.221853 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.222221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.221941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nnpkz\"" Jul 07 13:16:56.223507 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.223486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.223604 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.223512 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 13:16:56.223680 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.223665 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 13:16:56.223878 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.223766 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2v29b\"" Jul 07 13:16:56.223878 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.223794 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.224396 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8k5xf"] Jul 07 13:16:56.224503 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z"] Jul 07 13:16:56.224578 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224522 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl"] Jul 07 13:16:56.224578 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224543 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx"] Jul 07 13:16:56.224578 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224564 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42"] Jul 07 13:16:56.224727 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224583 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5874b88bf5-twgml"] Jul 07 13:16:56.224727 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224603 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:16:56.224727 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.224685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.225299 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.225276 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c9jzp"] Jul 07 13:16:56.227475 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.227457 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 13:16:56.227684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.227668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 13:16:56.227834 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.227822 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 13:16:56.227916 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.227896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.228099 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.228081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jldlk\"" Jul 07 13:16:56.228347 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.228326 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 13:16:56.228475 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.228357 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.228631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.228614 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-njxlf"] Jul 07 13:16:56.228849 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.228831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.231468 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.231448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 13:16:56.231619 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.231454 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 13:16:56.233954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.233935 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9z84"] Jul 07 13:16:56.234543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.234526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nmbgg\"" Jul 07 13:16:56.234736 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.234714 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.237129 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.236851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.237519 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.237496 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 13:16:56.237668 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.237651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jjmjd\"" Jul 07 13:16:56.237809 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.237698 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 13:16:56.237929 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.237907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.239242 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.239223 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-69ffc"] Jul 07 13:16:56.240056 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.239322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.242525 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.242502 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8pcw\"" Jul 07 13:16:56.242659 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.242639 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl"] Jul 07 13:16:56.242748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.242729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.242816 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.242762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 13:16:56.242871 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.242849 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 13:16:56.246141 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246121 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p"] Jul 07 13:16:56.246316 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246302 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9jzp"] Jul 07 13:16:56.246427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-njxlf"] Jul 07 13:16:56.246539 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9z84"] Jul 07 13:16:56.246654 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9d22t\"" Jul 07 13:16:56.246906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246886 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.247160 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.247138 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.247293 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.247273 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 13:16:56.247418 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.246981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" Jul 07 13:16:56.248747 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.248730 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl"] Jul 07 13:16:56.250824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.250789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6npmb\"" Jul 07 13:16:56.251025 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.251007 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 13:16:56.251591 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.250835 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 13:16:56.253222 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.253153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-69ffc"] Jul 07 13:16:56.255391 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.255365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 13:16:56.290110 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.290092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:16:56.290207 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.290131 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:16:56.290491 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.290475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:16:56.292654 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.292638 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:16:56.292774 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.292743 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:16:56.292875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.292747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sgxmd\"" Jul 07 13:16:56.293023 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.293003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9nksx\"" Jul 07 13:16:56.320518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ltz\" (UniqueName: \"kubernetes.io/projected/61b4e213-d827-4b00-ad59-7ff002b64d8a-kube-api-access-s5ltz\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.320622 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwbhd\" (UniqueName: \"kubernetes.io/projected/311549ba-2690-4506-a0af-c2645206e9ba-kube-api-access-wwbhd\") pod \"network-check-source-989f8b8dc-cjfvl\" (UID: \"311549ba-2690-4506-a0af-c2645206e9ba\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" Jul 07 13:16:56.320622 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-snapshots\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.320622 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.320622 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c891437-b0d1-4110-862c-e7814184f260-serving-cert\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5td\" (UniqueName: \"kubernetes.io/projected/5e3b5036-a79d-4657-9b8e-09657b388591-kube-api-access-qm5td\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e3b5036-a79d-4657-9b8e-09657b388591-config\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.320771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcgc\" (UniqueName: \"kubernetes.io/projected/383c811f-4e82-42cc-9273-0c8b0086710f-kube-api-access-dlcgc\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-trusted-ca\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/383c811f-4e82-42cc-9273-0c8b0086710f-config-volume\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr64v\" (UniqueName: \"kubernetes.io/projected/8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4-kube-api-access-qr64v\") pod \"volume-data-source-validator-5d456fdbcd-67jfx\" (UID: \"8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.320981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.321020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjg2g\" (UniqueName: \"kubernetes.io/projected/8ad1eaab-5426-4732-b6db-b9a0c1147f62-kube-api-access-sjg2g\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-stats-auth\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnvlr\" (UniqueName: \"kubernetes.io/projected/877f0aa1-2394-4755-b32c-3ec26ae972a9-kube-api-access-gnvlr\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vm6r\" (UniqueName: \"kubernetes.io/projected/19043063-7585-4e5c-81b6-06de25fb13eb-kube-api-access-6vm6r\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61b4e213-d827-4b00-ad59-7ff002b64d8a-cert\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-tmp\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/383c811f-4e82-42cc-9273-0c8b0086710f-tmp-dir\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdnl\" (UniqueName: \"kubernetes.io/projected/b17f6e88-5a54-4b02-96b2-28788c73a2ad-kube-api-access-vjdnl\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n74sc\" (UniqueName: \"kubernetes.io/projected/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-kube-api-access-n74sc\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.321401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t59f\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brm5l\" (UniqueName: \"kubernetes.io/projected/2c891437-b0d1-4110-862c-e7814184f260-kube-api-access-brm5l\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/877f0aa1-2394-4755-b32c-3ec26ae972a9-serving-cert\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1ab24e1-6dba-4a85-83da-42b7b3692268-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-default-certificate\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19043063-7585-4e5c-81b6-06de25fb13eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-config\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.322001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.321976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e3b5036-a79d-4657-9b8e-09657b388591-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.322414 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.322014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19043063-7585-4e5c-81b6-06de25fb13eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.367179 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.367152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx68l_4ddc2fa0-10aa-40a1-96eb-56064b6a187f/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:56.423095 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t59f\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.423226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brm5l\" (UniqueName: \"kubernetes.io/projected/2c891437-b0d1-4110-862c-e7814184f260-kube-api-access-brm5l\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.423226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/877f0aa1-2394-4755-b32c-3ec26ae972a9-serving-cert\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.423226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1ab24e1-6dba-4a85-83da-42b7b3692268-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.423375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-default-certificate\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.423375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19043063-7585-4e5c-81b6-06de25fb13eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.423375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.423521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-config\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.423521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.423521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e3b5036-a79d-4657-9b8e-09657b388591-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.423521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19043063-7585-4e5c-81b6-06de25fb13eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.423705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ltz\" (UniqueName: \"kubernetes.io/projected/61b4e213-d827-4b00-ad59-7ff002b64d8a-kube-api-access-s5ltz\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.423705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwbhd\" (UniqueName: \"kubernetes.io/projected/311549ba-2690-4506-a0af-c2645206e9ba-kube-api-access-wwbhd\") pod \"network-check-source-989f8b8dc-cjfvl\" (UID: \"311549ba-2690-4506-a0af-c2645206e9ba\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" Jul 07 13:16:56.423705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-snapshots\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.423846 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.423846 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c891437-b0d1-4110-862c-e7814184f260-serving-cert\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.423846 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5td\" (UniqueName: \"kubernetes.io/projected/5e3b5036-a79d-4657-9b8e-09657b388591-kube-api-access-qm5td\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.423846 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e3b5036-a79d-4657-9b8e-09657b388591-config\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19043063-7585-4e5c-81b6-06de25fb13eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcgc\" (UniqueName: \"kubernetes.io/projected/383c811f-4e82-42cc-9273-0c8b0086710f-kube-api-access-dlcgc\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-trusted-ca\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.423993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/383c811f-4e82-42cc-9273-0c8b0086710f-config-volume\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.424038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr64v\" (UniqueName: \"kubernetes.io/projected/8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4-kube-api-access-qr64v\") pod \"volume-data-source-validator-5d456fdbcd-67jfx\" (UID: \"8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjg2g\" (UniqueName: \"kubernetes.io/projected/8ad1eaab-5426-4732-b6db-b9a0c1147f62-kube-api-access-sjg2g\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-stats-auth\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnvlr\" (UniqueName: \"kubernetes.io/projected/877f0aa1-2394-4755-b32c-3ec26ae972a9-kube-api-access-gnvlr\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vm6r\" (UniqueName: \"kubernetes.io/projected/19043063-7585-4e5c-81b6-06de25fb13eb-kube-api-access-6vm6r\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.424455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61b4e213-d827-4b00-ad59-7ff002b64d8a-cert\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-tmp\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/383c811f-4e82-42cc-9273-0c8b0086710f-tmp-dir\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdnl\" (UniqueName: \"kubernetes.io/projected/b17f6e88-5a54-4b02-96b2-28788c73a2ad-kube-api-access-vjdnl\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-snapshots\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n74sc\" (UniqueName: \"kubernetes.io/projected/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-kube-api-access-n74sc\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-config\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1ab24e1-6dba-4a85-83da-42b7b3692268-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.424744 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.424757 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.424848 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.924832234 +0000 UTC m=+36.120469420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:16:56.425034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.424887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.425651 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425234 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:16:56.425651 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425293 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.925276437 +0000 UTC m=+36.120913625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:16:56.425651 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425478 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:16:56.425651 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.925509164 +0000 UTC m=+36.121146352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:16:56.425651 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425597 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.925585232 +0000 UTC m=+36.121222420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.425982 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.426053 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.926034129 +0000 UTC m=+36.121671316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.426208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.426282 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.426564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/383c811f-4e82-42cc-9273-0c8b0086710f-config-volume\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.426743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e3b5036-a79d-4657-9b8e-09657b388591-config\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.426982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877f0aa1-2394-4755-b32c-3ec26ae972a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.427008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877f0aa1-2394-4755-b32c-3ec26ae972a9-tmp\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.427039 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.927023764 +0000 UTC m=+36.122660952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.427249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/383c811f-4e82-42cc-9273-0c8b0086710f-tmp-dir\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.427266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c891437-b0d1-4110-862c-e7814184f260-trusted-ca\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.427505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.427574 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:16:56.427824 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.427614 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:56.927601197 +0000 UTC m=+36.123238395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:16:56.428543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.428381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/877f0aa1-2394-4755-b32c-3ec26ae972a9-serving-cert\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.429274 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.429218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.429358 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.429334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19043063-7585-4e5c-81b6-06de25fb13eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.429602 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.429578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.429677 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.429648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-default-certificate\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.433954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.430116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.433954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.430448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-stats-auth\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.433954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.430707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61b4e213-d827-4b00-ad59-7ff002b64d8a-cert\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.433954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.432494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e3b5036-a79d-4657-9b8e-09657b388591-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.435025 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.434974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c891437-b0d1-4110-862c-e7814184f260-serving-cert\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.436907 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.436881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ltz\" (UniqueName: \"kubernetes.io/projected/61b4e213-d827-4b00-ad59-7ff002b64d8a-kube-api-access-s5ltz\") pod \"ingress-canary-69ffc\" (UID: \"61b4e213-d827-4b00-ad59-7ff002b64d8a\") " pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwbhd\" (UniqueName: \"kubernetes.io/projected/311549ba-2690-4506-a0af-c2645206e9ba-kube-api-access-wwbhd\") pod \"network-check-source-989f8b8dc-cjfvl\" (UID: \"311549ba-2690-4506-a0af-c2645206e9ba\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brm5l\" (UniqueName: \"kubernetes.io/projected/2c891437-b0d1-4110-862c-e7814184f260-kube-api-access-brm5l\") pod \"console-operator-68b757fb67-njxlf\" (UID: \"2c891437-b0d1-4110-862c-e7814184f260\") " pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5td\" (UniqueName: \"kubernetes.io/projected/5e3b5036-a79d-4657-9b8e-09657b388591-kube-api-access-qm5td\") pod \"service-ca-operator-5d46d9ffd4-p9pkl\" (UID: \"5e3b5036-a79d-4657-9b8e-09657b388591\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnvlr\" (UniqueName: \"kubernetes.io/projected/877f0aa1-2394-4755-b32c-3ec26ae972a9-kube-api-access-gnvlr\") pod \"insights-operator-5c847dcfc4-8k5xf\" (UID: \"877f0aa1-2394-4755-b32c-3ec26ae972a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr64v\" (UniqueName: \"kubernetes.io/projected/8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4-kube-api-access-qr64v\") pod \"volume-data-source-validator-5d456fdbcd-67jfx\" (UID: \"8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t59f\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.439682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.439680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n74sc\" (UniqueName: \"kubernetes.io/projected/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-kube-api-access-n74sc\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.440514 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.440484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vm6r\" (UniqueName: \"kubernetes.io/projected/19043063-7585-4e5c-81b6-06de25fb13eb-kube-api-access-6vm6r\") pod \"kube-storage-version-migrator-operator-846bf668f7-cjc42\" (UID: \"19043063-7585-4e5c-81b6-06de25fb13eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.441432 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.441408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.442051 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.442022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcgc\" (UniqueName: \"kubernetes.io/projected/383c811f-4e82-42cc-9273-0c8b0086710f-kube-api-access-dlcgc\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.442174 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.442159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjg2g\" (UniqueName: \"kubernetes.io/projected/8ad1eaab-5426-4732-b6db-b9a0c1147f62-kube-api-access-sjg2g\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.442456 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.442434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdnl\" (UniqueName: \"kubernetes.io/projected/b17f6e88-5a54-4b02-96b2-28788c73a2ad-kube-api-access-vjdnl\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.458524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.458490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx68l_4ddc2fa0-10aa-40a1-96eb-56064b6a187f/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:56.506553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.506522 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" Jul 07 13:16:56.531477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.531452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" Jul 07 13:16:56.560743 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.560691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" Jul 07 13:16:56.568291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.567765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" Jul 07 13:16:56.590502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.590273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:16:56.609185 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.609067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-69ffc" Jul 07 13:16:56.611156 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.611099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" Jul 07 13:16:56.728414 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.728026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8k5xf"] Jul 07 13:16:56.765445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.762101 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx"] Jul 07 13:16:56.766561 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:56.766520 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b65ba20_e18a_43f1_a9ec_cf69b6a4b3e4.slice/crio-8073df4d247a8f3bdc08e500309a79d44685e47382150473a22ead8c8804ea9b WatchSource:0}: Error finding container 8073df4d247a8f3bdc08e500309a79d44685e47382150473a22ead8c8804ea9b: Status 404 returned error can't find the container with id 8073df4d247a8f3bdc08e500309a79d44685e47382150473a22ead8c8804ea9b Jul 07 13:16:56.807609 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.807466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl"] Jul 07 13:16:56.813806 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:56.813775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3b5036_a79d_4657_9b8e_09657b388591.slice/crio-5b6d0653a10a5788b707d5ecb25318f988a5ab898aee7fdad5dca9598a1b9342 WatchSource:0}: Error finding container 5b6d0653a10a5788b707d5ecb25318f988a5ab898aee7fdad5dca9598a1b9342: Status 404 returned error can't find the container with id 5b6d0653a10a5788b707d5ecb25318f988a5ab898aee7fdad5dca9598a1b9342 Jul 07 13:16:56.821479 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.821399 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42"] Jul 07 13:16:56.841220 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.841179 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-njxlf"] Jul 07 13:16:56.843993 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.843971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-69ffc"] Jul 07 13:16:56.844422 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:56.844397 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c891437_b0d1_4110_862c_e7814184f260.slice/crio-bbd94193a1fc6b976998a5e12bc318029daa17cc328cfd0ff3c4b581be19d960 WatchSource:0}: Error finding container bbd94193a1fc6b976998a5e12bc318029daa17cc328cfd0ff3c4b581be19d960: Status 404 returned error can't find the container with id bbd94193a1fc6b976998a5e12bc318029daa17cc328cfd0ff3c4b581be19d960 Jul 07 13:16:56.847459 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:56.847438 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b4e213_d827_4b00_ad59_7ff002b64d8a.slice/crio-6ae5c2e9498e18cc5ef003b50220a17ff281f3940fe783cf9a35e5cbf62e578e WatchSource:0}: Error finding container 6ae5c2e9498e18cc5ef003b50220a17ff281f3940fe783cf9a35e5cbf62e578e: Status 404 returned error can't find the container with id 6ae5c2e9498e18cc5ef003b50220a17ff281f3940fe783cf9a35e5cbf62e578e Jul 07 13:16:56.856389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.856365 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl"] Jul 07 13:16:56.859633 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:16:56.859611 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311549ba_2690_4506_a0af_c2645206e9ba.slice/crio-2fec460f0be2bbb81a42d899071eec1f1ede758b15b6ad7d531af7084515be0a WatchSource:0}: Error finding container 2fec460f0be2bbb81a42d899071eec1f1ede758b15b6ad7d531af7084515be0a: Status 404 returned error can't find the container with id 2fec460f0be2bbb81a42d899071eec1f1ede758b15b6ad7d531af7084515be0a Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929543 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929605178 +0000 UTC m=+37.125242378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929596 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929684 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929683244 +0000 UTC m=+37.125320431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929702 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929716 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929710057 +0000 UTC m=+37.125347258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929720 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:16:56.929769 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929736 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929728648 +0000 UTC m=+37.125365839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:16:56.930820 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929803 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929783525 +0000 UTC m=+37.125420737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:16:56.930820 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.929824 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.929813008 +0000 UTC m=+37.125450213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:16:56.930820 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:56.929938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:56.930820 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.930033 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:16:56.930820 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:56.930062 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:57.93005392 +0000 UTC m=+37.125691105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:16:57.173483 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.173443 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx68l_4ddc2fa0-10aa-40a1-96eb-56064b6a187f/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:57.274464 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.274433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx68l_4ddc2fa0-10aa-40a1-96eb-56064b6a187f/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:57.487267 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.487184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" event={"ID":"311549ba-2690-4506-a0af-c2645206e9ba","Type":"ContainerStarted","Data":"2fec460f0be2bbb81a42d899071eec1f1ede758b15b6ad7d531af7084515be0a"} Jul 07 13:16:57.488941 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.488912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" event={"ID":"19043063-7585-4e5c-81b6-06de25fb13eb","Type":"ContainerStarted","Data":"a29317b4408d2dec62de14f9f033192062d95fd7023aa19aa5e5a11c21069a96"} Jul 07 13:16:57.490556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.490527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" event={"ID":"5e3b5036-a79d-4657-9b8e-09657b388591","Type":"ContainerStarted","Data":"5b6d0653a10a5788b707d5ecb25318f988a5ab898aee7fdad5dca9598a1b9342"} Jul 07 13:16:57.491933 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.491871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" event={"ID":"877f0aa1-2394-4755-b32c-3ec26ae972a9","Type":"ContainerStarted","Data":"9b03c42909442dcc4ad2cc03f52987407a1ae475178e6275fe98c9517c0d566e"} Jul 07 13:16:57.493335 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.493244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-69ffc" event={"ID":"61b4e213-d827-4b00-ad59-7ff002b64d8a","Type":"ContainerStarted","Data":"6ae5c2e9498e18cc5ef003b50220a17ff281f3940fe783cf9a35e5cbf62e578e"} Jul 07 13:16:57.495230 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.495172 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" event={"ID":"8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4","Type":"ContainerStarted","Data":"8073df4d247a8f3bdc08e500309a79d44685e47382150473a22ead8c8804ea9b"} Jul 07 13:16:57.496668 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.496645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" event={"ID":"2c891437-b0d1-4110-862c-e7814184f260","Type":"ContainerStarted","Data":"bbd94193a1fc6b976998a5e12bc318029daa17cc328cfd0ff3c4b581be19d960"} Jul 07 13:16:57.940398 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:57.940608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:57.940608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:57.940608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:57.940608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:57.940952 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:57.940952 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:57.940657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:57.940952 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.940782 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:57.940952 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.940842 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.940824039 +0000 UTC m=+39.136461236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941248 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941304 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941288891 +0000 UTC m=+39.136926081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941365 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941397 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941386551 +0000 UTC m=+39.137023742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941458 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941468 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941488206 +0000 UTC m=+39.137125397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941553 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941572268 +0000 UTC m=+39.137209459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941632 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941684285 +0000 UTC m=+39.137321475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:16:57.941805 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:57.941763 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:16:59.941753451 +0000 UTC m=+39.137390640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:16:59.962202 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962333 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962397 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962438 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962397 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962516 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962448 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962430849 +0000 UTC m=+43.158068035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962532 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962539118 +0000 UTC m=+43.158176311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962583 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962572405 +0000 UTC m=+43.158209595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962592499 +0000 UTC m=+43.158229688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:16:59.962707 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962623 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.96261536 +0000 UTC m=+43.158252551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:16:59.963385 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962643 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962637449 +0000 UTC m=+43.158274635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:16:59.963385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:16:59.962711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:16:59.963385 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962817 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:16:59.963385 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:16:59.962862 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:03.962850569 +0000 UTC m=+43.158487759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:17:04.003584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003735 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003729455 +0000 UTC m=+51.199366662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003809 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003786917 +0000 UTC m=+51.199424103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003821 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:04.003837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003843 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003875 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003859819 +0000 UTC m=+51.199497005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003927 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003940 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:17:04.004083 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003916 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003894378 +0000 UTC m=+51.199531577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:17:04.004812 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003979 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003967385 +0000 UTC m=+51.199604572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:17:04.004812 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.003994 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.003986442 +0000 UTC m=+51.199623628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:17:04.004812 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.004030 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:17:04.004812 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.004048 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:17:04.004812 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:04.004101 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:17:12.004083722 +0000 UTC m=+51.199720910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:17:07.527640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.527562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" event={"ID":"5e3b5036-a79d-4657-9b8e-09657b388591","Type":"ContainerStarted","Data":"e6558f85a6819b88a4b9759750482aa5e9be2bfa09e3bd3e21357c5336de523c"} Jul 07 13:17:07.530050 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.530018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" event={"ID":"877f0aa1-2394-4755-b32c-3ec26ae972a9","Type":"ContainerStarted","Data":"3799f2d596ab61ce2cd66b94f2382787a0206858222c0f0fc300504c4e34b427"} Jul 07 13:17:07.533881 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.533846 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="5f972c52509904f48de81ca2a134c5507db328cac2ed1810228566719a2dfac9" exitCode=0 Jul 07 13:17:07.533979 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.533884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"5f972c52509904f48de81ca2a134c5507db328cac2ed1810228566719a2dfac9"} Jul 07 13:17:07.535841 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.535814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-69ffc" event={"ID":"61b4e213-d827-4b00-ad59-7ff002b64d8a","Type":"ContainerStarted","Data":"e0b7a60a573831782f6d9f69f3630e3f0e2f49d16d4c2c4d5ea8a91bd71fbf6f"} Jul 07 13:17:07.537668 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.537634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" event={"ID":"8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4","Type":"ContainerStarted","Data":"2ecc1cf3806e528cb4ea8f5d700dcad17668b186a4322997a0d558dd300ece5f"} Jul 07 13:17:07.539507 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.539486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/0.log" Jul 07 13:17:07.539605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.539519 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c891437-b0d1-4110-862c-e7814184f260" containerID="8b808c24057f31b22dc961707cde5b8efe34e15e679b4bf27284f56e21aa96f3" exitCode=255 Jul 07 13:17:07.539735 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.539715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" event={"ID":"2c891437-b0d1-4110-862c-e7814184f260","Type":"ContainerDied","Data":"8b808c24057f31b22dc961707cde5b8efe34e15e679b4bf27284f56e21aa96f3"} Jul 07 13:17:07.539875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.539794 2577 scope.go:117] "RemoveContainer" containerID="8b808c24057f31b22dc961707cde5b8efe34e15e679b4bf27284f56e21aa96f3" Jul 07 13:17:07.541621 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.541600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" event={"ID":"311549ba-2690-4506-a0af-c2645206e9ba","Type":"ContainerStarted","Data":"d6f9dd4c6990b481159fec553cebeeba3456198390ee9de511a05e5ff90e8ce0"} Jul 07 13:17:07.543631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.543610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" event={"ID":"19043063-7585-4e5c-81b6-06de25fb13eb","Type":"ContainerStarted","Data":"6300ad4429174bda816a7df183cffe0c1f0ab0c788ccba28a754dd4afdc50530"} Jul 07 13:17:07.548227 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.547533 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" podStartSLOduration=13.694417607 podStartE2EDuration="23.547516911s" totalImagesPullingTime="9.853099304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.545791334 +0000 UTC m=+46.741428543" watchObservedRunningTime="2026-07-07 13:17:07.547516911 +0000 UTC m=+46.743154120" Jul 07 13:17:07.586911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.586789 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6ms"] Jul 07 13:17:07.596488 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.596340 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cjfvl" podStartSLOduration=13.788129021 podStartE2EDuration="23.596318474s" totalImagesPullingTime="9.808189453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.594790146 +0000 UTC m=+46.790427356" watchObservedRunningTime="2026-07-07 13:17:07.596318474 +0000 UTC m=+46.791955684" Jul 07 13:17:07.626017 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.625498 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6ms"] Jul 07 13:17:07.626017 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.625629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.630173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk4vg\" (UniqueName: \"kubernetes.io/projected/3bc9d0fe-adbd-4425-9984-485d82521781-kube-api-access-fk4vg\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.630415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bc9d0fe-adbd-4425-9984-485d82521781-crio-socket\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.630529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.630679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc9d0fe-adbd-4425-9984-485d82521781-data-volume\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631035 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.630834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.631485 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.631467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 13:17:07.631807 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.631791 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 13:17:07.632138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.632122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nfz7b\"" Jul 07 13:17:07.641951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.641906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" podStartSLOduration=13.720025623 podStartE2EDuration="23.641887881s" totalImagesPullingTime="9.921862258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.633694071 +0000 UTC m=+46.829331281" watchObservedRunningTime="2026-07-07 13:17:07.641887881 +0000 UTC m=+46.837525090" Jul 07 13:17:07.679580 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.679013 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-67jfx" podStartSLOduration=13.780721304 podStartE2EDuration="23.67899576s" totalImagesPullingTime="9.898274456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.676914646 +0000 UTC m=+46.872551854" watchObservedRunningTime="2026-07-07 13:17:07.67899576 +0000 UTC m=+46.874632948" Jul 07 13:17:07.698750 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.698588 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-69ffc" podStartSLOduration=1.879773282 podStartE2EDuration="11.698569317s" totalImagesPullingTime="9.818796035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.697751875 +0000 UTC m=+46.893389083" watchObservedRunningTime="2026-07-07 13:17:07.698569317 +0000 UTC m=+46.894206527" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc9d0fe-adbd-4425-9984-485d82521781-data-volume\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk4vg\" (UniqueName: \"kubernetes.io/projected/3bc9d0fe-adbd-4425-9984-485d82521781-kube-api-access-fk4vg\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:07.731491 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bc9d0fe-adbd-4425-9984-485d82521781-crio-socket\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:07.731616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:08.23159803 +0000 UTC m=+47.427235223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : secret "insights-runtime-extractor-tls" not found Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:07.731666 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc9d0fe-adbd-4425-9984-485d82521781-data-volume\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.731729 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:07.731707 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:08.231696013 +0000 UTC m=+47.427333200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : configmap "kube-rbac-proxy" not found Jul 07 13:17:07.732244 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.731877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3bc9d0fe-adbd-4425-9984-485d82521781-crio-socket\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:07.742094 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.742036 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" podStartSLOduration=13.894046078 podStartE2EDuration="23.742019672s" totalImagesPullingTime="9.847973594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:07.741932872 +0000 UTC m=+46.937570082" watchObservedRunningTime="2026-07-07 13:17:07.742019672 +0000 UTC m=+46.937656881" Jul 07 13:17:07.748490 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:07.748443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk4vg\" (UniqueName: \"kubernetes.io/projected/3bc9d0fe-adbd-4425-9984-485d82521781-kube-api-access-fk4vg\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:08.236391 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.236356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:08.236540 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.236421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:08.236540 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:08.236503 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:17:08.236540 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:08.236518 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:17:08.236639 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:08.236558 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:09.236544871 +0000 UTC m=+48.432182056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : configmap "kube-rbac-proxy" not found Jul 07 13:17:08.236639 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:08.236584 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:09.23656569 +0000 UTC m=+48.432202882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : secret "insights-runtime-extractor-tls" not found Jul 07 13:17:08.552344 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.552259 2577 generic.go:356] "Generic (PLEG): container finished" podID="97b5df38-5aa2-4080-8485-5a8038a2534a" containerID="6abb66fd36d8e177bf58f9e9a31b5b9ad7ae4268673cede1dd75813f2b18c35e" exitCode=0 Jul 07 13:17:08.552344 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.552317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerDied","Data":"6abb66fd36d8e177bf58f9e9a31b5b9ad7ae4268673cede1dd75813f2b18c35e"} Jul 07 13:17:08.554132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.554116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:17:08.554835 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.554818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/0.log" Jul 07 13:17:08.554891 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.554852 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c891437-b0d1-4110-862c-e7814184f260" containerID="8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9" exitCode=255 Jul 07 13:17:08.554934 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.554889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" event={"ID":"2c891437-b0d1-4110-862c-e7814184f260","Type":"ContainerDied","Data":"8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9"} Jul 07 13:17:08.554975 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.554939 2577 scope.go:117] "RemoveContainer" containerID="8b808c24057f31b22dc961707cde5b8efe34e15e679b4bf27284f56e21aa96f3" Jul 07 13:17:08.555227 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:08.555206 2577 scope.go:117] "RemoveContainer" containerID="8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9" Jul 07 13:17:08.555532 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:08.555508 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-njxlf_openshift-console-operator(2c891437-b0d1-4110-862c-e7814184f260)\"" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" podUID="2c891437-b0d1-4110-862c-e7814184f260" Jul 07 13:17:09.012828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.012803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2pc5c_a5e5170a-098f-448e-996d-b7c039c2b3a9/dns-node-resolver/0.log" Jul 07 13:17:09.245598 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.245567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:09.245728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.245703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:09.245837 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:09.245824 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:17:09.245886 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:09.245879 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:11.245865933 +0000 UTC m=+50.441503118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : secret "insights-runtime-extractor-tls" not found Jul 07 13:17:09.246173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.246154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3bc9d0fe-adbd-4425-9984-485d82521781-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:09.558966 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.558943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:17:09.559408 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.559319 2577 scope.go:117] "RemoveContainer" containerID="8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9" Jul 07 13:17:09.559510 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:09.559487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-njxlf_openshift-console-operator(2c891437-b0d1-4110-862c-e7814184f260)\"" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" podUID="2c891437-b0d1-4110-862c-e7814184f260" Jul 07 13:17:09.562423 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.562403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" event={"ID":"97b5df38-5aa2-4080-8485-5a8038a2534a","Type":"ContainerStarted","Data":"008bf0bce34419c14f453d8d8794497c30b1c5aed8448d467e702b917e0f87a2"} Jul 07 13:17:09.597624 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:09.597583 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5gsqm" podStartSLOduration=7.031537539 podStartE2EDuration="47.597571833s" totalImagesPullingTime="40.566034294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:09.595725241 +0000 UTC m=+48.791362450" watchObservedRunningTime="2026-07-07 13:17:09.597571833 +0000 UTC m=+48.793209062" Jul 07 13:17:10.209530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:10.209504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m255s_43a92b87-4acc-4aec-99f6-f75ea3ae7de9/node-ca/0.log" Jul 07 13:17:10.809932 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:10.809901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-69ffc_61b4e213-d827-4b00-ad59-7ff002b64d8a/serve-healthcheck-canary/0.log" Jul 07 13:17:11.262173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:11.262144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:11.262354 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:11.262283 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:17:11.262354 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:11.262341 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:15.262326663 +0000 UTC m=+54.457963849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : secret "insights-runtime-extractor-tls" not found Jul 07 13:17:12.067778 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.067886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067905 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067931 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067943 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067938 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.067918482 +0000 UTC m=+67.263555691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : configmap references non-existent config key: service-ca.crt Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067990 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.067997 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls podName:ac9b555d-20fd-4a11-91f1-b9b830e9ef44 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.067980224 +0000 UTC m=+67.263617414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pjz4p" (UID: "ac9b555d-20fd-4a11-91f1-b9b830e9ef44") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068003 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7b6cb454-66m6r: secret "image-registry-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068013 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:12.068022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068037 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls podName:acf74ee7-50aa-4b5f-b9ce-3017ada09fbc nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.068026171 +0000 UTC m=+67.263663360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls") pod "image-registry-7d7b6cb454-66m6r" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc") : secret "image-registry-tls" not found Jul 07 13:17:12.068214 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068062 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls podName:383c811f-4e82-42cc-9273-0c8b0086710f nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.068048608 +0000 UTC m=+67.263685795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls") pod "dns-default-c9jzp" (UID: "383c811f-4e82-42cc-9273-0c8b0086710f") : secret "dns-default-metrics-tls" not found Jul 07 13:17:12.068713 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068080 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs podName:b17f6e88-5a54-4b02-96b2-28788c73a2ad nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.068073654 +0000 UTC m=+67.263710840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs") pod "router-default-5874b88bf5-twgml" (UID: "b17f6e88-5a54-4b02-96b2-28788c73a2ad") : secret "router-metrics-certs-default" not found Jul 07 13:17:12.068713 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068092 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert podName:f1ab24e1-6dba-4a85-83da-42b7b3692268 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.068086501 +0000 UTC m=+67.263723686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-n9z84" (UID: "f1ab24e1-6dba-4a85-83da-42b7b3692268") : secret "networking-console-plugin-cert" not found Jul 07 13:17:12.068823 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068809 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:17:12.068865 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:12.068856 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls podName:8ad1eaab-5426-4732-b6db-b9a0c1147f62 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:28.068841337 +0000 UTC m=+67.264478528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4vf4z" (UID: "8ad1eaab-5426-4732-b6db-b9a0c1147f62") : secret "samples-operator-tls" not found Jul 07 13:17:15.292216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:15.292156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:15.292807 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:15.292312 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:17:15.292807 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:15.292391 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls podName:3bc9d0fe-adbd-4425-9984-485d82521781 nodeName:}" failed. No retries permitted until 2026-07-07 13:17:23.292371908 +0000 UTC m=+62.488009128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6ms" (UID: "3bc9d0fe-adbd-4425-9984-485d82521781") : secret "insights-runtime-extractor-tls" not found Jul 07 13:17:16.591310 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:16.591274 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:17:16.591699 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:16.591333 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:17:16.591699 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:16.591650 2577 scope.go:117] "RemoveContainer" containerID="8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9" Jul 07 13:17:16.591818 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:17:16.591797 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-njxlf_openshift-console-operator(2c891437-b0d1-4110-862c-e7814184f260)\"" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" podUID="2c891437-b0d1-4110-862c-e7814184f260" Jul 07 13:17:22.478885 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:22.478858 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkcmn" Jul 07 13:17:23.357747 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:23.357710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:23.359956 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:23.359930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3bc9d0fe-adbd-4425-9984-485d82521781-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6ms\" (UID: \"3bc9d0fe-adbd-4425-9984-485d82521781\") " pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:23.560606 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:23.560571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nfz7b\"" Jul 07 13:17:23.568657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:23.568635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9k6ms" Jul 07 13:17:23.694151 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:23.694125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6ms"] Jul 07 13:17:23.697465 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:23.697441 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc9d0fe_adbd_4425_9984_485d82521781.slice/crio-28e7db8379f4fa593d37168cc83bc1f74ed4f5313dd41434d80a534652fcda8f WatchSource:0}: Error finding container 28e7db8379f4fa593d37168cc83bc1f74ed4f5313dd41434d80a534652fcda8f: Status 404 returned error can't find the container with id 28e7db8379f4fa593d37168cc83bc1f74ed4f5313dd41434d80a534652fcda8f Jul 07 13:17:24.612444 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:24.612403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6ms" event={"ID":"3bc9d0fe-adbd-4425-9984-485d82521781","Type":"ContainerStarted","Data":"28e7db8379f4fa593d37168cc83bc1f74ed4f5313dd41434d80a534652fcda8f"} Jul 07 13:17:26.082123 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.082075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:17:26.082560 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.082246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:17:26.084641 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.084616 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:17:26.084641 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.084634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:17:26.095236 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.095186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e89071b-1cee-41b0-8da7-55fc65345799-metrics-certs\") pod \"network-metrics-daemon-htntq\" (UID: \"8e89071b-1cee-41b0-8da7-55fc65345799\") " pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:17:26.095655 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.095606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50ce6155-474e-4f48-b121-f02cc920ce9a-original-pull-secret\") pod \"global-pull-secret-syncer-69bps\" (UID: \"50ce6155-474e-4f48-b121-f02cc920ce9a\") " pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:17:26.183009 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.182983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:17:26.185419 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.185398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c26z8\" (UniqueName: \"kubernetes.io/projected/d858c505-ac45-406f-a19c-cff71dc0b55b-kube-api-access-c26z8\") pod \"network-check-target-j8mw5\" (UID: \"d858c505-ac45-406f-a19c-cff71dc0b55b\") " pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:17:26.318511 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.318484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69bps" Jul 07 13:17:26.327990 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.327963 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sgxmd\"" Jul 07 13:17:26.334165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.334146 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9nksx\"" Jul 07 13:17:26.335887 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.335870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:17:26.342983 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:26.342965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htntq" Jul 07 13:17:27.406691 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.406664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8mw5"] Jul 07 13:17:27.410332 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:27.410307 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd858c505_ac45_406f_a19c_cff71dc0b55b.slice/crio-2751ee612c3786138197325b57749412430f099690bbf825c2cda6087ae4e020 WatchSource:0}: Error finding container 2751ee612c3786138197325b57749412430f099690bbf825c2cda6087ae4e020: Status 404 returned error can't find the container with id 2751ee612c3786138197325b57749412430f099690bbf825c2cda6087ae4e020 Jul 07 13:17:27.630215 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.630158 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-69bps"] Jul 07 13:17:27.634336 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.634305 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-htntq"] Jul 07 13:17:27.638672 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.638613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6ms" event={"ID":"3bc9d0fe-adbd-4425-9984-485d82521781","Type":"ContainerStarted","Data":"0e4f2efb75561a74cea07e4179baede249d92b979b66fee52cf71a4c9b3101bb"} Jul 07 13:17:27.640573 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.640542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8mw5" event={"ID":"d858c505-ac45-406f-a19c-cff71dc0b55b","Type":"ContainerStarted","Data":"5a05a478f45dc2cee664ec26c26025987c83648ad6c2b94375e758cb6e1aa379"} Jul 07 13:17:27.640696 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.640590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8mw5" event={"ID":"d858c505-ac45-406f-a19c-cff71dc0b55b","Type":"ContainerStarted","Data":"2751ee612c3786138197325b57749412430f099690bbf825c2cda6087ae4e020"} Jul 07 13:17:27.640872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.640691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:17:27.641585 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:27.641561 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ce6155_474e_4f48_b121_f02cc920ce9a.slice/crio-bf0b9745d0289d44c2b9ecaf137fcdf38feb581edc3603862763ef33f9586101 WatchSource:0}: Error finding container bf0b9745d0289d44c2b9ecaf137fcdf38feb581edc3603862763ef33f9586101: Status 404 returned error can't find the container with id bf0b9745d0289d44c2b9ecaf137fcdf38feb581edc3603862763ef33f9586101 Jul 07 13:17:27.642620 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:27.642594 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e89071b_1cee_41b0_8da7_55fc65345799.slice/crio-41f9b2fd3f5834e4f6c4671cad7397626590d7156743501a22c3519d68cae2e2 WatchSource:0}: Error finding container 41f9b2fd3f5834e4f6c4671cad7397626590d7156743501a22c3519d68cae2e2: Status 404 returned error can't find the container with id 41f9b2fd3f5834e4f6c4671cad7397626590d7156743501a22c3519d68cae2e2 Jul 07 13:17:27.656133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:27.656092 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j8mw5" podStartSLOduration=66.656079631 podStartE2EDuration="1m6.656079631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:27.654867067 +0000 UTC m=+66.850504296" watchObservedRunningTime="2026-07-07 13:17:27.656079631 +0000 UTC m=+66.851716838" Jul 07 13:17:28.100880 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.100855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:28.100973 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.100894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:28.100973 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.100927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:17:28.100973 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.100954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:28.101121 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.100982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:17:28.101121 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.101012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:28.101121 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.101056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:17:28.102123 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.101649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17f6e88-5a54-4b02-96b2-28788c73a2ad-service-ca-bundle\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:28.103718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.103697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/383c811f-4e82-42cc-9273-0c8b0086710f-metrics-tls\") pod \"dns-default-c9jzp\" (UID: \"383c811f-4e82-42cc-9273-0c8b0086710f\") " pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:28.103783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.103762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac9b555d-20fd-4a11-91f1-b9b830e9ef44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pjz4p\" (UID: \"ac9b555d-20fd-4a11-91f1-b9b830e9ef44\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:17:28.103906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.103889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ab24e1-6dba-4a85-83da-42b7b3692268-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9z84\" (UID: \"f1ab24e1-6dba-4a85-83da-42b7b3692268\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:17:28.103993 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.103970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"image-registry-7d7b6cb454-66m6r\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:28.103993 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.103988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b17f6e88-5a54-4b02-96b2-28788c73a2ad-metrics-certs\") pod \"router-default-5874b88bf5-twgml\" (UID: \"b17f6e88-5a54-4b02-96b2-28788c73a2ad\") " pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:28.104435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.104420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ad1eaab-5426-4732-b6db-b9a0c1147f62-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4vf4z\" (UID: \"8ad1eaab-5426-4732-b6db-b9a0c1147f62\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:17:28.326137 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.326081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mx56r\"" Jul 07 13:17:28.334112 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.334091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" Jul 07 13:17:28.344303 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.344278 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x9hsn\"" Jul 07 13:17:28.352501 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.352448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:28.354843 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.354827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f45kt\"" Jul 07 13:17:28.362922 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.362880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" Jul 07 13:17:28.378409 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.378168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jldlk\"" Jul 07 13:17:28.383309 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.383289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nmbgg\"" Jul 07 13:17:28.386347 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.386209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:28.392552 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.392247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:28.402376 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.399238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b8pcw\"" Jul 07 13:17:28.408426 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.407679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" Jul 07 13:17:28.550358 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.550277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z"] Jul 07 13:17:28.556738 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.556664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:17:28.560817 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:28.560787 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf74ee7_50aa_4b5f_b9ce_3017ada09fbc.slice/crio-a51efb6ddc69362e7fb671e25282b83e403bc07528e04999fbbbab8501f463ad WatchSource:0}: Error finding container a51efb6ddc69362e7fb671e25282b83e403bc07528e04999fbbbab8501f463ad: Status 404 returned error can't find the container with id a51efb6ddc69362e7fb671e25282b83e403bc07528e04999fbbbab8501f463ad Jul 07 13:17:28.588065 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.588034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p"] Jul 07 13:17:28.628048 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.628016 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5874b88bf5-twgml"] Jul 07 13:17:28.632581 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:28.632553 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17f6e88_5a54_4b02_96b2_28788c73a2ad.slice/crio-7e94a30c8727e143df7ddbedb54b7f9b466dd5795ec134f250f0f41f83cc555e WatchSource:0}: Error finding container 7e94a30c8727e143df7ddbedb54b7f9b466dd5795ec134f250f0f41f83cc555e: Status 404 returned error can't find the container with id 7e94a30c8727e143df7ddbedb54b7f9b466dd5795ec134f250f0f41f83cc555e Jul 07 13:17:28.649607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.645725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9jzp"] Jul 07 13:17:28.649607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.649506 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" event={"ID":"ac9b555d-20fd-4a11-91f1-b9b830e9ef44","Type":"ContainerStarted","Data":"19698be977c4b3383f066f7e44a88d15cd646f4b5cea292f5ff2565e0546ca78"} Jul 07 13:17:28.651745 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:28.651704 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383c811f_4e82_42cc_9273_0c8b0086710f.slice/crio-b97e5553e47d13dfbcc2de169d4209547b4ea08897c8e7e0c9c218dea92bc660 WatchSource:0}: Error finding container b97e5553e47d13dfbcc2de169d4209547b4ea08897c8e7e0c9c218dea92bc660: Status 404 returned error can't find the container with id b97e5553e47d13dfbcc2de169d4209547b4ea08897c8e7e0c9c218dea92bc660 Jul 07 13:17:28.653018 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.652990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" event={"ID":"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc","Type":"ContainerStarted","Data":"a51efb6ddc69362e7fb671e25282b83e403bc07528e04999fbbbab8501f463ad"} Jul 07 13:17:28.655262 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.655104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" event={"ID":"8ad1eaab-5426-4732-b6db-b9a0c1147f62","Type":"ContainerStarted","Data":"0727f5fab956c97f0225dd52150ec7ce850ce696868ea774b3bf123a131e0f24"} Jul 07 13:17:28.661112 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.660969 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9z84"] Jul 07 13:17:28.662022 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.661811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-69bps" event={"ID":"50ce6155-474e-4f48-b121-f02cc920ce9a","Type":"ContainerStarted","Data":"bf0b9745d0289d44c2b9ecaf137fcdf38feb581edc3603862763ef33f9586101"} Jul 07 13:17:28.663943 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:28.663915 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ab24e1_6dba_4a85_83da_42b7b3692268.slice/crio-1200b032e481453c4d6580db4a7f0526059568413c266399e6406b4ec1a24d97 WatchSource:0}: Error finding container 1200b032e481453c4d6580db4a7f0526059568413c266399e6406b4ec1a24d97: Status 404 returned error can't find the container with id 1200b032e481453c4d6580db4a7f0526059568413c266399e6406b4ec1a24d97 Jul 07 13:17:28.665482 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.665385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6ms" event={"ID":"3bc9d0fe-adbd-4425-9984-485d82521781","Type":"ContainerStarted","Data":"0874975dfe9dd141b3e8864abf4a172b8a63826d4f575d59f2a8418bb472f843"} Jul 07 13:17:28.668570 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.668499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5874b88bf5-twgml" event={"ID":"b17f6e88-5a54-4b02-96b2-28788c73a2ad","Type":"ContainerStarted","Data":"7e94a30c8727e143df7ddbedb54b7f9b466dd5795ec134f250f0f41f83cc555e"} Jul 07 13:17:28.671495 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:28.671167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htntq" event={"ID":"8e89071b-1cee-41b0-8da7-55fc65345799","Type":"ContainerStarted","Data":"41f9b2fd3f5834e4f6c4671cad7397626590d7156743501a22c3519d68cae2e2"} Jul 07 13:17:29.292327 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.291913 2577 scope.go:117] "RemoveContainer" containerID="8eca4be7e32d9d6597582a5f4a2a01ce6e0e3e375c088e13b2606afd3a9aa1f9" Jul 07 13:17:29.697384 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.697222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9jzp" event={"ID":"383c811f-4e82-42cc-9273-0c8b0086710f","Type":"ContainerStarted","Data":"b97e5553e47d13dfbcc2de169d4209547b4ea08897c8e7e0c9c218dea92bc660"} Jul 07 13:17:29.705722 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.705687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5874b88bf5-twgml" event={"ID":"b17f6e88-5a54-4b02-96b2-28788c73a2ad","Type":"ContainerStarted","Data":"0ec407531ae2116fb892d787f54aa37600fe689be1900fc41e017bb8731f3cf4"} Jul 07 13:17:29.709566 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.709484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htntq" event={"ID":"8e89071b-1cee-41b0-8da7-55fc65345799","Type":"ContainerStarted","Data":"50ff18e1e0c1577c89afc94b2dbc20bd7848fa0ab0546f680e32785975bd1d39"} Jul 07 13:17:29.709566 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.709532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htntq" event={"ID":"8e89071b-1cee-41b0-8da7-55fc65345799","Type":"ContainerStarted","Data":"a552a8fcb64cca50e4763ec892fadcbce1dc963b104ef71f8d07f3db257054b4"} Jul 07 13:17:29.714329 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.714294 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:17:29.714453 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.714371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" event={"ID":"2c891437-b0d1-4110-862c-e7814184f260","Type":"ContainerStarted","Data":"5993f3016ef9b445fb745864987b09eec37f2632bd4f39a7e4172617eb183059"} Jul 07 13:17:29.715125 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.715101 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:17:29.718726 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.718703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" event={"ID":"f1ab24e1-6dba-4a85-83da-42b7b3692268","Type":"ContainerStarted","Data":"1200b032e481453c4d6580db4a7f0526059568413c266399e6406b4ec1a24d97"} Jul 07 13:17:29.721401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.721118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" event={"ID":"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc","Type":"ContainerStarted","Data":"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633"} Jul 07 13:17:29.721657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.721631 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:29.726357 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.726163 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5874b88bf5-twgml" podStartSLOduration=45.726146493 podStartE2EDuration="45.726146493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:29.724404299 +0000 UTC m=+68.920041508" watchObservedRunningTime="2026-07-07 13:17:29.726146493 +0000 UTC m=+68.921783695" Jul 07 13:17:29.743851 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.743369 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" podStartSLOduration=67.743353309 podStartE2EDuration="1m7.743353309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:29.74205035 +0000 UTC m=+68.937687586" watchObservedRunningTime="2026-07-07 13:17:29.743353309 +0000 UTC m=+68.938990520" Jul 07 13:17:29.759770 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.759283 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" podStartSLOduration=35.935991794 podStartE2EDuration="45.759266809s" totalImagesPullingTime="9.823275015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:29.757738818 +0000 UTC m=+68.953376053" watchObservedRunningTime="2026-07-07 13:17:29.759266809 +0000 UTC m=+68.954904020" Jul 07 13:17:29.773213 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:29.772976 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-htntq" podStartSLOduration=66.30386177 podStartE2EDuration="1m7.772960076s" totalImagesPullingTime="1.469098306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:29.772434949 +0000 UTC m=+68.968072159" watchObservedRunningTime="2026-07-07 13:17:29.772960076 +0000 UTC m=+68.968597286" Jul 07 13:17:30.113887 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:30.113625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-njxlf" Jul 07 13:17:30.386817 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:30.386742 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:30.389943 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:30.389892 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:30.728171 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:30.728044 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:30.729766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:30.729486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5874b88bf5-twgml" Jul 07 13:17:35.746265 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:35.746239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" event={"ID":"f1ab24e1-6dba-4a85-83da-42b7b3692268","Type":"ContainerStarted","Data":"6486c105b9e66f471e816a34cbd1e5749aa64dda47767fde6fc661e516e098d0"} Jul 07 13:17:35.761428 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:35.761376 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9z84" podStartSLOduration=44.852179873 podStartE2EDuration="51.761356323s" totalImagesPullingTime="6.90917645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:35.760499789 +0000 UTC m=+74.956137010" watchObservedRunningTime="2026-07-07 13:17:35.761356323 +0000 UTC m=+74.956993532" Jul 07 13:17:36.751569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.751531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6ms" event={"ID":"3bc9d0fe-adbd-4425-9984-485d82521781","Type":"ContainerStarted","Data":"3839e34d3d0ce72547bd2f2c755486e105d4252c14e186cec1828eeb94d7e9e0"} Jul 07 13:17:36.752995 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.752974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" event={"ID":"ac9b555d-20fd-4a11-91f1-b9b830e9ef44","Type":"ContainerStarted","Data":"790b727f982867998302367fd3b250dac34042e98c13ed2f98b80eec203fe094"} Jul 07 13:17:36.754536 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.754513 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" event={"ID":"8ad1eaab-5426-4732-b6db-b9a0c1147f62","Type":"ContainerStarted","Data":"d9a9271cc7e32dfa80f9a8b94781a7a0e122f99f816a22750698a7c4066fbd41"} Jul 07 13:17:36.754658 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.754558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" event={"ID":"8ad1eaab-5426-4732-b6db-b9a0c1147f62","Type":"ContainerStarted","Data":"cd217baef91f563304a8c39f99e6bbc864c8f28da1c077c0107f16cfe344b372"} Jul 07 13:17:36.755931 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.755912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-69bps" event={"ID":"50ce6155-474e-4f48-b121-f02cc920ce9a","Type":"ContainerStarted","Data":"e126872a093571ac5e3ae2cf941e482c6a54f612507dd57a7957229696286392"} Jul 07 13:17:36.757666 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.757645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9jzp" event={"ID":"383c811f-4e82-42cc-9273-0c8b0086710f","Type":"ContainerStarted","Data":"9a8caac37b29f8b63b8e67aec741c952785e408aa20be86308dfbf52e6dd0522"} Jul 07 13:17:36.757760 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.757681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9jzp" event={"ID":"383c811f-4e82-42cc-9273-0c8b0086710f","Type":"ContainerStarted","Data":"905f8f4d0f2705914d5de5077070957efae0df364405a986c5ce4f1200a8e31b"} Jul 07 13:17:36.772933 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.772894 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9k6ms" podStartSLOduration=18.012193943 podStartE2EDuration="29.772884199s" totalImagesPullingTime="11.760690256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:17:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:36.771705328 +0000 UTC m=+75.967342558" watchObservedRunningTime="2026-07-07 13:17:36.772884199 +0000 UTC m=+75.968521406" Jul 07 13:17:36.785932 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.785896 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-69bps" podStartSLOduration=66.534480582 podStartE2EDuration="1m14.785887969s" totalImagesPullingTime="8.251407387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:36.785729198 +0000 UTC m=+75.981366427" watchObservedRunningTime="2026-07-07 13:17:36.785887969 +0000 UTC m=+75.981525177" Jul 07 13:17:36.802693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.802657 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" podStartSLOduration=45.814904978 podStartE2EDuration="52.802644755s" totalImagesPullingTime="6.987739777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:36.801936616 +0000 UTC m=+75.997573839" watchObservedRunningTime="2026-07-07 13:17:36.802644755 +0000 UTC m=+75.998282013" Jul 07 13:17:36.821267 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:36.821231 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c9jzp" podStartSLOduration=33.874555988 podStartE2EDuration="40.821220468s" totalImagesPullingTime="6.94666448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:36.820244483 +0000 UTC m=+76.015881689" watchObservedRunningTime="2026-07-07 13:17:36.821220468 +0000 UTC m=+76.016857670" Jul 07 13:17:37.762904 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:37.762865 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:40.411290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.411235 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4vf4z" podStartSLOduration=49.437360573 podStartE2EDuration="56.411167649s" totalImagesPullingTime="6.973807076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:36.837335731 +0000 UTC m=+76.032972939" watchObservedRunningTime="2026-07-07 13:17:40.411167649 +0000 UTC m=+79.606804872" Jul 07 13:17:40.412553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.412527 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:17:40.440767 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.440745 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:17:40.440869 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.440831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.443795 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.443772 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 13:17:40.443978 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.443951 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 13:17:40.443978 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.443969 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 13:17:40.443978 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.443957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 13:17:40.444162 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.444018 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 13:17:40.444828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.444813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 13:17:40.445164 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.445143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xh5f4\"" Jul 07 13:17:40.445164 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.445153 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 13:17:40.454472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.454454 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 13:17:40.506078 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vs2\" (UniqueName: \"kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.506290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.506275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vs2\" (UniqueName: \"kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606996 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606996 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.606996 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.606915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.607636 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.607599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.607730 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.607603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.607786 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.607745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.607916 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.607896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.609077 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.609052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.609290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.609273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.614922 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.614899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vs2\" (UniqueName: \"kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2\") pod \"console-57869bc449-mcmht\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.751508 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.751454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:40.901914 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:40.901881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:17:40.905950 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:17:40.905919 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc31b20_e072_4a65_bd25_c5655cf7d684.slice/crio-546205cf224bbefd6acab32e834763944b5db277e31b208b3c3417da01ed44f2 WatchSource:0}: Error finding container 546205cf224bbefd6acab32e834763944b5db277e31b208b3c3417da01ed44f2: Status 404 returned error can't find the container with id 546205cf224bbefd6acab32e834763944b5db277e31b208b3c3417da01ed44f2 Jul 07 13:17:41.779360 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:41.779320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57869bc449-mcmht" event={"ID":"8dc31b20-e072-4a65-bd25-c5655cf7d684","Type":"ContainerStarted","Data":"546205cf224bbefd6acab32e834763944b5db277e31b208b3c3417da01ed44f2"} Jul 07 13:17:44.792758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:44.792718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57869bc449-mcmht" event={"ID":"8dc31b20-e072-4a65-bd25-c5655cf7d684","Type":"ContainerStarted","Data":"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712"} Jul 07 13:17:44.814618 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:44.814557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57869bc449-mcmht" podStartSLOduration=1.648933602 podStartE2EDuration="4.814537425s" totalImagesPullingTime="3.165603823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:44.809355739 +0000 UTC m=+84.004992949" watchObservedRunningTime="2026-07-07 13:17:44.814537425 +0000 UTC m=+84.010174632" Jul 07 13:17:47.769620 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:47.769585 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c9jzp" Jul 07 13:17:48.357124 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:48.357089 2577 patch_prober.go:28] interesting pod/image-registry-7d7b6cb454-66m6r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 13:17:48.357302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:48.357143 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 13:17:50.731972 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:50.731944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:17:50.752208 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:50.752158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:50.752351 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:50.752223 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:50.757227 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:50.757206 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:50.818625 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:50.818602 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:17:55.239342 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:55.239306 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:17:57.841235 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:57.841204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:17:57.841574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:57.841248 2577 generic.go:356] "Generic (PLEG): container finished" podID="ac9b555d-20fd-4a11-91f1-b9b830e9ef44" containerID="790b727f982867998302367fd3b250dac34042e98c13ed2f98b80eec203fe094" exitCode=2 Jul 07 13:17:57.841574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:57.841304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" event={"ID":"ac9b555d-20fd-4a11-91f1-b9b830e9ef44","Type":"ContainerDied","Data":"790b727f982867998302367fd3b250dac34042e98c13ed2f98b80eec203fe094"} Jul 07 13:17:57.841643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:57.841621 2577 scope.go:117] "RemoveContainer" containerID="790b727f982867998302367fd3b250dac34042e98c13ed2f98b80eec203fe094" Jul 07 13:17:58.674345 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:58.674313 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j8mw5" Jul 07 13:17:58.847164 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:58.847137 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:17:58.847548 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:17:58.847261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pjz4p" event={"ID":"ac9b555d-20fd-4a11-91f1-b9b830e9ef44","Type":"ContainerStarted","Data":"30207ca26b3324c40952bd80adadfc2b00c159e89b4d00bb70c05a36e8f78597"} Jul 07 13:18:01.604214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.604164 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hhd65"] Jul 07 13:18:01.610447 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.610427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.612869 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.612848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 13:18:01.613214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.613179 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 13:18:01.613214 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.613184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wjwb8\"" Jul 07 13:18:01.613379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.613360 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 13:18:01.614076 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.614059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 13:18:01.759481 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-metrics-client-ca\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-wtmp\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-textfile\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-sys\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5lv\" (UniqueName: \"kubernetes.io/projected/993ab59f-113c-4213-b103-efe69a9ece9f-kube-api-access-zw5lv\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.759823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.759661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-root\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.860924 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-root\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.860924 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-metrics-client-ca\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-wtmp\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-textfile\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-root\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.860993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-sys\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5lv\" (UniqueName: \"kubernetes.io/projected/993ab59f-113c-4213-b103-efe69a9ece9f-kube-api-access-zw5lv\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-wtmp\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/993ab59f-113c-4213-b103-efe69a9ece9f-sys\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:01.861298 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-textfile\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.861385 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:01.861372 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls podName:993ab59f-113c-4213-b103-efe69a9ece9f nodeName:}" failed. No retries permitted until 2026-07-07 13:18:02.361352021 +0000 UTC m=+101.556989207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls") pod "node-exporter-hhd65" (UID: "993ab59f-113c-4213-b103-efe69a9ece9f") : secret "node-exporter-tls" not found Jul 07 13:18:01.861968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-metrics-client-ca\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.862110 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.861947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.866917 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.866894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:01.873224 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:01.873187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5lv\" (UniqueName: \"kubernetes.io/projected/993ab59f-113c-4213-b103-efe69a9ece9f-kube-api-access-zw5lv\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:02.365283 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.365255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:02.367485 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.367465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/993ab59f-113c-4213-b103-efe69a9ece9f-node-exporter-tls\") pod \"node-exporter-hhd65\" (UID: \"993ab59f-113c-4213-b103-efe69a9ece9f\") " pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:02.518948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.518919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hhd65" Jul 07 13:18:02.532595 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:18:02.532568 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993ab59f_113c_4213_b103_efe69a9ece9f.slice/crio-e3fe8c896c13b8199cf1b51422b0d11c3300dae26287ca4ee840cf7d9b978fd6 WatchSource:0}: Error finding container e3fe8c896c13b8199cf1b51422b0d11c3300dae26287ca4ee840cf7d9b978fd6: Status 404 returned error can't find the container with id e3fe8c896c13b8199cf1b51422b0d11c3300dae26287ca4ee840cf7d9b978fd6 Jul 07 13:18:02.663137 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.663072 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:18:02.666138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.666122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.669518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.669497 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 13:18:02.669622 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.669599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l7ttw\"" Jul 07 13:18:02.669686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.669601 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 13:18:02.670005 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.669986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 13:18:02.670092 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670026 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 13:18:02.670150 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670119 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 13:18:02.670258 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670240 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 13:18:02.670377 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 13:18:02.670532 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670513 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 13:18:02.670623 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.670572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 13:18:02.692075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.692054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:18:02.769695 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.769783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-out\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.769783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.769876 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.769876 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.769876 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770002 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770002 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.769962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770080 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.770004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-web-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770080 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.770028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770080 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.770076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghks\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-kube-api-access-pghks\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.770129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.770219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.770149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.864355 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.864325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhd65" event={"ID":"993ab59f-113c-4213-b103-efe69a9ece9f","Type":"ContainerStarted","Data":"e3fe8c896c13b8199cf1b51422b0d11c3300dae26287ca4ee840cf7d9b978fd6"} Jul 07 13:18:02.870680 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-out\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-web-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.870898 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.871816 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pghks\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-kube-api-access-pghks\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.871816 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.871816 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.870962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.871816 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:02.870945 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 13:18:02.872071 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:02.871856 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls podName:1d2fad69-576f-4d07-ba36-e5a7a95b8fbe nodeName:}" failed. No retries permitted until 2026-07-07 13:18:03.371834846 +0000 UTC m=+102.567472041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1d2fad69-576f-4d07-ba36-e5a7a95b8fbe") : secret "alertmanager-main-tls" not found Jul 07 13:18:02.872135 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.872082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.872861 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.872836 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.873027 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.873008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874031 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.873644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874031 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.873940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-out\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874031 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.873988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874346 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.874300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-web-config\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874715 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.874677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.874881 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.874862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.875792 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.875773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.876564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.876539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:02.880144 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:02.880120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghks\" (UniqueName: \"kubernetes.io/projected/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-kube-api-access-pghks\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:03.375536 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:03.375504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:03.375708 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:03.375633 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 13:18:03.375708 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:03.375700 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls podName:1d2fad69-576f-4d07-ba36-e5a7a95b8fbe nodeName:}" failed. No retries permitted until 2026-07-07 13:18:04.375685034 +0000 UTC m=+103.571322239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1d2fad69-576f-4d07-ba36-e5a7a95b8fbe") : secret "alertmanager-main-tls" not found Jul 07 13:18:03.869779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:03.869748 2577 generic.go:356] "Generic (PLEG): container finished" podID="993ab59f-113c-4213-b103-efe69a9ece9f" containerID="b141d32a8821ec3d309c4d5123f5459800dcdc91e97bfaf5841d0fd581212fd0" exitCode=0 Jul 07 13:18:03.870091 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:03.869823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhd65" event={"ID":"993ab59f-113c-4213-b103-efe69a9ece9f","Type":"ContainerDied","Data":"b141d32a8821ec3d309c4d5123f5459800dcdc91e97bfaf5841d0fd581212fd0"} Jul 07 13:18:04.383368 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.383339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:04.385574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.385550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d2fad69-576f-4d07-ba36-e5a7a95b8fbe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:04.477662 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.477640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:18:04.644291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.644263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:18:04.645035 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:18:04.645006 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2fad69_576f_4d07_ba36_e5a7a95b8fbe.slice/crio-8fc51b46c95de287e00cf294eb9974546f6cdea2e1af5994165fbf3316fc23e6 WatchSource:0}: Error finding container 8fc51b46c95de287e00cf294eb9974546f6cdea2e1af5994165fbf3316fc23e6: Status 404 returned error can't find the container with id 8fc51b46c95de287e00cf294eb9974546f6cdea2e1af5994165fbf3316fc23e6 Jul 07 13:18:04.875543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.875508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhd65" event={"ID":"993ab59f-113c-4213-b103-efe69a9ece9f","Type":"ContainerStarted","Data":"2760e07dd6dde02908460c381947c11595584ec2bf34849baa6a95ff7523cf7e"} Jul 07 13:18:04.875887 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.875577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhd65" event={"ID":"993ab59f-113c-4213-b103-efe69a9ece9f","Type":"ContainerStarted","Data":"d89fe72255b8250016a6e47ea44176a426c504b40b9e103b7f354237dffc68b0"} Jul 07 13:18:04.876702 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.876684 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"8fc51b46c95de287e00cf294eb9974546f6cdea2e1af5994165fbf3316fc23e6"} Jul 07 13:18:04.897987 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:04.897914 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hhd65" podStartSLOduration=2.707436817 podStartE2EDuration="3.897901469s" totalImagesPullingTime="1.124589119s" totalInitContainerRuntime="65.875533ms" isStatefulPod=true podCreationTimestamp="2026-07-07 13:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:18:04.896481322 +0000 UTC m=+104.092118553" watchObservedRunningTime="2026-07-07 13:18:04.897901469 +0000 UTC m=+104.093538677" Jul 07 13:18:06.362316 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.358631 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:18:06.379903 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.379849 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4"] Jul 07 13:18:06.380095 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.380055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.384270 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.384248 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:18:06.384410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.384385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.384539 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.384413 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4"] Jul 07 13:18:06.387018 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.387001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 13:18:06.387256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.387230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tfqtd\"" Jul 07 13:18:06.499639 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.499734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdb5\" (UniqueName: \"kubernetes.io/projected/a9220665-816d-40ea-abf1-9e50d1d77f66-kube-api-access-6pdb5\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.499836 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpzcd\" (UniqueName: \"kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499836 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.499958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.499900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600757 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600757 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600757 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600878 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.600878 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.600853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.600974 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:06.600930 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 07 13:18:06.601027 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:06.600998 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert podName:a9220665-816d-40ea-abf1-9e50d1d77f66 nodeName:}" failed. No retries permitted until 2026-07-07 13:18:07.10097573 +0000 UTC m=+106.296612928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-zlph4" (UID: "a9220665-816d-40ea-abf1-9e50d1d77f66") : secret "monitoring-plugin-cert" not found Jul 07 13:18:06.601091 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdb5\" (UniqueName: \"kubernetes.io/projected/a9220665-816d-40ea-abf1-9e50d1d77f66-kube-api-access-6pdb5\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.601091 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpzcd\" (UniqueName: \"kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.601216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.601564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.601564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601553 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.601732 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.601797 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.601770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.603100 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.603072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.603185 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.603127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.611533 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.611510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpzcd\" (UniqueName: \"kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd\") pod \"console-6f45f4c44f-bwcj9\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.612015 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.611996 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdb5\" (UniqueName: \"kubernetes.io/projected/a9220665-816d-40ea-abf1-9e50d1d77f66-kube-api-access-6pdb5\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:06.692931 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.692880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:06.851075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.851054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:18:06.853097 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:18:06.853073 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b07b58_605b_4bec_8617_2046eabfc2db.slice/crio-e51ab206a65b3f4b949366f9d628006772cf3bde80e7ef558bb5cfd5b9426873 WatchSource:0}: Error finding container e51ab206a65b3f4b949366f9d628006772cf3bde80e7ef558bb5cfd5b9426873: Status 404 returned error can't find the container with id e51ab206a65b3f4b949366f9d628006772cf3bde80e7ef558bb5cfd5b9426873 Jul 07 13:18:06.885587 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.885552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f4c44f-bwcj9" event={"ID":"45b07b58-605b-4bec-8617-2046eabfc2db","Type":"ContainerStarted","Data":"e51ab206a65b3f4b949366f9d628006772cf3bde80e7ef558bb5cfd5b9426873"} Jul 07 13:18:06.887023 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.886995 2577 generic.go:356] "Generic (PLEG): container finished" podID="1d2fad69-576f-4d07-ba36-e5a7a95b8fbe" containerID="13ccc891de594c5ef969681f40b54ea6226e3ea8bafa4576fff78f1e89044993" exitCode=0 Jul 07 13:18:06.887089 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:06.887056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerDied","Data":"13ccc891de594c5ef969681f40b54ea6226e3ea8bafa4576fff78f1e89044993"} Jul 07 13:18:07.105912 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.105880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:07.108205 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.108172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9220665-816d-40ea-abf1-9e50d1d77f66-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zlph4\" (UID: \"a9220665-816d-40ea-abf1-9e50d1d77f66\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:07.299499 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.299445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:07.444520 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.444497 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4"] Jul 07 13:18:07.446875 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:18:07.446846 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9220665_816d_40ea_abf1_9e50d1d77f66.slice/crio-53dae27a183804b786992f2d7386fa635e2667107e7d7b60899bb46314d1fa0a WatchSource:0}: Error finding container 53dae27a183804b786992f2d7386fa635e2667107e7d7b60899bb46314d1fa0a: Status 404 returned error can't find the container with id 53dae27a183804b786992f2d7386fa635e2667107e7d7b60899bb46314d1fa0a Jul 07 13:18:07.898231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.898185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f4c44f-bwcj9" event={"ID":"45b07b58-605b-4bec-8617-2046eabfc2db","Type":"ContainerStarted","Data":"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962"} Jul 07 13:18:07.899721 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.899687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" event={"ID":"a9220665-816d-40ea-abf1-9e50d1d77f66","Type":"ContainerStarted","Data":"53dae27a183804b786992f2d7386fa635e2667107e7d7b60899bb46314d1fa0a"} Jul 07 13:18:07.916932 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:07.916882 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f45f4c44f-bwcj9" podStartSLOduration=1.91686844 podStartE2EDuration="1.91686844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:18:07.916671353 +0000 UTC m=+107.112308583" watchObservedRunningTime="2026-07-07 13:18:07.91686844 +0000 UTC m=+107.112505648" Jul 07 13:18:09.911847 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.911816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"fd50187eb1e798789b858000bb8d76c1211013e09e16d70711c8f1f3f8420f4c"} Jul 07 13:18:09.912304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.911907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"e8f8a8dd257a4087bc692a804cac30c571e446d0e9647f8677fdc9027ffaca3c"} Jul 07 13:18:09.913492 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.913465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" event={"ID":"a9220665-816d-40ea-abf1-9e50d1d77f66","Type":"ContainerStarted","Data":"2dbb7441387b7ea36c51ffe1ba1abfa4e89d390cfd7784f447458c2861e2ac53"} Jul 07 13:18:09.913667 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.913646 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:09.918816 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.918797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" Jul 07 13:18:09.933336 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:09.933302 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zlph4" podStartSLOduration=1.810024332 podStartE2EDuration="3.933289703s" totalImagesPullingTime="2.123265371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:18:09.932500705 +0000 UTC m=+109.128137914" watchObservedRunningTime="2026-07-07 13:18:09.933289703 +0000 UTC m=+109.128926926" Jul 07 13:18:10.920915 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:10.920881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"b151313edd960bcca6a1bd3af3bf84c7d090e99fe21490b4418a767bcad259a6"} Jul 07 13:18:10.921293 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:10.920947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"a4ea12e2394c04ddc984dd97007d142df5d2d22453403bc17d99db8e1da70078"} Jul 07 13:18:10.921293 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:10.920977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"fbd5e0de2e11711de2e696cb57a5f75e01aaceefdfd08689f69ac8b7438efdf9"} Jul 07 13:18:11.928848 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:11.928801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d2fad69-576f-4d07-ba36-e5a7a95b8fbe","Type":"ContainerStarted","Data":"954418a334fcfc95109c8f7dde8fbb38f9f8b41ff6ce9c2f709f89615961bce7"} Jul 07 13:18:11.959121 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:11.959073 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.5587099779999996 podStartE2EDuration="9.959057626s" totalImagesPullingTime="5.385722962s" totalInitContainerRuntime="14.624686ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:18:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:18:11.957166107 +0000 UTC m=+111.152803315" watchObservedRunningTime="2026-07-07 13:18:11.959057626 +0000 UTC m=+111.154694835" Jul 07 13:18:12.934984 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:12.934950 2577 generic.go:356] "Generic (PLEG): container finished" podID="877f0aa1-2394-4755-b32c-3ec26ae972a9" containerID="3799f2d596ab61ce2cd66b94f2382787a0206858222c0f0fc300504c4e34b427" exitCode=0 Jul 07 13:18:12.935398 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:12.935024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" event={"ID":"877f0aa1-2394-4755-b32c-3ec26ae972a9","Type":"ContainerDied","Data":"3799f2d596ab61ce2cd66b94f2382787a0206858222c0f0fc300504c4e34b427"} Jul 07 13:18:12.935449 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:12.935419 2577 scope.go:117] "RemoveContainer" containerID="3799f2d596ab61ce2cd66b94f2382787a0206858222c0f0fc300504c4e34b427" Jul 07 13:18:13.942874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:13.942833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8k5xf" event={"ID":"877f0aa1-2394-4755-b32c-3ec26ae972a9","Type":"ContainerStarted","Data":"87b8514d853d0079c55879fdee49548e68ad36941c6578f0a79eba957b410cf7"} Jul 07 13:18:13.962239 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:13.962213 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5874b88bf5-twgml_b17f6e88-5a54-4b02-96b2-28788c73a2ad/router/0.log" Jul 07 13:18:13.970818 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:13.970790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-69ffc_61b4e213-d827-4b00-ad59-7ff002b64d8a/serve-healthcheck-canary/0.log" Jul 07 13:18:16.694104 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:16.694071 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:16.694542 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:16.694131 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:16.698866 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:16.698844 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:16.957716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:16.957655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:18:17.032504 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:17.032469 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:18:20.259560 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.259515 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerName="registry" containerID="cri-o://d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633" gracePeriod=30 Jul 07 13:18:20.498826 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.498801 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:18:20.614053 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614030 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614081 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614101 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614123 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614149 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614168 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614217 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614185 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614537 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614229 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t59f\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f\") pod \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\" (UID: \"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc\") " Jul 07 13:18:20.614721 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614689 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:20.614809 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.614786 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:20.616755 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.616728 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:18:20.616852 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.616803 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:18:20.616902 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.616859 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:18:20.617016 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.616992 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f" (OuterVolumeSpecName: "kube-api-access-7t59f") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "kube-api-access-7t59f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:18:20.617105 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.617085 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:18:20.622771 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.622748 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" (UID: "acf74ee7-50aa-4b5f-b9ce-3017ada09fbc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:18:20.715716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715695 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715715 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-ca-trust-extracted\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715725 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-bound-sa-token\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715734 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-image-registry-private-configuration\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715742 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-trusted-ca\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715751 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-installation-pull-secrets\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715759 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-registry-certificates\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.715833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.715767 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t59f\" (UniqueName: \"kubernetes.io/projected/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc-kube-api-access-7t59f\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:20.972860 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.972787 2577 generic.go:356] "Generic (PLEG): container finished" podID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerID="d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633" exitCode=0 Jul 07 13:18:20.972860 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.972835 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" Jul 07 13:18:20.972860 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.972850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" event={"ID":"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc","Type":"ContainerDied","Data":"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633"} Jul 07 13:18:20.973063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.972920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7b6cb454-66m6r" event={"ID":"acf74ee7-50aa-4b5f-b9ce-3017ada09fbc","Type":"ContainerDied","Data":"a51efb6ddc69362e7fb671e25282b83e403bc07528e04999fbbbab8501f463ad"} Jul 07 13:18:20.973063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.972941 2577 scope.go:117] "RemoveContainer" containerID="d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633" Jul 07 13:18:20.981350 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.981334 2577 scope.go:117] "RemoveContainer" containerID="d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633" Jul 07 13:18:20.981602 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:20.981584 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633\": container with ID starting with d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633 not found: ID does not exist" containerID="d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633" Jul 07 13:18:20.981667 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.981608 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633"} err="failed to get container status \"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633\": rpc error: code = NotFound desc = could not find container \"d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633\": container with ID starting with d69fc8eccecf98924ac386c204ea43784a2fb4e9c881db917b9920afb0bd1633 not found: ID does not exist" Jul 07 13:18:20.993935 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.993912 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:18:20.997240 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:20.997221 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d7b6cb454-66m6r"] Jul 07 13:18:21.294653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:21.294602 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" path="/var/lib/kubelet/pods/acf74ee7-50aa-4b5f-b9ce-3017ada09fbc/volumes" Jul 07 13:18:28.006660 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:28.006622 2577 generic.go:356] "Generic (PLEG): container finished" podID="5e3b5036-a79d-4657-9b8e-09657b388591" containerID="e6558f85a6819b88a4b9759750482aa5e9be2bfa09e3bd3e21357c5336de523c" exitCode=0 Jul 07 13:18:28.007039 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:28.006697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" event={"ID":"5e3b5036-a79d-4657-9b8e-09657b388591","Type":"ContainerDied","Data":"e6558f85a6819b88a4b9759750482aa5e9be2bfa09e3bd3e21357c5336de523c"} Jul 07 13:18:28.007039 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:28.007006 2577 scope.go:117] "RemoveContainer" containerID="e6558f85a6819b88a4b9759750482aa5e9be2bfa09e3bd3e21357c5336de523c" Jul 07 13:18:29.015282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:29.015246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9pkl" event={"ID":"5e3b5036-a79d-4657-9b8e-09657b388591","Type":"ContainerStarted","Data":"073ddf6d04ce5eda1de205d33317bcd9f540d63f0a2c5aa7a9db6e3d4d96f4cd"} Jul 07 13:18:33.032211 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:33.032131 2577 generic.go:356] "Generic (PLEG): container finished" podID="19043063-7585-4e5c-81b6-06de25fb13eb" containerID="6300ad4429174bda816a7df183cffe0c1f0ab0c788ccba28a754dd4afdc50530" exitCode=0 Jul 07 13:18:33.032211 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:33.032207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" event={"ID":"19043063-7585-4e5c-81b6-06de25fb13eb","Type":"ContainerDied","Data":"6300ad4429174bda816a7df183cffe0c1f0ab0c788ccba28a754dd4afdc50530"} Jul 07 13:18:33.032539 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:33.032448 2577 scope.go:117] "RemoveContainer" containerID="6300ad4429174bda816a7df183cffe0c1f0ab0c788ccba28a754dd4afdc50530" Jul 07 13:18:34.038427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:34.038391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cjc42" event={"ID":"19043063-7585-4e5c-81b6-06de25fb13eb","Type":"ContainerStarted","Data":"5297212dd4fb3ff82992625573c0f5bb822c57fdc688746927c3e5cf17dc71c8"} Jul 07 13:18:42.053951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.053909 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57869bc449-mcmht" podUID="8dc31b20-e072-4a65-bd25-c5655cf7d684" containerName="console" containerID="cri-o://5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712" gracePeriod=15 Jul 07 13:18:42.303607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.303584 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:18:42.374314 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374289 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374320 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5vs2\" (UniqueName: \"kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374344 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374557 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374538 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374598 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374571 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374642 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374621 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374655 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert\") pod \"8dc31b20-e072-4a65-bd25-c5655cf7d684\" (UID: \"8dc31b20-e072-4a65-bd25-c5655cf7d684\") " Jul 07 13:18:42.374684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374654 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config" (OuterVolumeSpecName: "console-config") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:42.374788 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374717 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca" (OuterVolumeSpecName: "service-ca") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:42.374962 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.374921 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:42.375226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.375003 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:18:42.375226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.375074 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-service-ca\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.375226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.375094 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-oauth-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.375226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.375110 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-trusted-ca-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.375226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.375125 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.376612 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.376588 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2" (OuterVolumeSpecName: "kube-api-access-c5vs2") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "kube-api-access-c5vs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:18:42.377109 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.377085 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:18:42.377258 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.377105 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8dc31b20-e072-4a65-bd25-c5655cf7d684" (UID: "8dc31b20-e072-4a65-bd25-c5655cf7d684"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:18:42.476243 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.476218 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-oauth-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.476243 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.476240 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8dc31b20-e072-4a65-bd25-c5655cf7d684-console-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:42.476365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:42.476250 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5vs2\" (UniqueName: \"kubernetes.io/projected/8dc31b20-e072-4a65-bd25-c5655cf7d684-kube-api-access-c5vs2\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:18:43.075310 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.075274 2577 generic.go:356] "Generic (PLEG): container finished" podID="8dc31b20-e072-4a65-bd25-c5655cf7d684" containerID="5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712" exitCode=0 Jul 07 13:18:43.075693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.075346 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57869bc449-mcmht" Jul 07 13:18:43.075693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.075360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57869bc449-mcmht" event={"ID":"8dc31b20-e072-4a65-bd25-c5655cf7d684","Type":"ContainerDied","Data":"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712"} Jul 07 13:18:43.075693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.075438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57869bc449-mcmht" event={"ID":"8dc31b20-e072-4a65-bd25-c5655cf7d684","Type":"ContainerDied","Data":"546205cf224bbefd6acab32e834763944b5db277e31b208b3c3417da01ed44f2"} Jul 07 13:18:43.075693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.075461 2577 scope.go:117] "RemoveContainer" containerID="5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712" Jul 07 13:18:43.085254 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.085236 2577 scope.go:117] "RemoveContainer" containerID="5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712" Jul 07 13:18:43.085551 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:18:43.085531 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712\": container with ID starting with 5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712 not found: ID does not exist" containerID="5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712" Jul 07 13:18:43.085605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.085562 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712"} err="failed to get container status \"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712\": rpc error: code = NotFound desc = could not find container \"5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712\": container with ID starting with 5fb7f16fb72e84494f6c33980af25c38252881dcd6c24f5a0667b19c7ac6d712 not found: ID does not exist" Jul 07 13:18:43.096153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.096130 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:18:43.099592 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.099569 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57869bc449-mcmht"] Jul 07 13:18:43.294670 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:18:43.294650 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc31b20-e072-4a65-bd25-c5655cf7d684" path="/var/lib/kubelet/pods/8dc31b20-e072-4a65-bd25-c5655cf7d684/volumes" Jul 07 13:19:25.835287 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835256 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd"] Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835525 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc31b20-e072-4a65-bd25-c5655cf7d684" containerName="console" Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835536 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc31b20-e072-4a65-bd25-c5655cf7d684" containerName="console" Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835549 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerName="registry" Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835555 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerName="registry" Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835614 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf74ee7-50aa-4b5f-b9ce-3017ada09fbc" containerName="registry" Jul 07 13:19:25.835663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.835623 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc31b20-e072-4a65-bd25-c5655cf7d684" containerName="console" Jul 07 13:19:25.839746 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.839727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.842533 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.842503 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 13:19:25.842646 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.842539 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 13:19:25.842646 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.842505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xq7lz\"" Jul 07 13:19:25.842765 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.842664 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 13:19:25.842958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.842940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 13:19:25.843618 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.843604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 13:19:25.848362 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.848346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 13:19:25.857943 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.857910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd"] Jul 07 13:19:25.981424 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981523 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kb8\" (UniqueName: \"kubernetes.io/projected/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-kube-api-access-d6kb8\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981523 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-federate-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981523 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-metrics-client-ca\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981523 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981656 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981656 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:25.981721 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:25.981666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082610 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082706 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082706 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kb8\" (UniqueName: \"kubernetes.io/projected/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-kube-api-access-d6kb8\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082706 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-federate-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082706 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-metrics-client-ca\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082880 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082880 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.082880 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.082778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.083648 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.083615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-serving-certs-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.083754 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.083660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.083754 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.083615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-metrics-client-ca\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.085473 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.085409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-federate-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.085718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.085696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.085891 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.085867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.085930 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.085905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-telemeter-client-tls\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.090772 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.090752 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kb8\" (UniqueName: \"kubernetes.io/projected/0e45717a-c2e9-4d5a-8881-6d082f54fe4f-kube-api-access-d6kb8\") pod \"telemeter-client-5bcd485cbd-9ggrd\" (UID: \"0e45717a-c2e9-4d5a-8881-6d082f54fe4f\") " pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.149405 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.149383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" Jul 07 13:19:26.280928 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:26.280868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd"] Jul 07 13:19:26.283173 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:19:26.283142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e45717a_c2e9_4d5a_8881_6d082f54fe4f.slice/crio-7318314bc96697cdda7125a30b0919f7f2f53791212bc52654657ac81e4c8955 WatchSource:0}: Error finding container 7318314bc96697cdda7125a30b0919f7f2f53791212bc52654657ac81e4c8955: Status 404 returned error can't find the container with id 7318314bc96697cdda7125a30b0919f7f2f53791212bc52654657ac81e4c8955 Jul 07 13:19:27.259401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:27.259367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" event={"ID":"0e45717a-c2e9-4d5a-8881-6d082f54fe4f","Type":"ContainerStarted","Data":"7318314bc96697cdda7125a30b0919f7f2f53791212bc52654657ac81e4c8955"} Jul 07 13:19:28.265631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:28.265605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" event={"ID":"0e45717a-c2e9-4d5a-8881-6d082f54fe4f","Type":"ContainerStarted","Data":"6a56039e29a02b38870e2084f6c70f389a558ec149dd6a911e706f774f69bded"} Jul 07 13:19:28.265935 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:28.265671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" event={"ID":"0e45717a-c2e9-4d5a-8881-6d082f54fe4f","Type":"ContainerStarted","Data":"f3509cda28ab6644d981db8b76c1578de72438a99671572f5ffba92a89944a0b"} Jul 07 13:19:29.271935 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:29.271894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" event={"ID":"0e45717a-c2e9-4d5a-8881-6d082f54fe4f","Type":"ContainerStarted","Data":"23e3d5470fa7bd3a8bcd3a07d82cde56f71c3951ad187a6b9b2fb56e929f92de"} Jul 07 13:19:29.294984 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:29.294931 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bcd485cbd-9ggrd" podStartSLOduration=2.430990852 podStartE2EDuration="4.29491344s" totalImagesPullingTime="1.863922588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:19:29.291375714 +0000 UTC m=+188.487012950" watchObservedRunningTime="2026-07-07 13:19:29.29491344 +0000 UTC m=+188.490550647" Jul 07 13:19:29.949409 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:29.949366 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:19:29.953045 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:29.953020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:29.963471 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:29.963445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:19:30.112564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4r8\" (UniqueName: \"kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112870 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.112870 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.112807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213431 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213431 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213431 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.213678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.213595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4r8\" (UniqueName: \"kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.214294 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.214267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.214421 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.214340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.214470 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.214419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.214470 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.214419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.216608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.216581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.216729 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.216704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.221568 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.221540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4r8\" (UniqueName: \"kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8\") pod \"console-56d7d4c65-rwvs7\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.263182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.263158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:30.410096 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:30.410062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:19:30.413724 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:19:30.413691 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb1cc92_faea_4dbe_8f5d_c34c790dcb8e.slice/crio-90ad3d351fa31346bb649d7755608a9eb108ca11811ed86da0726c50bd589d0e WatchSource:0}: Error finding container 90ad3d351fa31346bb649d7755608a9eb108ca11811ed86da0726c50bd589d0e: Status 404 returned error can't find the container with id 90ad3d351fa31346bb649d7755608a9eb108ca11811ed86da0726c50bd589d0e Jul 07 13:19:31.281114 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:31.281078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d7d4c65-rwvs7" event={"ID":"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e","Type":"ContainerStarted","Data":"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed"} Jul 07 13:19:31.281297 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:31.281134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d7d4c65-rwvs7" event={"ID":"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e","Type":"ContainerStarted","Data":"90ad3d351fa31346bb649d7755608a9eb108ca11811ed86da0726c50bd589d0e"} Jul 07 13:19:31.298763 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:31.298716 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56d7d4c65-rwvs7" podStartSLOduration=2.298700951 podStartE2EDuration="2.298700951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:19:31.297179608 +0000 UTC m=+190.492816818" watchObservedRunningTime="2026-07-07 13:19:31.298700951 +0000 UTC m=+190.494338159" Jul 07 13:19:40.263602 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.263560 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:40.264123 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.263649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:40.268779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.268755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:40.318640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.318619 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:19:40.360652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.360619 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:19:40.435761 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.435730 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:19:40.440275 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.440252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.464003 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.463977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:19:40.485946 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.485924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486065 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.485953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.486081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486140 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.486109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486140 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.486131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486234 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.486216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlcb\" (UniqueName: \"kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.486273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.486247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586703 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586703 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586703 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlcb\" (UniqueName: \"kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586703 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.586905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.586724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.587447 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.587425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.587530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.587480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.587572 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.587523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.587728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.587706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.589012 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.588993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.589117 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.589100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.594100 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.594077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlcb\" (UniqueName: \"kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb\") pod \"console-58dbfdb677-gxhnh\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.749858 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.749831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:40.876993 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:40.876968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:19:40.879535 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:19:40.879510 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2860c60_9ab3_4749_8266_a2da208e23a3.slice/crio-ccca8406fadc8beef2ee4659bf39ed49a4b93d7ba94235aa6a59f8a2ebebab88 WatchSource:0}: Error finding container ccca8406fadc8beef2ee4659bf39ed49a4b93d7ba94235aa6a59f8a2ebebab88: Status 404 returned error can't find the container with id ccca8406fadc8beef2ee4659bf39ed49a4b93d7ba94235aa6a59f8a2ebebab88 Jul 07 13:19:41.320136 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:41.320041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58dbfdb677-gxhnh" event={"ID":"a2860c60-9ab3-4749-8266-a2da208e23a3","Type":"ContainerStarted","Data":"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098"} Jul 07 13:19:41.320136 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:41.320097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58dbfdb677-gxhnh" event={"ID":"a2860c60-9ab3-4749-8266-a2da208e23a3","Type":"ContainerStarted","Data":"ccca8406fadc8beef2ee4659bf39ed49a4b93d7ba94235aa6a59f8a2ebebab88"} Jul 07 13:19:41.335890 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:41.335675 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58dbfdb677-gxhnh" podStartSLOduration=1.335661668 podStartE2EDuration="1.335661668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:19:41.335545469 +0000 UTC m=+200.531182676" watchObservedRunningTime="2026-07-07 13:19:41.335661668 +0000 UTC m=+200.531298877" Jul 07 13:19:50.750228 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:50.750169 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:50.750688 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:50.750257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:50.754949 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:50.754922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:51.366757 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:51.366730 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:19:51.407048 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:19:51.407014 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:20:05.385080 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.385040 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f45f4c44f-bwcj9" podUID="45b07b58-605b-4bec-8617-2046eabfc2db" containerName="console" containerID="cri-o://b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962" gracePeriod=15 Jul 07 13:20:05.624354 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.624330 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:20:05.672483 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpzcd\" (UniqueName: \"kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672483 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672436 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672698 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672698 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672607 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672698 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672635 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672849 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672709 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672849 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672750 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca\") pod \"45b07b58-605b-4bec-8617-2046eabfc2db\" (UID: \"45b07b58-605b-4bec-8617-2046eabfc2db\") " Jul 07 13:20:05.672849 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.672790 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:05.673026 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.673009 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-oauth-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.673102 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.673056 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:05.673154 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.673101 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config" (OuterVolumeSpecName: "console-config") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:05.673221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.673162 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca" (OuterVolumeSpecName: "service-ca") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:05.674642 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.674616 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:20:05.674775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.674756 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:20:05.674838 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.674780 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd" (OuterVolumeSpecName: "kube-api-access-vpzcd") pod "45b07b58-605b-4bec-8617-2046eabfc2db" (UID: "45b07b58-605b-4bec-8617-2046eabfc2db"). InnerVolumeSpecName "kube-api-access-vpzcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:20:05.773610 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773584 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-console-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.773610 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773606 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-service-ca\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.773610 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773615 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpzcd\" (UniqueName: \"kubernetes.io/projected/45b07b58-605b-4bec-8617-2046eabfc2db-kube-api-access-vpzcd\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.773789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773623 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-oauth-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.773789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773632 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45b07b58-605b-4bec-8617-2046eabfc2db-trusted-ca-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:05.773789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:05.773640 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45b07b58-605b-4bec-8617-2046eabfc2db-console-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:06.425351 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.425316 2577 generic.go:356] "Generic (PLEG): container finished" podID="45b07b58-605b-4bec-8617-2046eabfc2db" containerID="b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962" exitCode=0 Jul 07 13:20:06.425748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.425360 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f4c44f-bwcj9" Jul 07 13:20:06.425748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.425408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f4c44f-bwcj9" event={"ID":"45b07b58-605b-4bec-8617-2046eabfc2db","Type":"ContainerDied","Data":"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962"} Jul 07 13:20:06.425748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.425465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f4c44f-bwcj9" event={"ID":"45b07b58-605b-4bec-8617-2046eabfc2db","Type":"ContainerDied","Data":"e51ab206a65b3f4b949366f9d628006772cf3bde80e7ef558bb5cfd5b9426873"} Jul 07 13:20:06.425748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.425486 2577 scope.go:117] "RemoveContainer" containerID="b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962" Jul 07 13:20:06.434525 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.434505 2577 scope.go:117] "RemoveContainer" containerID="b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962" Jul 07 13:20:06.434801 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:20:06.434781 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962\": container with ID starting with b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962 not found: ID does not exist" containerID="b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962" Jul 07 13:20:06.434872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.434807 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962"} err="failed to get container status \"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962\": rpc error: code = NotFound desc = could not find container \"b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962\": container with ID starting with b039ce7db3dd8b0213b7526b1e2567c23e4404f191898a2f9c7af6161ac1c962 not found: ID does not exist" Jul 07 13:20:06.446377 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.446353 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:20:06.450164 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:06.450142 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f45f4c44f-bwcj9"] Jul 07 13:20:07.295182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:07.295149 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b07b58-605b-4bec-8617-2046eabfc2db" path="/var/lib/kubelet/pods/45b07b58-605b-4bec-8617-2046eabfc2db/volumes" Jul 07 13:20:16.430602 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.430563 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56d7d4c65-rwvs7" podUID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" containerName="console" containerID="cri-o://cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed" gracePeriod=15 Jul 07 13:20:16.667648 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.667626 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:20:16.753811 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753742 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m4r8\" (UniqueName: \"kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.753811 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753791 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753836 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753857 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753891 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753941 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.753966 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config\") pod \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\" (UID: \"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e\") " Jul 07 13:20:16.754364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.754310 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:16.754364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.754321 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:16.754364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.754326 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config" (OuterVolumeSpecName: "console-config") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:16.754656 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.754400 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:20:16.755992 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.755968 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:20:16.756087 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.755974 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8" (OuterVolumeSpecName: "kube-api-access-4m4r8") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "kube-api-access-4m4r8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:20:16.756087 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.756046 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" (UID: "1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:20:16.854522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854497 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-trusted-ca-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854520 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-service-ca\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854530 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854539 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-oauth-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854547 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-oauth-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854555 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m4r8\" (UniqueName: \"kubernetes.io/projected/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-kube-api-access-4m4r8\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:16.854663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:16.854578 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e-console-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:17.471793 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.471764 2577 generic.go:356] "Generic (PLEG): container finished" podID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" containerID="cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed" exitCode=0 Jul 07 13:20:17.472165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.471807 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d7d4c65-rwvs7" Jul 07 13:20:17.472165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.471853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d7d4c65-rwvs7" event={"ID":"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e","Type":"ContainerDied","Data":"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed"} Jul 07 13:20:17.472165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.471902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d7d4c65-rwvs7" event={"ID":"1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e","Type":"ContainerDied","Data":"90ad3d351fa31346bb649d7755608a9eb108ca11811ed86da0726c50bd589d0e"} Jul 07 13:20:17.472165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.471929 2577 scope.go:117] "RemoveContainer" containerID="cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed" Jul 07 13:20:17.480643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.480625 2577 scope.go:117] "RemoveContainer" containerID="cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed" Jul 07 13:20:17.480898 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:20:17.480877 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed\": container with ID starting with cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed not found: ID does not exist" containerID="cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed" Jul 07 13:20:17.480946 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.480907 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed"} err="failed to get container status \"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed\": rpc error: code = NotFound desc = could not find container \"cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed\": container with ID starting with cba7086139a18e5afe52afd9170f1c6f732910e34ace92ea45c47e5ad5ab87ed not found: ID does not exist" Jul 07 13:20:17.487948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.487925 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:20:17.491302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:17.491283 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56d7d4c65-rwvs7"] Jul 07 13:20:19.294805 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:19.294770 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" path="/var/lib/kubelet/pods/1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e/volumes" Jul 07 13:20:25.662473 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662433 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch"] Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662810 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" containerName="console" Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662825 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" containerName="console" Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662860 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b07b58-605b-4bec-8617-2046eabfc2db" containerName="console" Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662868 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b07b58-605b-4bec-8617-2046eabfc2db" containerName="console" Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662930 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb1cc92-faea-4dbe-8f5d-c34c790dcb8e" containerName="console" Jul 07 13:20:25.662976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.662943 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b07b58-605b-4bec-8617-2046eabfc2db" containerName="console" Jul 07 13:20:25.667893 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.667872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.670562 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.670535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:20:25.670724 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.670575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gcrgr\"" Jul 07 13:20:25.670724 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.670578 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:20:25.674725 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.674693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch"] Jul 07 13:20:25.828119 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.828088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnnj\" (UniqueName: \"kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.828276 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.828129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.828276 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.828228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.929402 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.929340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.929402 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.929400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnnj\" (UniqueName: \"kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.929596 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.929426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.929741 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.929720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.929741 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.929733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.937950 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.937919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnnj\" (UniqueName: \"kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:25.978828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:25.978804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:26.110024 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:26.110000 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch"] Jul 07 13:20:26.111921 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:20:26.111895 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2a9c31_7b0a_4666_9233_26c1c3086e0e.slice/crio-b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737 WatchSource:0}: Error finding container b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737: Status 404 returned error can't find the container with id b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737 Jul 07 13:20:26.509118 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:26.509088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerStarted","Data":"b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737"} Jul 07 13:20:33.539677 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:33.539610 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerID="603686a73dcf6a849724250b22af38a513d34433d3c61c435d8a6ee0d4a51028" exitCode=0 Jul 07 13:20:33.540005 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:33.539704 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerDied","Data":"603686a73dcf6a849724250b22af38a513d34433d3c61c435d8a6ee0d4a51028"} Jul 07 13:20:35.550438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:35.550407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerStarted","Data":"aa8206d8bd7b3d70a64a2b8e03df0599bc280c138819dba7a10fb667f929228a"} Jul 07 13:20:36.556322 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:36.556286 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerID="aa8206d8bd7b3d70a64a2b8e03df0599bc280c138819dba7a10fb667f929228a" exitCode=0 Jul 07 13:20:36.556747 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:36.556367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerDied","Data":"aa8206d8bd7b3d70a64a2b8e03df0599bc280c138819dba7a10fb667f929228a"} Jul 07 13:20:45.598470 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:45.598440 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerID="50d12bc261a6d0124a8a3d8c1294a1ad1c5e61a2d0317fb621b8127b94c0b93e" exitCode=0 Jul 07 13:20:45.598815 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:45.598517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerDied","Data":"50d12bc261a6d0124a8a3d8c1294a1ad1c5e61a2d0317fb621b8127b94c0b93e"} Jul 07 13:20:46.767018 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.766992 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:46.893161 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.893100 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle\") pod \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " Jul 07 13:20:46.893161 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.893136 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util\") pod \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " Jul 07 13:20:46.893366 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.893249 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwnnj\" (UniqueName: \"kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj\") pod \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\" (UID: \"0b2a9c31-7b0a-4666-9233-26c1c3086e0e\") " Jul 07 13:20:46.893709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.893683 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle" (OuterVolumeSpecName: "bundle") pod "0b2a9c31-7b0a-4666-9233-26c1c3086e0e" (UID: "0b2a9c31-7b0a-4666-9233-26c1c3086e0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:20:46.895390 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.895362 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj" (OuterVolumeSpecName: "kube-api-access-mwnnj") pod "0b2a9c31-7b0a-4666-9233-26c1c3086e0e" (UID: "0b2a9c31-7b0a-4666-9233-26c1c3086e0e"). InnerVolumeSpecName "kube-api-access-mwnnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:20:46.897353 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.897331 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util" (OuterVolumeSpecName: "util") pod "0b2a9c31-7b0a-4666-9233-26c1c3086e0e" (UID: "0b2a9c31-7b0a-4666-9233-26c1c3086e0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:20:46.993778 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.993755 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwnnj\" (UniqueName: \"kubernetes.io/projected/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-kube-api-access-mwnnj\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:46.993778 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.993776 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:46.993892 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:46.993785 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b2a9c31-7b0a-4666-9233-26c1c3086e0e-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:20:47.608176 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:47.608146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" event={"ID":"0b2a9c31-7b0a-4666-9233-26c1c3086e0e","Type":"ContainerDied","Data":"b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737"} Jul 07 13:20:47.608318 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:47.608178 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c8gch" Jul 07 13:20:47.608318 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:47.608211 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b743292c2bf318f761ec33845f1678af77717e8418c9a9fed6daca7b061a7737" Jul 07 13:20:53.634280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634248 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k"] Jul 07 13:20:53.634697 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634668 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="pull" Jul 07 13:20:53.634697 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634686 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="pull" Jul 07 13:20:53.634803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634722 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="extract" Jul 07 13:20:53.634803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634752 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="extract" Jul 07 13:20:53.634803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634764 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="util" Jul 07 13:20:53.634803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634773 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="util" Jul 07 13:20:53.634920 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.634864 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2a9c31-7b0a-4666-9233-26c1c3086e0e" containerName="extract" Jul 07 13:20:53.637592 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.637559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.640234 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.640208 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:20:53.640360 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.640263 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ks9sv\"" Jul 07 13:20:53.640360 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.640272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 13:20:53.644300 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.644269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sssmk\" (UniqueName: \"kubernetes.io/projected/8b6912ae-0c20-4f63-b65f-fc582f87eb37-kube-api-access-sssmk\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.644448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.644340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6912ae-0c20-4f63-b65f-fc582f87eb37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.648458 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.648434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k"] Jul 07 13:20:53.745386 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.745363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sssmk\" (UniqueName: \"kubernetes.io/projected/8b6912ae-0c20-4f63-b65f-fc582f87eb37-kube-api-access-sssmk\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.745511 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.745403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6912ae-0c20-4f63-b65f-fc582f87eb37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.745760 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.745744 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6912ae-0c20-4f63-b65f-fc582f87eb37-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.753027 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.753002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sssmk\" (UniqueName: \"kubernetes.io/projected/8b6912ae-0c20-4f63-b65f-fc582f87eb37-kube-api-access-sssmk\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfk7k\" (UID: \"8b6912ae-0c20-4f63-b65f-fc582f87eb37\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:53.946994 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:53.946928 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" Jul 07 13:20:54.079807 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:54.079784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k"] Jul 07 13:20:54.082796 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:20:54.082770 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6912ae_0c20_4f63_b65f_fc582f87eb37.slice/crio-87068af993d3624fe4595d5c7282a2f51beba1a967b307748243ecef4cc2b8b8 WatchSource:0}: Error finding container 87068af993d3624fe4595d5c7282a2f51beba1a967b307748243ecef4cc2b8b8: Status 404 returned error can't find the container with id 87068af993d3624fe4595d5c7282a2f51beba1a967b307748243ecef4cc2b8b8 Jul 07 13:20:54.640921 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:54.640887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" event={"ID":"8b6912ae-0c20-4f63-b65f-fc582f87eb37","Type":"ContainerStarted","Data":"87068af993d3624fe4595d5c7282a2f51beba1a967b307748243ecef4cc2b8b8"} Jul 07 13:20:55.646996 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:55.646958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" event={"ID":"8b6912ae-0c20-4f63-b65f-fc582f87eb37","Type":"ContainerStarted","Data":"fb357383968f59a0aa6b58389b756f6b238c4888a48558fd59b4d350d981a03c"} Jul 07 13:20:55.669151 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:55.669099 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfk7k" podStartSLOduration=1.332354896 podStartE2EDuration="2.669085426s" totalImagesPullingTime="1.33673053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:20:55.667643407 +0000 UTC m=+274.863280608" watchObservedRunningTime="2026-07-07 13:20:55.669085426 +0000 UTC m=+274.864722634" Jul 07 13:20:57.177762 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.177731 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l7699"] Jul 07 13:20:57.179880 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.179865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.182364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.182331 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 13:20:57.182502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.182363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 13:20:57.182502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.182379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hkd8h\"" Jul 07 13:20:57.189336 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.189314 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l7699"] Jul 07 13:20:57.270830 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.270808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.270942 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.270848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkfw\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-kube-api-access-8pkfw\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.371905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.371872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkfw\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-kube-api-access-8pkfw\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.372032 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.371929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.385948 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.385925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkfw\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-kube-api-access-8pkfw\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.386418 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.386400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dba0f715-6485-4e94-9e1e-20e2bd036d19-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l7699\" (UID: \"dba0f715-6485-4e94-9e1e-20e2bd036d19\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.499652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.499594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:20:57.515442 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.515418 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf"] Jul 07 13:20:57.517958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.517938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.520442 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.520421 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:20:57.520558 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.520422 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:20:57.520558 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.520470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gcrgr\"" Jul 07 13:20:57.527001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.526965 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf"] Jul 07 13:20:57.573051 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.573023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.573177 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.573090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.573177 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.573125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jktd6\" (UniqueName: \"kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.630979 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.630857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l7699"] Jul 07 13:20:57.633658 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:20:57.633632 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddba0f715_6485_4e94_9e1e_20e2bd036d19.slice/crio-976ea396abcd05224663d19939af97f31d3c2a97018cccfa24417637869ef8ab WatchSource:0}: Error finding container 976ea396abcd05224663d19939af97f31d3c2a97018cccfa24417637869ef8ab: Status 404 returned error can't find the container with id 976ea396abcd05224663d19939af97f31d3c2a97018cccfa24417637869ef8ab Jul 07 13:20:57.656352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.656323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" event={"ID":"dba0f715-6485-4e94-9e1e-20e2bd036d19","Type":"ContainerStarted","Data":"976ea396abcd05224663d19939af97f31d3c2a97018cccfa24417637869ef8ab"} Jul 07 13:20:57.673616 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.673592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.673696 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.673627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.673696 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.673647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jktd6\" (UniqueName: \"kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.673975 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.673955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.674034 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.674001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.681684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.681657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jktd6\" (UniqueName: \"kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.829890 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.829839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:20:57.955909 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:57.955883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf"] Jul 07 13:20:57.958231 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:20:57.958206 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2c2b78_a376_41c3_9aad_2345c4715c12.slice/crio-1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50 WatchSource:0}: Error finding container 1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50: Status 404 returned error can't find the container with id 1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50 Jul 07 13:20:58.663687 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:58.663646 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerID="4e98f3a3c5df6eb25758818a0a42514bfa31bbbc308d754477e21572a4f3f1e3" exitCode=0 Jul 07 13:20:58.664170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:58.663693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" event={"ID":"de2c2b78-a376-41c3-9aad-2345c4715c12","Type":"ContainerDied","Data":"4e98f3a3c5df6eb25758818a0a42514bfa31bbbc308d754477e21572a4f3f1e3"} Jul 07 13:20:58.664170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:20:58.663735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" event={"ID":"de2c2b78-a376-41c3-9aad-2345c4715c12","Type":"ContainerStarted","Data":"1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50"} Jul 07 13:21:00.675831 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:00.675785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" event={"ID":"dba0f715-6485-4e94-9e1e-20e2bd036d19","Type":"ContainerStarted","Data":"4abf7edd879feb73eb9f461d96d241763fb37905300f41956060003acf9160ab"} Jul 07 13:21:00.676272 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:00.675873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:21:00.691556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:00.691506 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" podStartSLOduration=1.22573004 podStartE2EDuration="3.691488343s" totalImagesPullingTime="2.465758303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:00.690347524 +0000 UTC m=+279.885984735" watchObservedRunningTime="2026-07-07 13:21:00.691488343 +0000 UTC m=+279.887125551" Jul 07 13:21:01.682040 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:01.682007 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerID="4bbba250034eee2242617bbd503980c7590c6495d8f77d74fe90da6678e8b206" exitCode=0 Jul 07 13:21:01.682443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:01.682071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" event={"ID":"de2c2b78-a376-41c3-9aad-2345c4715c12","Type":"ContainerDied","Data":"4bbba250034eee2242617bbd503980c7590c6495d8f77d74fe90da6678e8b206"} Jul 07 13:21:02.688968 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:02.688930 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerID="e3d48aeadcaeb4a2c840a13115427a0c0d630ea2366b20055c47baa529622a56" exitCode=0 Jul 07 13:21:02.689390 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:02.689016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" event={"ID":"de2c2b78-a376-41c3-9aad-2345c4715c12","Type":"ContainerDied","Data":"e3d48aeadcaeb4a2c840a13115427a0c0d630ea2366b20055c47baa529622a56"} Jul 07 13:21:03.818716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.818692 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:21:03.923687 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.923659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util\") pod \"de2c2b78-a376-41c3-9aad-2345c4715c12\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " Jul 07 13:21:03.923823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.923718 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jktd6\" (UniqueName: \"kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6\") pod \"de2c2b78-a376-41c3-9aad-2345c4715c12\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " Jul 07 13:21:03.923823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.923799 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle\") pod \"de2c2b78-a376-41c3-9aad-2345c4715c12\" (UID: \"de2c2b78-a376-41c3-9aad-2345c4715c12\") " Jul 07 13:21:03.924563 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.924526 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle" (OuterVolumeSpecName: "bundle") pod "de2c2b78-a376-41c3-9aad-2345c4715c12" (UID: "de2c2b78-a376-41c3-9aad-2345c4715c12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:21:03.925819 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.925790 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6" (OuterVolumeSpecName: "kube-api-access-jktd6") pod "de2c2b78-a376-41c3-9aad-2345c4715c12" (UID: "de2c2b78-a376-41c3-9aad-2345c4715c12"). InnerVolumeSpecName "kube-api-access-jktd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:21:03.927773 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:03.927741 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util" (OuterVolumeSpecName: "util") pod "de2c2b78-a376-41c3-9aad-2345c4715c12" (UID: "de2c2b78-a376-41c3-9aad-2345c4715c12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:21:04.025099 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.025041 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:04.025099 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.025064 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jktd6\" (UniqueName: \"kubernetes.io/projected/de2c2b78-a376-41c3-9aad-2345c4715c12-kube-api-access-jktd6\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:04.025099 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.025080 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2c2b78-a376-41c3-9aad-2345c4715c12-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:04.706181 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.706152 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" Jul 07 13:21:04.706394 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.706214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4k5gf" event={"ID":"de2c2b78-a376-41c3-9aad-2345c4715c12","Type":"ContainerDied","Data":"1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50"} Jul 07 13:21:04.706394 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:04.706316 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a20b15a4f7bd7fb9625123fb38e349809c2bcfe4dfbdb38661e8f95bb4c5e50" Jul 07 13:21:06.375781 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.375739 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb995"] Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376100 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="pull" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376113 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="pull" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376128 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="extract" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376134 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="extract" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376149 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="util" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376158 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="util" Jul 07 13:21:06.376231 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.376233 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2c2b78-a376-41c3-9aad-2345c4715c12" containerName="extract" Jul 07 13:21:06.378638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.378619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.380966 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.380939 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cdpnz\"" Jul 07 13:21:06.389308 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.389279 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb995"] Jul 07 13:21:06.446066 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.446040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.446162 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.446082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9656x\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-kube-api-access-9656x\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.546824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.546803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.546909 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.546845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9656x\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-kube-api-access-9656x\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.555262 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.555239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.555378 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.555365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9656x\" (UniqueName: \"kubernetes.io/projected/e8ceb774-db64-41e9-bfde-6d739db71100-kube-api-access-9656x\") pod \"cert-manager-55b4d954d5-nb995\" (UID: \"e8ceb774-db64-41e9-bfde-6d739db71100\") " pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.685060 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.684999 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l7699" Jul 07 13:21:06.688469 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.688445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nb995" Jul 07 13:21:06.818078 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:06.818053 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb995"] Jul 07 13:21:06.820027 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:06.819999 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8ceb774_db64_41e9_bfde_6d739db71100.slice/crio-c3a88dd43045dc3b48c70e44f74a9b8c60537c293be0bd738bb6b46e5f76ca78 WatchSource:0}: Error finding container c3a88dd43045dc3b48c70e44f74a9b8c60537c293be0bd738bb6b46e5f76ca78: Status 404 returned error can't find the container with id c3a88dd43045dc3b48c70e44f74a9b8c60537c293be0bd738bb6b46e5f76ca78 Jul 07 13:21:07.720981 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:07.720947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nb995" event={"ID":"e8ceb774-db64-41e9-bfde-6d739db71100","Type":"ContainerStarted","Data":"994291057ffac117b317bb30ce98835f4502ed4a9bd50bc9a9c1ffc36413d6c9"} Jul 07 13:21:07.721467 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:07.721000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nb995" event={"ID":"e8ceb774-db64-41e9-bfde-6d739db71100","Type":"ContainerStarted","Data":"c3a88dd43045dc3b48c70e44f74a9b8c60537c293be0bd738bb6b46e5f76ca78"} Jul 07 13:21:07.736969 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:07.736914 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nb995" podStartSLOduration=1.736900308 podStartE2EDuration="1.736900308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:07.735635406 +0000 UTC m=+286.931272613" watchObservedRunningTime="2026-07-07 13:21:07.736900308 +0000 UTC m=+286.932537516" Jul 07 13:21:10.519879 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.519845 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj"] Jul 07 13:21:10.544556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.544532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.544556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.544540 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj"] Jul 07 13:21:10.547389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.547368 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:21:10.548312 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.548291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 13:21:10.548438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.548338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-498xc\"" Jul 07 13:21:10.577032 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.577011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbt7t\" (UniqueName: \"kubernetes.io/projected/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-kube-api-access-mbt7t\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.577121 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.577047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.677524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.677500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbt7t\" (UniqueName: \"kubernetes.io/projected/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-kube-api-access-mbt7t\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.677629 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.677527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.677850 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.677833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.685522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.685501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbt7t\" (UniqueName: \"kubernetes.io/projected/c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33-kube-api-access-mbt7t\") pod \"openshift-lws-operator-fd8ccff4c-9f6hj\" (UID: \"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:10.853542 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:10.853518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" Jul 07 13:21:11.005951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:11.005922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj"] Jul 07 13:21:11.008465 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:11.008439 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3bc2550_ae5d_4fa3_bfa8_4196c6f23a33.slice/crio-cda2a00940ea3adac8eeac097978085b051337d5fd0f7f2d505afe58e68eb648 WatchSource:0}: Error finding container cda2a00940ea3adac8eeac097978085b051337d5fd0f7f2d505afe58e68eb648: Status 404 returned error can't find the container with id cda2a00940ea3adac8eeac097978085b051337d5fd0f7f2d505afe58e68eb648 Jul 07 13:21:11.740464 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:11.740433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" event={"ID":"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33","Type":"ContainerStarted","Data":"cda2a00940ea3adac8eeac097978085b051337d5fd0f7f2d505afe58e68eb648"} Jul 07 13:21:13.752877 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:13.752841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" event={"ID":"c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33","Type":"ContainerStarted","Data":"88b41d37b91264b408059198249cc0258e4ff0c23e9438dbf0e33e58e419f9ee"} Jul 07 13:21:13.769133 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:13.769088 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9f6hj" podStartSLOduration=1.459522146 podStartE2EDuration="3.769070736s" totalImagesPullingTime="2.30954859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:13.768908628 +0000 UTC m=+292.964545837" watchObservedRunningTime="2026-07-07 13:21:13.769070736 +0000 UTC m=+292.964707945" Jul 07 13:21:16.362000 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.361964 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z"] Jul 07 13:21:16.364879 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.364860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.367298 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.367263 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gcrgr\"" Jul 07 13:21:16.367298 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.367274 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:21:16.368269 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.368240 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:21:16.372797 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.372768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z"] Jul 07 13:21:16.422321 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.422296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9lm9\" (UniqueName: \"kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.422438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.422345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.422438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.422366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.523149 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.523124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9lm9\" (UniqueName: \"kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.523291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.523175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.523291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.523216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.523760 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.523735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.523827 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.523746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.530906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.530883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9lm9\" (UniqueName: \"kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.675018 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.674969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:16.805563 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:16.805491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z"] Jul 07 13:21:16.807889 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:16.807855 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107e7e89_4516_4953_be8c_363170d4358b.slice/crio-7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091 WatchSource:0}: Error finding container 7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091: Status 404 returned error can't find the container with id 7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091 Jul 07 13:21:17.774601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:17.774562 2577 generic.go:356] "Generic (PLEG): container finished" podID="107e7e89-4516-4953-be8c-363170d4358b" containerID="e9d92b9f4b966d0820cb83b07e4033486a6b331676b0eea223525243e538bb99" exitCode=0 Jul 07 13:21:17.775033 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:17.774648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" event={"ID":"107e7e89-4516-4953-be8c-363170d4358b","Type":"ContainerDied","Data":"e9d92b9f4b966d0820cb83b07e4033486a6b331676b0eea223525243e538bb99"} Jul 07 13:21:17.775033 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:17.774701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" event={"ID":"107e7e89-4516-4953-be8c-363170d4358b","Type":"ContainerStarted","Data":"7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091"} Jul 07 13:21:18.782654 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:18.782621 2577 generic.go:356] "Generic (PLEG): container finished" podID="107e7e89-4516-4953-be8c-363170d4358b" containerID="db8d160d27d1b133ff01d876fcc386b47133fca356a8a0054c056a125663b71f" exitCode=0 Jul 07 13:21:18.783001 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:18.782701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" event={"ID":"107e7e89-4516-4953-be8c-363170d4358b","Type":"ContainerDied","Data":"db8d160d27d1b133ff01d876fcc386b47133fca356a8a0054c056a125663b71f"} Jul 07 13:21:19.789638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:19.789601 2577 generic.go:356] "Generic (PLEG): container finished" podID="107e7e89-4516-4953-be8c-363170d4358b" containerID="6b42a8c6640c8d0d0d7511c942d9b2bb3cea3686c2a3a3552fce611d1d8b1cb0" exitCode=0 Jul 07 13:21:19.790020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:19.789669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" event={"ID":"107e7e89-4516-4953-be8c-363170d4358b","Type":"ContainerDied","Data":"6b42a8c6640c8d0d0d7511c942d9b2bb3cea3686c2a3a3552fce611d1d8b1cb0"} Jul 07 13:21:20.923789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:20.923763 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:21.060273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.060208 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle\") pod \"107e7e89-4516-4953-be8c-363170d4358b\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " Jul 07 13:21:21.060273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.060241 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util\") pod \"107e7e89-4516-4953-be8c-363170d4358b\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " Jul 07 13:21:21.060273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.060271 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9lm9\" (UniqueName: \"kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9\") pod \"107e7e89-4516-4953-be8c-363170d4358b\" (UID: \"107e7e89-4516-4953-be8c-363170d4358b\") " Jul 07 13:21:21.060867 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.060840 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle" (OuterVolumeSpecName: "bundle") pod "107e7e89-4516-4953-be8c-363170d4358b" (UID: "107e7e89-4516-4953-be8c-363170d4358b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:21:21.062341 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.062311 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9" (OuterVolumeSpecName: "kube-api-access-r9lm9") pod "107e7e89-4516-4953-be8c-363170d4358b" (UID: "107e7e89-4516-4953-be8c-363170d4358b"). InnerVolumeSpecName "kube-api-access-r9lm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:21:21.065631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.065594 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util" (OuterVolumeSpecName: "util") pod "107e7e89-4516-4953-be8c-363170d4358b" (UID: "107e7e89-4516-4953-be8c-363170d4358b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:21:21.160731 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.160710 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:21.160731 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.160733 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/107e7e89-4516-4953-be8c-363170d4358b-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:21.160904 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.160746 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9lm9\" (UniqueName: \"kubernetes.io/projected/107e7e89-4516-4953-be8c-363170d4358b-kube-api-access-r9lm9\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:21:21.161047 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.161026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:21:21.164499 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.164481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:21:21.164619 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.164601 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:21:21.168223 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.168185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:21:21.171302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.171281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:21:21.174897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.174880 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:21:21.176768 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.176750 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 13:21:21.801270 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.801231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" event={"ID":"107e7e89-4516-4953-be8c-363170d4358b","Type":"ContainerDied","Data":"7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091"} Jul 07 13:21:21.801270 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.801257 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz484z" Jul 07 13:21:21.801505 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:21.801290 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7baab4509b132f12414b3b70adbdac28f1142c76d7a5cb62c939493a6e729091" Jul 07 13:21:33.690047 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690009 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns"] Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690353 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="pull" Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690367 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="pull" Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690384 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="util" Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690392 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="util" Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690421 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="extract" Jul 07 13:21:33.690472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690430 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="extract" Jul 07 13:21:33.690678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.690523 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="107e7e89-4516-4953-be8c-363170d4358b" containerName="extract" Jul 07 13:21:33.693356 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.693336 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.696162 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.696137 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 13:21:33.696292 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.696226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 13:21:33.696292 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.696233 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 13:21:33.696404 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.696373 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 13:21:33.696543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.696528 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vc28\"" Jul 07 13:21:33.709629 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.709605 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns"] Jul 07 13:21:33.757971 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.757942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-tmp\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.758076 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.757977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.758076 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.758022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-manifests\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.758216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.758074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbfv\" (UniqueName: \"kubernetes.io/projected/7efa4a64-63d2-4481-832e-0c3a9d624ab1-kube-api-access-xtbfv\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.758216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.758137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-tmp\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859542 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-manifests\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859542 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbfv\" (UniqueName: \"kubernetes.io/projected/7efa4a64-63d2-4481-832e-0c3a9d624ab1-kube-api-access-xtbfv\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859542 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.859828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.859803 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-manifests\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.861696 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.861675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa4a64-63d2-4481-832e-0c3a9d624ab1-tmp\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.861774 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.861703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.861892 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.861870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7efa4a64-63d2-4481-832e-0c3a9d624ab1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:33.867644 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:33.867615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbfv\" (UniqueName: \"kubernetes.io/projected/7efa4a64-63d2-4481-832e-0c3a9d624ab1-kube-api-access-xtbfv\") pod \"opendatahub-operator-controller-manager-69fbc88fbc-rqjns\" (UID: \"7efa4a64-63d2-4481-832e-0c3a9d624ab1\") " pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:34.004151 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:34.004092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:34.144599 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:34.144568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns"] Jul 07 13:21:34.147111 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:34.147084 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efa4a64_63d2_4481_832e_0c3a9d624ab1.slice/crio-04b46ee00dedb6e6604abe3a042b73a95041106dbca4526f3020bb5afe7eaea1 WatchSource:0}: Error finding container 04b46ee00dedb6e6604abe3a042b73a95041106dbca4526f3020bb5afe7eaea1: Status 404 returned error can't find the container with id 04b46ee00dedb6e6604abe3a042b73a95041106dbca4526f3020bb5afe7eaea1 Jul 07 13:21:34.148974 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:34.148955 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:21:34.865281 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:34.865244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" event={"ID":"7efa4a64-63d2-4481-832e-0c3a9d624ab1","Type":"ContainerStarted","Data":"04b46ee00dedb6e6604abe3a042b73a95041106dbca4526f3020bb5afe7eaea1"} Jul 07 13:21:37.882764 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:37.882718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" event={"ID":"7efa4a64-63d2-4481-832e-0c3a9d624ab1","Type":"ContainerStarted","Data":"a91236eb01a1c480cd7701d8173519c3b8d22911b6a689df69136cb4a3d17b47"} Jul 07 13:21:38.889153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:38.889120 2577 generic.go:356] "Generic (PLEG): container finished" podID="7efa4a64-63d2-4481-832e-0c3a9d624ab1" containerID="a91236eb01a1c480cd7701d8173519c3b8d22911b6a689df69136cb4a3d17b47" exitCode=0 Jul 07 13:21:38.889655 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:38.889225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" event={"ID":"7efa4a64-63d2-4481-832e-0c3a9d624ab1","Type":"ContainerDied","Data":"a91236eb01a1c480cd7701d8173519c3b8d22911b6a689df69136cb4a3d17b47"} Jul 07 13:21:39.896036 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:39.896005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" event={"ID":"7efa4a64-63d2-4481-832e-0c3a9d624ab1","Type":"ContainerStarted","Data":"138294b6b35ffd3c96161c0da3f7cec99f2b10385f94b7c827bfa4bea0ea0122"} Jul 07 13:21:39.896447 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:39.896075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:39.919057 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:39.919008 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" podStartSLOduration=2.5615567009999998 podStartE2EDuration="6.918994622s" totalImagesPullingTime="3.312067357s" totalInitContainerRuntime="1.045370564s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:39.917557806 +0000 UTC m=+319.113195016" watchObservedRunningTime="2026-07-07 13:21:39.918994622 +0000 UTC m=+319.114631829" Jul 07 13:21:50.902282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:50.902247 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69fbc88fbc-rqjns" Jul 07 13:21:53.566911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.566877 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv"] Jul 07 13:21:53.572310 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.572285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.575538 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.575515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 13:21:53.575681 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.575629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 13:21:53.576585 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.576563 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mff25\"" Jul 07 13:21:53.591473 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.591453 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv"] Jul 07 13:21:53.708749 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.708723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgdfm\" (UniqueName: \"kubernetes.io/projected/5b0daae9-0329-4e0b-a713-73e12266207d-kube-api-access-zgdfm\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.708875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.708784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0daae9-0329-4e0b-a713-73e12266207d-tmp\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.708875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.708808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0daae9-0329-4e0b-a713-73e12266207d-tls-certs\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.762569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.762545 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj7ms"] Jul 07 13:21:53.766289 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.766273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:53.768861 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.768842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2prsl\"" Jul 07 13:21:53.769163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.769148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 13:21:53.776365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.776341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj7ms"] Jul 07 13:21:53.809683 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.809657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0daae9-0329-4e0b-a713-73e12266207d-tmp\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.809790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.809686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0daae9-0329-4e0b-a713-73e12266207d-tls-certs\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.809790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.809719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgdfm\" (UniqueName: \"kubernetes.io/projected/5b0daae9-0329-4e0b-a713-73e12266207d-kube-api-access-zgdfm\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.811782 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.811762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0daae9-0329-4e0b-a713-73e12266207d-tmp\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.811992 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.811973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0daae9-0329-4e0b-a713-73e12266207d-tls-certs\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.818330 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.818286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgdfm\" (UniqueName: \"kubernetes.io/projected/5b0daae9-0329-4e0b-a713-73e12266207d-kube-api-access-zgdfm\") pod \"kube-auth-proxy-577c5f8c7-4jhjv\" (UID: \"5b0daae9-0329-4e0b-a713-73e12266207d\") " pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.882797 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.882776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" Jul 07 13:21:53.910661 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.910635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-cert\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:53.910759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:53.910701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpppl\" (UniqueName: \"kubernetes.io/projected/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-kube-api-access-tpppl\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.011775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.011748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-cert\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.011922 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.011796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpppl\" (UniqueName: \"kubernetes.io/projected/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-kube-api-access-tpppl\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.014049 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.014029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-cert\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.019291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.019270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv"] Jul 07 13:21:54.021838 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.021802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpppl\" (UniqueName: \"kubernetes.io/projected/9ab99f60-1f9c-4df1-9ce8-e38c722f7a69-kube-api-access-tpppl\") pod \"odh-model-controller-7998c67dc4-fj7ms\" (UID: \"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.022449 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:54.022422 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0daae9_0329_4e0b_a713_73e12266207d.slice/crio-8bb1e9dd9d79b209d7ea39a2f4ca6645216b5bfee1ffcd45a01c27cd53a962ee WatchSource:0}: Error finding container 8bb1e9dd9d79b209d7ea39a2f4ca6645216b5bfee1ffcd45a01c27cd53a962ee: Status 404 returned error can't find the container with id 8bb1e9dd9d79b209d7ea39a2f4ca6645216b5bfee1ffcd45a01c27cd53a962ee Jul 07 13:21:54.076570 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.076518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:54.247613 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:54.247578 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab99f60_1f9c_4df1_9ce8_e38c722f7a69.slice/crio-9d756d51c09b5db3c5c8b4ee9f0372d85bc9b01dc875b3102f4d096a85488fc1 WatchSource:0}: Error finding container 9d756d51c09b5db3c5c8b4ee9f0372d85bc9b01dc875b3102f4d096a85488fc1: Status 404 returned error can't find the container with id 9d756d51c09b5db3c5c8b4ee9f0372d85bc9b01dc875b3102f4d096a85488fc1 Jul 07 13:21:54.253796 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.253773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj7ms"] Jul 07 13:21:54.587011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.586978 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndhpb"] Jul 07 13:21:54.592233 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.592211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.594522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.594498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 13:21:54.594629 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.594579 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-65bvd\"" Jul 07 13:21:54.601432 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.601407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndhpb"] Jul 07 13:21:54.717337 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.717303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315c9774-e951-451e-a6fd-e123171f5c18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.717463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.717340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbcb6\" (UniqueName: \"kubernetes.io/projected/315c9774-e951-451e-a6fd-e123171f5c18-kube-api-access-nbcb6\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.805252 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.805222 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:21:54.808840 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.808820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.811531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.811379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 13:21:54.811531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.811383 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 13:21:54.811531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.811418 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 13:21:54.811531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.811407 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 13:21:54.811818 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.811543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-78lwn\"" Jul 07 13:21:54.818334 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.818309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315c9774-e951-451e-a6fd-e123171f5c18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.818444 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.818346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbcb6\" (UniqueName: \"kubernetes.io/projected/315c9774-e951-451e-a6fd-e123171f5c18-kube-api-access-nbcb6\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.821153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.821132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315c9774-e951-451e-a6fd-e123171f5c18-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.823172 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.823140 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:21:54.836013 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.835989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbcb6\" (UniqueName: \"kubernetes.io/projected/315c9774-e951-451e-a6fd-e123171f5c18-kube-api-access-nbcb6\") pod \"model-serving-api-54d89bd5fc-ndhpb\" (UID: \"315c9774-e951-451e-a6fd-e123171f5c18\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.904302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.903866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvnbw\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.919653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.919574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:54.971564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.971527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" event={"ID":"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69","Type":"ContainerStarted","Data":"9d756d51c09b5db3c5c8b4ee9f0372d85bc9b01dc875b3102f4d096a85488fc1"} Jul 07 13:21:54.973112 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:54.973055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" event={"ID":"5b0daae9-0329-4e0b-a713-73e12266207d","Type":"ContainerStarted","Data":"8bb1e9dd9d79b209d7ea39a2f4ca6645216b5bfee1ffcd45a01c27cd53a962ee"} Jul 07 13:21:55.020915 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.020857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvnbw\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.021962 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.021875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.022529 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.022486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.024982 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.024941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.025588 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.025543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.025859 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.025814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.027587 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.027548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.030719 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.030658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.031128 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.031105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvnbw\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw\") pod \"istiod-openshift-gateway-7574459656-bzm2b\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.073341 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.073131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndhpb"] Jul 07 13:21:55.079549 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:55.079518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315c9774_e951_451e_a6fd_e123171f5c18.slice/crio-872386cdea2d9b47385bcac25ac5436c2aa5b891abb5faf9ba4ef1922bb07ca2 WatchSource:0}: Error finding container 872386cdea2d9b47385bcac25ac5436c2aa5b891abb5faf9ba4ef1922bb07ca2: Status 404 returned error can't find the container with id 872386cdea2d9b47385bcac25ac5436c2aa5b891abb5faf9ba4ef1922bb07ca2 Jul 07 13:21:55.151212 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.151106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:21:55.316998 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.316963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:21:55.320853 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:21:55.320824 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9925a3_0bc3_43ff_99c0_7dc6dfc591e7.slice/crio-2fdb04b4adf532f2d50c6bbca77b0ba64059002717b8c0dbb04e5545798f3bcb WatchSource:0}: Error finding container 2fdb04b4adf532f2d50c6bbca77b0ba64059002717b8c0dbb04e5545798f3bcb: Status 404 returned error can't find the container with id 2fdb04b4adf532f2d50c6bbca77b0ba64059002717b8c0dbb04e5545798f3bcb Jul 07 13:21:55.982485 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.982435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" event={"ID":"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7","Type":"ContainerStarted","Data":"2fdb04b4adf532f2d50c6bbca77b0ba64059002717b8c0dbb04e5545798f3bcb"} Jul 07 13:21:55.984534 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:55.984459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" event={"ID":"315c9774-e951-451e-a6fd-e123171f5c18","Type":"ContainerStarted","Data":"872386cdea2d9b47385bcac25ac5436c2aa5b891abb5faf9ba4ef1922bb07ca2"} Jul 07 13:21:59.004940 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.004903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" event={"ID":"315c9774-e951-451e-a6fd-e123171f5c18","Type":"ContainerStarted","Data":"90d0396831d705f0492ec1cda149150ac88de6c9f5dc7f41884b713d2e8114ea"} Jul 07 13:21:59.005462 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.005101 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:21:59.006686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.006659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" event={"ID":"9ab99f60-1f9c-4df1-9ce8-e38c722f7a69","Type":"ContainerStarted","Data":"6a100e6f64c4eb3577ac64e285c0a0b58a36422d709dc6bb149cb870a4121a4e"} Jul 07 13:21:59.006808 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.006789 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:21:59.008331 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.008304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" event={"ID":"5b0daae9-0329-4e0b-a713-73e12266207d","Type":"ContainerStarted","Data":"558d5e61a520f98a04a9a9493b82c018986fe82017ec4297e74e38dfb8e51e0f"} Jul 07 13:21:59.028642 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.028590 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" podStartSLOduration=1.607713336 podStartE2EDuration="5.02857266s" totalImagesPullingTime="3.420859324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:59.025753365 +0000 UTC m=+338.221390574" watchObservedRunningTime="2026-07-07 13:21:59.02857266 +0000 UTC m=+338.224209873" Jul 07 13:21:59.046210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.046150 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-577c5f8c7-4jhjv" podStartSLOduration=1.563650542 podStartE2EDuration="6.04613634s" totalImagesPullingTime="4.482485798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:59.044102191 +0000 UTC m=+338.239739422" watchObservedRunningTime="2026-07-07 13:21:59.04613634 +0000 UTC m=+338.241773548" Jul 07 13:21:59.062749 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.062705 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" podStartSLOduration=1.797566082 podStartE2EDuration="6.062690678s" totalImagesPullingTime="4.265124596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:59.060046938 +0000 UTC m=+338.255684184" watchObservedRunningTime="2026-07-07 13:21:59.062690678 +0000 UTC m=+338.258327886" Jul 07 13:21:59.809163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.809126 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:21:59.809280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:21:59.809218 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:22:00.015022 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:00.014985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" event={"ID":"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7","Type":"ContainerStarted","Data":"7e0064fd8623221aac6b9af69cb915f4aabb7bf90fbc137e4b0666a5ba3f6a5c"} Jul 07 13:22:00.015521 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:00.015498 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:22:00.016665 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:00.016638 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bzm2b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 13:22:00.016796 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:00.016692 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 13:22:00.038305 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:00.038263 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" podStartSLOduration=1.552874366 podStartE2EDuration="6.038250131s" totalImagesPullingTime="4.485375765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:00.035663296 +0000 UTC m=+339.231300521" watchObservedRunningTime="2026-07-07 13:22:00.038250131 +0000 UTC m=+339.233887338" Jul 07 13:22:01.021513 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:01.021488 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:22:04.058539 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.058506 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb"] Jul 07 13:22:04.061897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.061876 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.063514 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.063492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf"] Jul 07 13:22:04.064745 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.064724 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 13:22:04.064852 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.064744 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4l4vs\"" Jul 07 13:22:04.066695 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.066679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.069395 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.069374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kv6nf\"" Jul 07 13:22:04.069395 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.069387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 13:22:04.076108 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.076087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb"] Jul 07 13:22:04.078998 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.078977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf"] Jul 07 13:22:04.106483 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.106458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6010ceb6-2b77-4f88-83e6-3981800e5180-cert\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.106601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.106487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rccc\" (UniqueName: \"kubernetes.io/projected/6010ceb6-2b77-4f88-83e6-3981800e5180-kube-api-access-9rccc\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.106601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.106511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.106601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.106584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb98c\" (UniqueName: \"kubernetes.io/projected/e6492719-eeff-45c6-9fce-0bf21be9c8b9-kube-api-access-xb98c\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.207229 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.207184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6010ceb6-2b77-4f88-83e6-3981800e5180-cert\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.207322 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.207237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rccc\" (UniqueName: \"kubernetes.io/projected/6010ceb6-2b77-4f88-83e6-3981800e5180-kube-api-access-9rccc\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.207436 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.207411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.207490 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.207473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb98c\" (UniqueName: \"kubernetes.io/projected/e6492719-eeff-45c6-9fce-0bf21be9c8b9-kube-api-access-xb98c\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.207584 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:22:04.207569 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 13:22:04.207631 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:22:04.207625 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert podName:e6492719-eeff-45c6-9fce-0bf21be9c8b9 nodeName:}" failed. No retries permitted until 2026-07-07 13:22:04.707608124 +0000 UTC m=+343.903245327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert") pod "llmisvc-controller-manager-777c6bd7d5-2cxgf" (UID: "e6492719-eeff-45c6-9fce-0bf21be9c8b9") : secret "llmisvc-webhook-server-cert" not found Jul 07 13:22:04.209826 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.209809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6010ceb6-2b77-4f88-83e6-3981800e5180-cert\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.220647 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.220624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb98c\" (UniqueName: \"kubernetes.io/projected/e6492719-eeff-45c6-9fce-0bf21be9c8b9-kube-api-access-xb98c\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.221257 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.221237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rccc\" (UniqueName: \"kubernetes.io/projected/6010ceb6-2b77-4f88-83e6-3981800e5180-kube-api-access-9rccc\") pod \"kserve-controller-manager-d6f4b65b8-4hdlb\" (UID: \"6010ceb6-2b77-4f88-83e6-3981800e5180\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.373937 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.373907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:04.515070 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.515046 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb"] Jul 07 13:22:04.516478 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:22:04.516452 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6010ceb6_2b77_4f88_83e6_3981800e5180.slice/crio-1f9a347395ad8919312a82c37c73985bb00575805e1d6973809b23a07f555abf WatchSource:0}: Error finding container 1f9a347395ad8919312a82c37c73985bb00575805e1d6973809b23a07f555abf: Status 404 returned error can't find the container with id 1f9a347395ad8919312a82c37c73985bb00575805e1d6973809b23a07f555abf Jul 07 13:22:04.711020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.710960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.713212 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.713178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6492719-eeff-45c6-9fce-0bf21be9c8b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2cxgf\" (UID: \"e6492719-eeff-45c6-9fce-0bf21be9c8b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:04.981464 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:04.981402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:05.047684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:05.047595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" event={"ID":"6010ceb6-2b77-4f88-83e6-3981800e5180","Type":"ContainerStarted","Data":"1f9a347395ad8919312a82c37c73985bb00575805e1d6973809b23a07f555abf"} Jul 07 13:22:05.126082 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:05.126059 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf"] Jul 07 13:22:05.127741 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:22:05.127713 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6492719_eeff_45c6_9fce_0bf21be9c8b9.slice/crio-5552299f6c0fa993cb0855e46c314687809ca563dd3811d3d98039cb4c0b5b81 WatchSource:0}: Error finding container 5552299f6c0fa993cb0855e46c314687809ca563dd3811d3d98039cb4c0b5b81: Status 404 returned error can't find the container with id 5552299f6c0fa993cb0855e46c314687809ca563dd3811d3d98039cb4c0b5b81 Jul 07 13:22:06.056206 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:06.056150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" event={"ID":"e6492719-eeff-45c6-9fce-0bf21be9c8b9","Type":"ContainerStarted","Data":"5552299f6c0fa993cb0855e46c314687809ca563dd3811d3d98039cb4c0b5b81"} Jul 07 13:22:06.705171 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:06.705133 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:22:06.705739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:06.705357 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" containerID="cri-o://7e0064fd8623221aac6b9af69cb915f4aabb7bf90fbc137e4b0666a5ba3f6a5c" gracePeriod=30 Jul 07 13:22:07.065160 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.065079 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerID="7e0064fd8623221aac6b9af69cb915f4aabb7bf90fbc137e4b0666a5ba3f6a5c" exitCode=0 Jul 07 13:22:07.065341 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.065163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" event={"ID":"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7","Type":"ContainerDied","Data":"7e0064fd8623221aac6b9af69cb915f4aabb7bf90fbc137e4b0666a5ba3f6a5c"} Jul 07 13:22:07.587984 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.587957 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:22:07.633538 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633574 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633639 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633814 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633688 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633814 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633814 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvnbw\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.633974 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.633961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs\") pod \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\" (UID: \"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7\") " Jul 07 13:22:07.634401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.634355 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:22:07.636576 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.636390 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:07.636776 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.636739 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:22:07.636906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.636819 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:22:07.637324 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.637294 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts" (OuterVolumeSpecName: "cacerts") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:22:07.637528 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.637507 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs" (OuterVolumeSpecName: "local-certs") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:07.637766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.637745 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw" (OuterVolumeSpecName: "kube-api-access-jvnbw") pod "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" (UID: "5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7"). InnerVolumeSpecName "kube-api-access-jvnbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:07.735278 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735253 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-ca-configmap\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735278 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735276 2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-cacerts\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735286 2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-kubeconfig\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735295 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvnbw\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-kube-api-access-jvnbw\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735304 2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-local-certs\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735312 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-token\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:07.735597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:07.735320 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7-istio-csr-dns-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:22:08.073840 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:08.073809 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" Jul 07 13:22:08.074022 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:08.073806 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" event={"ID":"5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7","Type":"ContainerDied","Data":"2fdb04b4adf532f2d50c6bbca77b0ba64059002717b8c0dbb04e5545798f3bcb"} Jul 07 13:22:08.074022 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:08.073952 2577 scope.go:117] "RemoveContainer" containerID="7e0064fd8623221aac6b9af69cb915f4aabb7bf90fbc137e4b0666a5ba3f6a5c" Jul 07 13:22:08.106092 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:08.106065 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:22:08.112323 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:08.112294 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b"] Jul 07 13:22:09.081676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.081640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" event={"ID":"6010ceb6-2b77-4f88-83e6-3981800e5180","Type":"ContainerStarted","Data":"e47f38ab4a42c6d3cbefaf9e7c98efec93b90673fa0746733150f9f0eec0667c"} Jul 07 13:22:09.082130 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.081787 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:09.083243 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.083217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" event={"ID":"e6492719-eeff-45c6-9fce-0bf21be9c8b9","Type":"ContainerStarted","Data":"1e1640031e66c94cfdcd65780f199c505a86a570b9a2d641780745a7b3005e8f"} Jul 07 13:22:09.083361 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.083335 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:09.101787 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.101743 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" podStartSLOduration=1.143939204 podStartE2EDuration="5.10173011s" totalImagesPullingTime="3.957790906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:09.099700069 +0000 UTC m=+348.295337277" watchObservedRunningTime="2026-07-07 13:22:09.10173011 +0000 UTC m=+348.297367316" Jul 07 13:22:09.118646 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.118605 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" podStartSLOduration=1.746689753 podStartE2EDuration="5.118591049s" totalImagesPullingTime="3.371901296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:09.117522761 +0000 UTC m=+348.313159989" watchObservedRunningTime="2026-07-07 13:22:09.118591049 +0000 UTC m=+348.314228257" Jul 07 13:22:09.296038 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:09.296009 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" path="/var/lib/kubelet/pods/5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7/volumes" Jul 07 13:22:10.017378 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:10.017343 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fj7ms" Jul 07 13:22:10.019239 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:10.019218 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ndhpb" Jul 07 13:22:12.022841 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:12.022801 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bzm2b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:22:12.023330 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:12.022871 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzm2b" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.38:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 13:22:40.090861 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:40.090822 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2cxgf" Jul 07 13:22:40.093693 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:40.093672 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4hdlb" Jul 07 13:22:54.625268 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.625239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72nfb"] Jul 07 13:22:54.625728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.625590 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" Jul 07 13:22:54.625728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.625610 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" Jul 07 13:22:54.625728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.625673 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9925a3-0bc3-43ff-99c0-7dc6dfc591e7" containerName="discovery" Jul 07 13:22:54.627742 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.627722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:22:54.630734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.630715 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d4952\"" Jul 07 13:22:54.631389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.631369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 13:22:54.631485 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.631387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 13:22:54.643895 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.643857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72nfb"] Jul 07 13:22:54.791839 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.791802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sx8\" (UniqueName: \"kubernetes.io/projected/73ff743e-a27c-40ba-a58b-30e536ea35ca-kube-api-access-65sx8\") pod \"kuadrant-operator-catalog-72nfb\" (UID: \"73ff743e-a27c-40ba-a58b-30e536ea35ca\") " pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:22:54.892563 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.892493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sx8\" (UniqueName: \"kubernetes.io/projected/73ff743e-a27c-40ba-a58b-30e536ea35ca-kube-api-access-65sx8\") pod \"kuadrant-operator-catalog-72nfb\" (UID: \"73ff743e-a27c-40ba-a58b-30e536ea35ca\") " pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:22:54.901050 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.901019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sx8\" (UniqueName: \"kubernetes.io/projected/73ff743e-a27c-40ba-a58b-30e536ea35ca-kube-api-access-65sx8\") pod \"kuadrant-operator-catalog-72nfb\" (UID: \"73ff743e-a27c-40ba-a58b-30e536ea35ca\") " pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:22:54.938530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:54.938506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:22:55.065224 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:55.065181 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72nfb"] Jul 07 13:22:55.067948 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:22:55.067919 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ff743e_a27c_40ba_a58b_30e536ea35ca.slice/crio-f33a42f85e55e2e1b06ce73aae5515f24a8c687dab8264c99681ce56234c2010 WatchSource:0}: Error finding container f33a42f85e55e2e1b06ce73aae5515f24a8c687dab8264c99681ce56234c2010: Status 404 returned error can't find the container with id f33a42f85e55e2e1b06ce73aae5515f24a8c687dab8264c99681ce56234c2010 Jul 07 13:22:55.331722 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:55.331652 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" event={"ID":"73ff743e-a27c-40ba-a58b-30e536ea35ca","Type":"ContainerStarted","Data":"f33a42f85e55e2e1b06ce73aae5515f24a8c687dab8264c99681ce56234c2010"} Jul 07 13:22:57.349056 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:57.349023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" event={"ID":"73ff743e-a27c-40ba-a58b-30e536ea35ca","Type":"ContainerStarted","Data":"340955d731d46b43b336dd77d0becaaaed1baf7e036cb500493b371c76c2e3e8"} Jul 07 13:22:57.364070 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:22:57.364025 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" podStartSLOduration=1.263892772 podStartE2EDuration="3.364011638s" totalImagesPullingTime="2.100118866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:57.362943041 +0000 UTC m=+396.558580250" watchObservedRunningTime="2026-07-07 13:22:57.364011638 +0000 UTC m=+396.559648845" Jul 07 13:23:04.939313 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:04.939282 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:23:04.939732 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:04.939329 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:23:04.961732 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:04.961710 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:23:05.415388 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:05.415366 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-72nfb" Jul 07 13:23:08.430721 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.430682 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j"] Jul 07 13:23:08.434838 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.434820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.437245 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.437221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ms98c\"" Jul 07 13:23:08.443118 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.443093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j"] Jul 07 13:23:08.602634 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.602608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.602739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.602649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqx8v\" (UniqueName: \"kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.602739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.602689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.703423 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.703365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.703526 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.703425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.703526 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.703451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqx8v\" (UniqueName: \"kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.703775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.703752 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.703843 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.703780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.711364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.711341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqx8v\" (UniqueName: \"kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.745128 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.745108 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:08.879338 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:08.879310 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j"] Jul 07 13:23:08.882236 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:08.882187 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d02c094_c344_47cd_8564_ea4040006009.slice/crio-dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc WatchSource:0}: Error finding container dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc: Status 404 returned error can't find the container with id dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc Jul 07 13:23:09.033037 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.033012 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42"] Jul 07 13:23:09.036615 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.036600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.044631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.044610 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42"] Jul 07 13:23:09.207792 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.207770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.207914 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.207809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbgt\" (UniqueName: \"kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.207914 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.207891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.308522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.308468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.308619 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.308530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.308670 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.308636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbgt\" (UniqueName: \"kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.308870 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.308851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.308911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.308878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.316567 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.316543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbgt\" (UniqueName: \"kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.345492 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.345473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:09.415694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.415667 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d02c094-c344-47cd-8564-ea4040006009" containerID="582b6072022bd3765947c5a9e89a5bb9828ed523ca373cb2589b7c3daeb8fe64" exitCode=0 Jul 07 13:23:09.415820 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.415709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" event={"ID":"9d02c094-c344-47cd-8564-ea4040006009","Type":"ContainerDied","Data":"582b6072022bd3765947c5a9e89a5bb9828ed523ca373cb2589b7c3daeb8fe64"} Jul 07 13:23:09.415820 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.415741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" event={"ID":"9d02c094-c344-47cd-8564-ea4040006009","Type":"ContainerStarted","Data":"dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc"} Jul 07 13:23:09.476963 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.476935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42"] Jul 07 13:23:09.480064 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:09.480042 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbab0f1e_dda5_4a88_9ad5_1f1c73cc70ab.slice/crio-388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b WatchSource:0}: Error finding container 388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b: Status 404 returned error can't find the container with id 388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b Jul 07 13:23:09.627946 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.627921 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr"] Jul 07 13:23:09.631568 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.631550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.639353 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.639330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr"] Jul 07 13:23:09.813840 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.813812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.813925 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.813888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.813925 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.813913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4zg\" (UniqueName: \"kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.914270 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.914245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.914395 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.914332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.914395 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.914359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4zg\" (UniqueName: \"kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.914705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.914683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.914773 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.914685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.922381 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.922359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4zg\" (UniqueName: \"kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:09.940812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:09.940788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:10.070480 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.070430 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr"] Jul 07 13:23:10.112275 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:10.112245 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8368c41d_1c33_488f_af32_2d2006fb4cc1.slice/crio-f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3 WatchSource:0}: Error finding container f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3: Status 404 returned error can't find the container with id f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3 Jul 07 13:23:10.228868 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.228841 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54"] Jul 07 13:23:10.232280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.232260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.240851 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.240831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54"] Jul 07 13:23:10.418357 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.418298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.418657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.418582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.418741 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.418709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzwm\" (UniqueName: \"kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.423597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.423572 2577 generic.go:356] "Generic (PLEG): container finished" podID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerID="eab8aaf3ca864208efb5cd0be8a3a453118746ae3e67c4f25d32f3dd8175eb89" exitCode=0 Jul 07 13:23:10.423684 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.423650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" event={"ID":"8368c41d-1c33-488f-af32-2d2006fb4cc1","Type":"ContainerDied","Data":"eab8aaf3ca864208efb5cd0be8a3a453118746ae3e67c4f25d32f3dd8175eb89"} Jul 07 13:23:10.423734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.423691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" event={"ID":"8368c41d-1c33-488f-af32-2d2006fb4cc1","Type":"ContainerStarted","Data":"f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3"} Jul 07 13:23:10.425149 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.425131 2577 generic.go:356] "Generic (PLEG): container finished" podID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerID="6506b2b8239165ff53152aecaa9ce6573bd6186d2bd6a0e7f4d82aa6e3fece11" exitCode=0 Jul 07 13:23:10.425256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.425174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" event={"ID":"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab","Type":"ContainerDied","Data":"6506b2b8239165ff53152aecaa9ce6573bd6186d2bd6a0e7f4d82aa6e3fece11"} Jul 07 13:23:10.425326 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.425265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" event={"ID":"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab","Type":"ContainerStarted","Data":"388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b"} Jul 07 13:23:10.433912 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.433878 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d02c094-c344-47cd-8564-ea4040006009" containerID="969c3830143d597cc95cee5540730037aa2eba96c18873c137afe87e5b6979e4" exitCode=0 Jul 07 13:23:10.434002 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.433915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" event={"ID":"9d02c094-c344-47cd-8564-ea4040006009","Type":"ContainerDied","Data":"969c3830143d597cc95cee5540730037aa2eba96c18873c137afe87e5b6979e4"} Jul 07 13:23:10.519534 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.519414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.519915 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.519648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwm\" (UniqueName: \"kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.519915 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.519726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.519915 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.519818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.520056 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.520035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.528255 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.528236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzwm\" (UniqueName: \"kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.624155 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.624134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:10.757023 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:10.756998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54"] Jul 07 13:23:10.758706 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:10.758678 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb6ddfd_e5eb_4f5a_a07c_9e969f96b3ca.slice/crio-5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283 WatchSource:0}: Error finding container 5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283: Status 404 returned error can't find the container with id 5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283 Jul 07 13:23:11.441310 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.441233 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d02c094-c344-47cd-8564-ea4040006009" containerID="6306ae2c0559604c4bd38a4ad6c0b6be33e11225c5b5990dfd2d29acdd69a72c" exitCode=0 Jul 07 13:23:11.441455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.441312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" event={"ID":"9d02c094-c344-47cd-8564-ea4040006009","Type":"ContainerDied","Data":"6306ae2c0559604c4bd38a4ad6c0b6be33e11225c5b5990dfd2d29acdd69a72c"} Jul 07 13:23:11.442836 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.442810 2577 generic.go:356] "Generic (PLEG): container finished" podID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerID="3e5421d99e4f69b34d07393fc96eb7d25d0eb39e5f21834efd8c878cd51d9ec2" exitCode=0 Jul 07 13:23:11.442951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.442882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" event={"ID":"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca","Type":"ContainerDied","Data":"3e5421d99e4f69b34d07393fc96eb7d25d0eb39e5f21834efd8c878cd51d9ec2"} Jul 07 13:23:11.442951 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.442931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" event={"ID":"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca","Type":"ContainerStarted","Data":"5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283"} Jul 07 13:23:11.445100 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.445073 2577 generic.go:356] "Generic (PLEG): container finished" podID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerID="8dd66c80aae9e48c74903e6f25fb1e42d5844ec1c81776ee4e81d2c48acff6c4" exitCode=0 Jul 07 13:23:11.445263 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:11.445111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" event={"ID":"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab","Type":"ContainerDied","Data":"8dd66c80aae9e48c74903e6f25fb1e42d5844ec1c81776ee4e81d2c48acff6c4"} Jul 07 13:23:12.452549 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.452524 2577 generic.go:356] "Generic (PLEG): container finished" podID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerID="32b8fe25d6595443d4a61a6616a3bdde84eb1ede6967c64e1ef4f4e3548b4e18" exitCode=0 Jul 07 13:23:12.452874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.452604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" event={"ID":"8368c41d-1c33-488f-af32-2d2006fb4cc1","Type":"ContainerDied","Data":"32b8fe25d6595443d4a61a6616a3bdde84eb1ede6967c64e1ef4f4e3548b4e18"} Jul 07 13:23:12.454531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.454511 2577 generic.go:356] "Generic (PLEG): container finished" podID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerID="3dd71baac2cbe880b597f3ee4d3e19b9adc31ffc7cddc71264b8814476905260" exitCode=0 Jul 07 13:23:12.454640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.454603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" event={"ID":"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca","Type":"ContainerDied","Data":"3dd71baac2cbe880b597f3ee4d3e19b9adc31ffc7cddc71264b8814476905260"} Jul 07 13:23:12.456905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.456885 2577 generic.go:356] "Generic (PLEG): container finished" podID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerID="df26d819b7e825116f9161d01cf46358990048f4cd3b6e9829fe9b4f46fa7f08" exitCode=0 Jul 07 13:23:12.456989 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.456964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" event={"ID":"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab","Type":"ContainerDied","Data":"df26d819b7e825116f9161d01cf46358990048f4cd3b6e9829fe9b4f46fa7f08"} Jul 07 13:23:12.591627 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.591601 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:12.737419 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.737394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle\") pod \"9d02c094-c344-47cd-8564-ea4040006009\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " Jul 07 13:23:12.737524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.737426 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util\") pod \"9d02c094-c344-47cd-8564-ea4040006009\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " Jul 07 13:23:12.737524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.737453 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqx8v\" (UniqueName: \"kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v\") pod \"9d02c094-c344-47cd-8564-ea4040006009\" (UID: \"9d02c094-c344-47cd-8564-ea4040006009\") " Jul 07 13:23:12.738024 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.738003 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle" (OuterVolumeSpecName: "bundle") pod "9d02c094-c344-47cd-8564-ea4040006009" (UID: "9d02c094-c344-47cd-8564-ea4040006009"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:12.739554 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.739532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v" (OuterVolumeSpecName: "kube-api-access-sqx8v") pod "9d02c094-c344-47cd-8564-ea4040006009" (UID: "9d02c094-c344-47cd-8564-ea4040006009"). InnerVolumeSpecName "kube-api-access-sqx8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:12.743293 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.743270 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util" (OuterVolumeSpecName: "util") pod "9d02c094-c344-47cd-8564-ea4040006009" (UID: "9d02c094-c344-47cd-8564-ea4040006009"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:12.838463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.838440 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:12.838463 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.838460 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d02c094-c344-47cd-8564-ea4040006009-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:12.838579 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:12.838470 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqx8v\" (UniqueName: \"kubernetes.io/projected/9d02c094-c344-47cd-8564-ea4040006009-kube-api-access-sqx8v\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:13.464891 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.464863 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" Jul 07 13:23:13.465284 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.464864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j" event={"ID":"9d02c094-c344-47cd-8564-ea4040006009","Type":"ContainerDied","Data":"dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc"} Jul 07 13:23:13.465284 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.465000 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc4c5a625c0270c1dc2ee2b1358cbd2d7f32789fb50b22d80ab6ffb5b11473bc" Jul 07 13:23:13.467628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.467602 2577 generic.go:356] "Generic (PLEG): container finished" podID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerID="a5146490e049a6d090420b339262c70d934254ce86716ef759fe20408c2d8eba" exitCode=0 Jul 07 13:23:13.467735 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.467673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" event={"ID":"8368c41d-1c33-488f-af32-2d2006fb4cc1","Type":"ContainerDied","Data":"a5146490e049a6d090420b339262c70d934254ce86716ef759fe20408c2d8eba"} Jul 07 13:23:13.469955 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.469924 2577 generic.go:356] "Generic (PLEG): container finished" podID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerID="d8b647f2007cd5ce265602731031339e46aa3f8afd843fb7aa98c2c04c4b1c8e" exitCode=0 Jul 07 13:23:13.470068 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.470006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" event={"ID":"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca","Type":"ContainerDied","Data":"d8b647f2007cd5ce265602731031339e46aa3f8afd843fb7aa98c2c04c4b1c8e"} Jul 07 13:23:13.604157 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.604137 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:13.746626 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.746602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util\") pod \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " Jul 07 13:23:13.746739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.746662 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle\") pod \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " Jul 07 13:23:13.746739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.746688 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzbgt\" (UniqueName: \"kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt\") pod \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\" (UID: \"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab\") " Jul 07 13:23:13.747157 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.747130 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle" (OuterVolumeSpecName: "bundle") pod "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" (UID: "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:13.748679 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.748652 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt" (OuterVolumeSpecName: "kube-api-access-vzbgt") pod "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" (UID: "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab"). InnerVolumeSpecName "kube-api-access-vzbgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:13.752173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.752140 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util" (OuterVolumeSpecName: "util") pod "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" (UID: "dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:13.847972 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.847945 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:13.847972 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.847969 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzbgt\" (UniqueName: \"kubernetes.io/projected/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-kube-api-access-vzbgt\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:13.848102 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:13.847979 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.478910 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.478882 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" Jul 07 13:23:14.478910 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.478894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42" event={"ID":"dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab","Type":"ContainerDied","Data":"388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b"} Jul 07 13:23:14.479448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.478950 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="388a7f53b661bf770548417f3606475a6524f513173e3ad1d7962b858871889b" Jul 07 13:23:14.634657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.634634 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:14.637404 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.637384 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:14.755228 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755154 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle\") pod \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " Jul 07 13:23:14.755228 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755227 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc4zg\" (UniqueName: \"kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg\") pod \"8368c41d-1c33-488f-af32-2d2006fb4cc1\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " Jul 07 13:23:14.755389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755270 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util\") pod \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " Jul 07 13:23:14.755389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755301 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle\") pod \"8368c41d-1c33-488f-af32-2d2006fb4cc1\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " Jul 07 13:23:14.755389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755318 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hzwm\" (UniqueName: \"kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm\") pod \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\" (UID: \"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca\") " Jul 07 13:23:14.755389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.755358 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util\") pod \"8368c41d-1c33-488f-af32-2d2006fb4cc1\" (UID: \"8368c41d-1c33-488f-af32-2d2006fb4cc1\") " Jul 07 13:23:14.756043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.756013 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle" (OuterVolumeSpecName: "bundle") pod "8368c41d-1c33-488f-af32-2d2006fb4cc1" (UID: "8368c41d-1c33-488f-af32-2d2006fb4cc1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:14.756163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.756082 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle" (OuterVolumeSpecName: "bundle") pod "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" (UID: "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:14.757472 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.757449 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg" (OuterVolumeSpecName: "kube-api-access-kc4zg") pod "8368c41d-1c33-488f-af32-2d2006fb4cc1" (UID: "8368c41d-1c33-488f-af32-2d2006fb4cc1"). InnerVolumeSpecName "kube-api-access-kc4zg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:14.757579 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.757527 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm" (OuterVolumeSpecName: "kube-api-access-4hzwm") pod "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" (UID: "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca"). InnerVolumeSpecName "kube-api-access-4hzwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:14.764409 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.764381 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util" (OuterVolumeSpecName: "util") pod "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" (UID: "1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:14.764601 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.764582 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util" (OuterVolumeSpecName: "util") pod "8368c41d-1c33-488f-af32-2d2006fb4cc1" (UID: "8368c41d-1c33-488f-af32-2d2006fb4cc1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:14.856138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856096 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.856138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856119 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc4zg\" (UniqueName: \"kubernetes.io/projected/8368c41d-1c33-488f-af32-2d2006fb4cc1-kube-api-access-kc4zg\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.856138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856132 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.856138 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856143 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.856445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856152 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hzwm\" (UniqueName: \"kubernetes.io/projected/1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca-kube-api-access-4hzwm\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:14.856445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:14.856160 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8368c41d-1c33-488f-af32-2d2006fb4cc1-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:15.486460 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.486433 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" Jul 07 13:23:15.486828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.486432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr" event={"ID":"8368c41d-1c33-488f-af32-2d2006fb4cc1","Type":"ContainerDied","Data":"f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3"} Jul 07 13:23:15.486828 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.486573 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f833ad7d1d37d5da68891ad5e077d899ea7bff88c133f15c2a43c9ad30a80af3" Jul 07 13:23:15.488632 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.488606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" event={"ID":"1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca","Type":"ContainerDied","Data":"5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283"} Jul 07 13:23:15.488790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.488649 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5eac25363a5d0d513b4f2291af6b639a357834a0329c6e31f272327dfca93283" Jul 07 13:23:15.488790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:15.488653 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54" Jul 07 13:23:24.844010 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.843967 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r"] Jul 07 13:23:24.844586 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844562 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="util" Jul 07 13:23:24.844586 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844588 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="util" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844603 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="util" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844611 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="util" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844623 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="util" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844632 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="util" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844662 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="extract" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844670 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="extract" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844684 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="pull" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844693 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="pull" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844702 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="extract" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844710 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="extract" Jul 07 13:23:24.844718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844722 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844731 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844742 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844749 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844767 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844775 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844789 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="util" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844797 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="util" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844811 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844820 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="pull" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844830 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844839 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844937 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844952 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844963 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d02c094-c344-47cd-8564-ea4040006009" containerName="extract" Jul 07 13:23:24.845266 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.844974 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8368c41d-1c33-488f-af32-2d2006fb4cc1" containerName="extract" Jul 07 13:23:24.849635 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.849612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:24.852090 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.852063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 13:23:24.852222 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.852156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ctdlt\"" Jul 07 13:23:24.857678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.857330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r"] Jul 07 13:23:24.926046 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:24.926021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hkl\" (UniqueName: \"kubernetes.io/projected/1b3de95d-8336-4662-a8f0-05a43774b228-kube-api-access-84hkl\") pod \"dns-operator-controller-manager-864dd78c4c-z4d9r\" (UID: \"1b3de95d-8336-4662-a8f0-05a43774b228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:25.026868 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:25.026827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hkl\" (UniqueName: \"kubernetes.io/projected/1b3de95d-8336-4662-a8f0-05a43774b228-kube-api-access-84hkl\") pod \"dns-operator-controller-manager-864dd78c4c-z4d9r\" (UID: \"1b3de95d-8336-4662-a8f0-05a43774b228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:25.038657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:25.038633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hkl\" (UniqueName: \"kubernetes.io/projected/1b3de95d-8336-4662-a8f0-05a43774b228-kube-api-access-84hkl\") pod \"dns-operator-controller-manager-864dd78c4c-z4d9r\" (UID: \"1b3de95d-8336-4662-a8f0-05a43774b228\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:25.161913 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:25.161844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:25.317831 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:25.317805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r"] Jul 07 13:23:25.319032 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:25.318996 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3de95d_8336_4662_a8f0_05a43774b228.slice/crio-8600417b24a4cdb270fbf7f0029e24c17b102e5079f3d7ae6c7b778992d41f8c WatchSource:0}: Error finding container 8600417b24a4cdb270fbf7f0029e24c17b102e5079f3d7ae6c7b778992d41f8c: Status 404 returned error can't find the container with id 8600417b24a4cdb270fbf7f0029e24c17b102e5079f3d7ae6c7b778992d41f8c Jul 07 13:23:25.542946 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:25.542885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" event={"ID":"1b3de95d-8336-4662-a8f0-05a43774b228","Type":"ContainerStarted","Data":"8600417b24a4cdb270fbf7f0029e24c17b102e5079f3d7ae6c7b778992d41f8c"} Jul 07 13:23:28.562701 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:28.562659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" event={"ID":"1b3de95d-8336-4662-a8f0-05a43774b228","Type":"ContainerStarted","Data":"99bac3bfb7c46fe72131fa4743da5e28bf3959cf46b84cad4dd314a9525570df"} Jul 07 13:23:28.563175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:28.562751 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:28.594704 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:28.594655 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" podStartSLOduration=2.404292564 podStartE2EDuration="4.594638113s" totalImagesPullingTime="2.190345549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:28.594041209 +0000 UTC m=+427.789678444" watchObservedRunningTime="2026-07-07 13:23:28.594638113 +0000 UTC m=+427.790275418" Jul 07 13:23:30.132441 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.132400 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj"] Jul 07 13:23:30.135912 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.135895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.139312 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.139292 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2j7s9\"" Jul 07 13:23:30.152640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.152620 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj"] Jul 07 13:23:30.170082 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.170060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.170167 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.170133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d6c9\" (UniqueName: \"kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.271415 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.271388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d6c9\" (UniqueName: \"kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.271532 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.271442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.271791 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.271773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.284161 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.284137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d6c9\" (UniqueName: \"kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.445578 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.445519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:30.588634 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:30.588609 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj"] Jul 07 13:23:30.590849 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:30.590823 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd2f9cd_3125_4495_a9dc_80ae2551e7d0.slice/crio-cc2088d55dc811b1f75cb8ef9654c755d8d932a63653ed71930c68d451636329 WatchSource:0}: Error finding container cc2088d55dc811b1f75cb8ef9654c755d8d932a63653ed71930c68d451636329: Status 404 returned error can't find the container with id cc2088d55dc811b1f75cb8ef9654c755d8d932a63653ed71930c68d451636329 Jul 07 13:23:31.582700 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:31.582663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" event={"ID":"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0","Type":"ContainerStarted","Data":"cc2088d55dc811b1f75cb8ef9654c755d8d932a63653ed71930c68d451636329"} Jul 07 13:23:33.571282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.571244 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cx24r"] Jul 07 13:23:33.576637 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.576601 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:33.579448 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.579423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mmbmc\"" Jul 07 13:23:33.583694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.583669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cx24r"] Jul 07 13:23:33.596945 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.596916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96lrd\" (UniqueName: \"kubernetes.io/projected/347ec94b-5506-43a4-8aa4-4699a67d3c69-kube-api-access-96lrd\") pod \"authorino-operator-75cc8d5cb7-cx24r\" (UID: \"347ec94b-5506-43a4-8aa4-4699a67d3c69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:33.698302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.698276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96lrd\" (UniqueName: \"kubernetes.io/projected/347ec94b-5506-43a4-8aa4-4699a67d3c69-kube-api-access-96lrd\") pod \"authorino-operator-75cc8d5cb7-cx24r\" (UID: \"347ec94b-5506-43a4-8aa4-4699a67d3c69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:33.708908 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.708873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96lrd\" (UniqueName: \"kubernetes.io/projected/347ec94b-5506-43a4-8aa4-4699a67d3c69-kube-api-access-96lrd\") pod \"authorino-operator-75cc8d5cb7-cx24r\" (UID: \"347ec94b-5506-43a4-8aa4-4699a67d3c69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:33.888820 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:33.888763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:34.043013 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:34.042990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cx24r"] Jul 07 13:23:34.044788 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:34.044759 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347ec94b_5506_43a4_8aa4_4699a67d3c69.slice/crio-2e1c9c9077bfc8608f408ba64a3b1299c3786a85e72a8f8f6d4a84d44da695c6 WatchSource:0}: Error finding container 2e1c9c9077bfc8608f408ba64a3b1299c3786a85e72a8f8f6d4a84d44da695c6: Status 404 returned error can't find the container with id 2e1c9c9077bfc8608f408ba64a3b1299c3786a85e72a8f8f6d4a84d44da695c6 Jul 07 13:23:34.604397 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:34.604358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" event={"ID":"347ec94b-5506-43a4-8aa4-4699a67d3c69","Type":"ContainerStarted","Data":"2e1c9c9077bfc8608f408ba64a3b1299c3786a85e72a8f8f6d4a84d44da695c6"} Jul 07 13:23:36.446312 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.446256 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk"] Jul 07 13:23:36.455045 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.455019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:36.457847 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.457823 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6grr6\"" Jul 07 13:23:36.462543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.462518 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk"] Jul 07 13:23:36.527048 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.527010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tztpv\" (UniqueName: \"kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv\") pod \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" (UID: \"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:36.628257 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.628228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tztpv\" (UniqueName: \"kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv\") pod \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" (UID: \"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:36.640629 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.640601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tztpv\" (UniqueName: \"kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv\") pod \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" (UID: \"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:36.770372 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:36.770288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:37.403992 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.403971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk"] Jul 07 13:23:37.404995 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:37.404971 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aee66cb_244b_4a4f_a911_ae59ef9fa9dd.slice/crio-0e75d44d3056e69f32a31fa702bd2dc5e215fb9fba416ff7c01d0f8ad230dd55 WatchSource:0}: Error finding container 0e75d44d3056e69f32a31fa702bd2dc5e215fb9fba416ff7c01d0f8ad230dd55: Status 404 returned error can't find the container with id 0e75d44d3056e69f32a31fa702bd2dc5e215fb9fba416ff7c01d0f8ad230dd55 Jul 07 13:23:37.623887 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.623845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" event={"ID":"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0","Type":"ContainerStarted","Data":"64bcc23aaa814f5ab8c69e6189be9c30313af460ec7a2351128bf06300fee1d9"} Jul 07 13:23:37.624304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.623922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:37.625065 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.625046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" event={"ID":"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd","Type":"ContainerStarted","Data":"0e75d44d3056e69f32a31fa702bd2dc5e215fb9fba416ff7c01d0f8ad230dd55"} Jul 07 13:23:37.626555 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.626533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" event={"ID":"347ec94b-5506-43a4-8aa4-4699a67d3c69","Type":"ContainerStarted","Data":"dd85333480b012358d76a58b8e94e4a4cbc4d38e21414fad821d16861aa95f00"} Jul 07 13:23:37.626630 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.626608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:37.642929 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.642866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" podStartSLOduration=0.955439407 podStartE2EDuration="7.642846964s" totalImagesPullingTime="6.687407557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:37.63968368 +0000 UTC m=+436.835320909" watchObservedRunningTime="2026-07-07 13:23:37.642846964 +0000 UTC m=+436.838484173" Jul 07 13:23:37.660524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:37.660479 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" podStartSLOduration=1.420271884 podStartE2EDuration="4.660467674s" totalImagesPullingTime="3.24019579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:37.659523318 +0000 UTC m=+436.855160526" watchObservedRunningTime="2026-07-07 13:23:37.660467674 +0000 UTC m=+436.856104881" Jul 07 13:23:39.571286 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:39.571262 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4d9r" Jul 07 13:23:39.641432 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:39.641388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" event={"ID":"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd","Type":"ContainerStarted","Data":"2eb9226745cdc2b7a9edc6866075cad4057cdeb7655bb225ced1f1f3922355ea"} Jul 07 13:23:39.641698 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:39.641534 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:39.658779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:39.658736 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" podStartSLOduration=1.584683671 podStartE2EDuration="3.65872099s" totalImagesPullingTime="2.074037319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:39.656654384 +0000 UTC m=+438.852291610" watchObservedRunningTime="2026-07-07 13:23:39.65872099 +0000 UTC m=+438.854358199" Jul 07 13:23:48.634389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:48.634305 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:48.634389 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:48.634386 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cx24r" Jul 07 13:23:50.040959 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.040921 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5"] Jul 07 13:23:50.044710 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.044686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.056975 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.056954 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5"] Jul 07 13:23:50.135916 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.135892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.136033 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.135936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p42gt\" (UniqueName: \"kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.236540 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.236511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.236652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.236565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p42gt\" (UniqueName: \"kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.236873 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.236851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.244329 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.244304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p42gt\" (UniqueName: \"kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt\") pod \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.354418 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.354397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.496847 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.496825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5"] Jul 07 13:23:50.499053 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:50.499026 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18cd08e_4ace_47e6_abcf_92db54484780.slice/crio-1b6827bd08c642472815f30cecfef01a72df4ad814e1093042660c40b292f556 WatchSource:0}: Error finding container 1b6827bd08c642472815f30cecfef01a72df4ad814e1093042660c40b292f556: Status 404 returned error can't find the container with id 1b6827bd08c642472815f30cecfef01a72df4ad814e1093042660c40b292f556 Jul 07 13:23:50.516386 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.516364 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5"] Jul 07 13:23:50.519871 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.519849 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5"] Jul 07 13:23:50.539719 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.539695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:23:50.544112 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.544098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.555799 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.555777 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj"] Jul 07 13:23:50.555975 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.555953 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" containerName="manager" containerID="cri-o://64bcc23aaa814f5ab8c69e6189be9c30313af460ec7a2351128bf06300fee1d9" gracePeriod=2 Jul 07 13:23:50.560005 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.558957 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:23:50.562258 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.562234 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj"] Jul 07 13:23:50.572488 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.572450 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.578397 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.578374 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk"] Jul 07 13:23:50.578570 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.578546 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" containerName="manager" containerID="cri-o://2eb9226745cdc2b7a9edc6866075cad4057cdeb7655bb225ced1f1f3922355ea" gracePeriod=2 Jul 07 13:23:50.580623 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.580601 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.580806 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.580777 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.583631 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.583606 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:23:50.584153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.584134 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" containerName="manager" Jul 07 13:23:50.584153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.584155 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" containerName="manager" Jul 07 13:23:50.584377 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.584358 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" containerName="manager" Jul 07 13:23:50.587921 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.587896 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.588317 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.588267 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk"] Jul 07 13:23:50.588398 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.588371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.589815 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.589790 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.591602 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.591580 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.598368 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.598347 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:23:50.621075 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.621043 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.640227 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.640200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr54m\" (UniqueName: \"kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.640331 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.640254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.640394 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.640360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.640439 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.640411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkkmw\" (UniqueName: \"kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.707724 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.707694 2577 generic.go:356] "Generic (PLEG): container finished" podID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" containerID="2eb9226745cdc2b7a9edc6866075cad4057cdeb7655bb225ced1f1f3922355ea" exitCode=0 Jul 07 13:23:50.709730 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.709707 2577 generic.go:356] "Generic (PLEG): container finished" podID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" containerID="64bcc23aaa814f5ab8c69e6189be9c30313af460ec7a2351128bf06300fee1d9" exitCode=0 Jul 07 13:23:50.711768 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.711736 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" containerName="manager" containerID="cri-o://ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf" gracePeriod=2 Jul 07 13:23:50.714201 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.714152 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.715976 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.715953 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.717792 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.717770 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.740998 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.740930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkkmw\" (UniqueName: \"kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.741235 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.741185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr54m\" (UniqueName: \"kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.741303 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.741291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.741638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.741624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.741936 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.741921 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.741974 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.741949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.748694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.748668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr54m\" (UniqueName: \"kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jj8mk\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:50.748801 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.748776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkkmw\" (UniqueName: \"kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw\") pod \"kuadrant-operator-controller-manager-55467d9f7-2ckj4\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.825465 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.825445 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.827397 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.827376 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.827703 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.827680 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.829498 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.829473 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.831427 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.831399 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.833262 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.833238 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.835360 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.835333 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.837230 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.837202 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.871680 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.871620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:50.944524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.944493 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume\") pod \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " Jul 07 13:23:50.944643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.944597 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tztpv\" (UniqueName: \"kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv\") pod \"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd\" (UID: \"0aee66cb-244b-4a4f-a911-ae59ef9fa9dd\") " Jul 07 13:23:50.944643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.944630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d6c9\" (UniqueName: \"kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9\") pod \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\" (UID: \"cbd2f9cd-3125-4495-a9dc-80ae2551e7d0\") " Jul 07 13:23:50.945328 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.945061 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" (UID: "cbd2f9cd-3125-4495-a9dc-80ae2551e7d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:50.946769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.946735 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv" (OuterVolumeSpecName: "kube-api-access-tztpv") pod "0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" (UID: "0aee66cb-244b-4a4f-a911-ae59ef9fa9dd"). InnerVolumeSpecName "kube-api-access-tztpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:50.946910 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.946883 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9" (OuterVolumeSpecName: "kube-api-access-2d6c9") pod "cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" (UID: "cbd2f9cd-3125-4495-a9dc-80ae2551e7d0"). InnerVolumeSpecName "kube-api-access-2d6c9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:50.954373 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.954353 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.956671 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.956649 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:50.958601 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.958575 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:50.960421 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:50.960403 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:50.966493 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:50.966474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:51.020522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.020476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:23:51.022694 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:51.022666 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09502ef6_0ff2_403b_b185_a2cf1e108d4e.slice/crio-91dcbb6e5f3e7a36b6aa130a7f99e5affe2a216063c581877c63f470791b4e3e WatchSource:0}: Error finding container 91dcbb6e5f3e7a36b6aa130a7f99e5affe2a216063c581877c63f470791b4e3e: Status 404 returned error can't find the container with id 91dcbb6e5f3e7a36b6aa130a7f99e5affe2a216063c581877c63f470791b4e3e Jul 07 13:23:51.046075 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046047 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume\") pod \"e18cd08e-4ace-47e6-abcf-92db54484780\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " Jul 07 13:23:51.046451 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046123 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p42gt\" (UniqueName: \"kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt\") pod \"e18cd08e-4ace-47e6-abcf-92db54484780\" (UID: \"e18cd08e-4ace-47e6-abcf-92db54484780\") " Jul 07 13:23:51.046451 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046288 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e18cd08e-4ace-47e6-abcf-92db54484780" (UID: "e18cd08e-4ace-47e6-abcf-92db54484780"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:51.046451 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046430 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-extensions-socket-volume\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:51.046569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046452 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tztpv\" (UniqueName: \"kubernetes.io/projected/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd-kube-api-access-tztpv\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:51.046569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046467 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d6c9\" (UniqueName: \"kubernetes.io/projected/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0-kube-api-access-2d6c9\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:51.046569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.046480 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18cd08e-4ace-47e6-abcf-92db54484780-extensions-socket-volume\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:51.048125 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.048102 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt" (OuterVolumeSpecName: "kube-api-access-p42gt") pod "e18cd08e-4ace-47e6-abcf-92db54484780" (UID: "e18cd08e-4ace-47e6-abcf-92db54484780"). InnerVolumeSpecName "kube-api-access-p42gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:51.111862 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.111842 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:23:51.113796 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:23:51.113775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f075cf1_c2f5_4dcf_86c5_76b9de62d1c8.slice/crio-1185da4db4ec7509aded51f88f16f35643046db1bd9c86f316cdef96ad3a497d WatchSource:0}: Error finding container 1185da4db4ec7509aded51f88f16f35643046db1bd9c86f316cdef96ad3a497d: Status 404 returned error can't find the container with id 1185da4db4ec7509aded51f88f16f35643046db1bd9c86f316cdef96ad3a497d Jul 07 13:23:51.147752 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.147723 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p42gt\" (UniqueName: \"kubernetes.io/projected/e18cd08e-4ace-47e6-abcf-92db54484780-kube-api-access-p42gt\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:23:51.297427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.297401 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" path="/var/lib/kubelet/pods/0aee66cb-244b-4a4f-a911-ae59ef9fa9dd/volumes" Jul 07 13:23:51.297814 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.297799 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" path="/var/lib/kubelet/pods/cbd2f9cd-3125-4495-a9dc-80ae2551e7d0/volumes" Jul 07 13:23:51.298140 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.298127 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" path="/var/lib/kubelet/pods/e18cd08e-4ace-47e6-abcf-92db54484780/volumes" Jul 07 13:23:51.300045 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:51.300018 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n9jxk\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:51.302661 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:51.302636 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8m7cj\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="cbd2f9cd-3125-4495-a9dc-80ae2551e7d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:51.304543 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:51.304522 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:51.719216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.719164 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8m7cj" Jul 07 13:23:51.719216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.719165 2577 scope.go:117] "RemoveContainer" containerID="64bcc23aaa814f5ab8c69e6189be9c30313af460ec7a2351128bf06300fee1d9" Jul 07 13:23:51.720742 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.720669 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18cd08e-4ace-47e6-abcf-92db54484780" containerID="ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf" exitCode=2 Jul 07 13:23:51.720742 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.720713 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:51.722356 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.722339 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9jxk" Jul 07 13:23:51.724326 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.724301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" event={"ID":"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8","Type":"ContainerStarted","Data":"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836"} Jul 07 13:23:51.724460 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.724353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" event={"ID":"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8","Type":"ContainerStarted","Data":"1185da4db4ec7509aded51f88f16f35643046db1bd9c86f316cdef96ad3a497d"} Jul 07 13:23:51.724460 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.724400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:23:51.726478 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.726454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" event={"ID":"09502ef6-0ff2-403b-b185-a2cf1e108d4e","Type":"ContainerStarted","Data":"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b"} Jul 07 13:23:51.726594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.726498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" event={"ID":"09502ef6-0ff2-403b-b185-a2cf1e108d4e","Type":"ContainerStarted","Data":"91dcbb6e5f3e7a36b6aa130a7f99e5affe2a216063c581877c63f470791b4e3e"} Jul 07 13:23:51.726594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.726573 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:23:51.730837 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.730815 2577 scope.go:117] "RemoveContainer" containerID="ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf" Jul 07 13:23:51.740612 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.740595 2577 scope.go:117] "RemoveContainer" containerID="ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf" Jul 07 13:23:51.740866 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:51.740849 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf\": container with ID starting with ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf not found: ID does not exist" containerID="ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf" Jul 07 13:23:51.740911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.740874 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf"} err="failed to get container status \"ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf\": rpc error: code = NotFound desc = could not find container \"ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf\": container with ID starting with ba0c3e9a3d4b3746d8fa05e9d560a56875453543a207c9340dd366cff26fcdcf not found: ID does not exist" Jul 07 13:23:51.740911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.740890 2577 scope.go:117] "RemoveContainer" containerID="2eb9226745cdc2b7a9edc6866075cad4057cdeb7655bb225ced1f1f3922355ea" Jul 07 13:23:51.748333 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.748291 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" podStartSLOduration=1.74827884 podStartE2EDuration="1.74827884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:51.747207577 +0000 UTC m=+450.942844803" watchObservedRunningTime="2026-07-07 13:23:51.74827884 +0000 UTC m=+450.943916048" Jul 07 13:23:51.749235 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:23:51.749207 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fn6v5\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fn6v5" Jul 07 13:23:51.768906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:23:51.768867 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" podStartSLOduration=1.768855834 podStartE2EDuration="1.768855834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:51.766530174 +0000 UTC m=+450.962167399" watchObservedRunningTime="2026-07-07 13:23:51.768855834 +0000 UTC m=+450.964493041" Jul 07 13:24:02.737599 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:02.737551 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:24:02.737971 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:02.737669 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:24:02.819379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:02.819345 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:24:02.819612 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:02.819586 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" podUID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" containerName="manager" containerID="cri-o://3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836" gracePeriod=10 Jul 07 13:24:03.032139 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032068 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:24:03.032474 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032461 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" containerName="manager" Jul 07 13:24:03.032515 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032475 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" containerName="manager" Jul 07 13:24:03.032515 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032496 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" containerName="manager" Jul 07 13:24:03.032515 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032502 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" containerName="manager" Jul 07 13:24:03.032605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032556 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aee66cb-244b-4a4f-a911-ae59ef9fa9dd" containerName="manager" Jul 07 13:24:03.032605 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.032568 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18cd08e-4ace-47e6-abcf-92db54484780" containerName="manager" Jul 07 13:24:03.036162 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.036138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.048269 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.048246 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:24:03.068998 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.068976 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:24:03.150257 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.150233 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr54m\" (UniqueName: \"kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m\") pod \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " Jul 07 13:24:03.150384 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.150268 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume\") pod \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\" (UID: \"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8\") " Jul 07 13:24:03.150443 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.150398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.150581 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.150556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v45m4\" (UniqueName: \"kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.150709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.150686 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" (UID: "6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:24:03.152174 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.152151 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m" (OuterVolumeSpecName: "kube-api-access-mr54m") pod "6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" (UID: "6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8"). InnerVolumeSpecName "kube-api-access-mr54m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:24:03.251260 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.251236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45m4\" (UniqueName: \"kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.251365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.251271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.251365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.251318 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr54m\" (UniqueName: \"kubernetes.io/projected/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-kube-api-access-mr54m\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:03.251365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.251328 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8-extensions-socket-volume\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:03.251599 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.251581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.261130 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.261107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45m4\" (UniqueName: \"kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4\") pod \"kuadrant-operator-controller-manager-86878c769f-pqzt6\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.365789 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.365771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.507975 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.507951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:24:03.509813 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:03.509782 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08bc5f4_19bf_4c6d_8b35_77414aa52aff.slice/crio-75132981d306f7a3f51a71be88038e04c882c1a7de25eac242a54d541158dd3c WatchSource:0}: Error finding container 75132981d306f7a3f51a71be88038e04c882c1a7de25eac242a54d541158dd3c: Status 404 returned error can't find the container with id 75132981d306f7a3f51a71be88038e04c882c1a7de25eac242a54d541158dd3c Jul 07 13:24:03.806474 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.806441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" event={"ID":"e08bc5f4-19bf-4c6d-8b35-77414aa52aff","Type":"ContainerStarted","Data":"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c"} Jul 07 13:24:03.806841 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.806493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" event={"ID":"e08bc5f4-19bf-4c6d-8b35-77414aa52aff","Type":"ContainerStarted","Data":"75132981d306f7a3f51a71be88038e04c882c1a7de25eac242a54d541158dd3c"} Jul 07 13:24:03.806841 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.806535 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:03.807985 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.807960 2577 generic.go:356] "Generic (PLEG): container finished" podID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" containerID="3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836" exitCode=0 Jul 07 13:24:03.808104 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.807991 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" Jul 07 13:24:03.808104 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.808038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" event={"ID":"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8","Type":"ContainerDied","Data":"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836"} Jul 07 13:24:03.808104 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.808081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk" event={"ID":"6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8","Type":"ContainerDied","Data":"1185da4db4ec7509aded51f88f16f35643046db1bd9c86f316cdef96ad3a497d"} Jul 07 13:24:03.808242 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.808108 2577 scope.go:117] "RemoveContainer" containerID="3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836" Jul 07 13:24:03.817281 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.817262 2577 scope.go:117] "RemoveContainer" containerID="3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836" Jul 07 13:24:03.817542 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:24:03.817524 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836\": container with ID starting with 3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836 not found: ID does not exist" containerID="3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836" Jul 07 13:24:03.817614 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.817550 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836"} err="failed to get container status \"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836\": rpc error: code = NotFound desc = could not find container \"3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836\": container with ID starting with 3579e38f5ed32945fb7c825802a52083003051a495a1a7a3974e7847c566e836 not found: ID does not exist" Jul 07 13:24:03.825574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.825531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" podStartSLOduration=0.825518156 podStartE2EDuration="825.518156ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:03.82457517 +0000 UTC m=+463.020212378" watchObservedRunningTime="2026-07-07 13:24:03.825518156 +0000 UTC m=+463.021155364" Jul 07 13:24:03.839567 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.839536 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:24:03.843567 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:03.843540 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jj8mk"] Jul 07 13:24:05.296416 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:05.296387 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" path="/var/lib/kubelet/pods/6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8/volumes" Jul 07 13:24:14.818255 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:14.818221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:24:14.873763 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:14.873731 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:24:14.874007 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:14.873961 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" podUID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" containerName="manager" containerID="cri-o://1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b" gracePeriod=10 Jul 07 13:24:15.129273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.129251 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:24:15.243544 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.243517 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkkmw\" (UniqueName: \"kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw\") pod \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " Jul 07 13:24:15.243676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.243599 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume\") pod \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\" (UID: \"09502ef6-0ff2-403b-b185-a2cf1e108d4e\") " Jul 07 13:24:15.243990 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.243961 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "09502ef6-0ff2-403b-b185-a2cf1e108d4e" (UID: "09502ef6-0ff2-403b-b185-a2cf1e108d4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:24:15.245657 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.245636 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw" (OuterVolumeSpecName: "kube-api-access-mkkmw") pod "09502ef6-0ff2-403b-b185-a2cf1e108d4e" (UID: "09502ef6-0ff2-403b-b185-a2cf1e108d4e"). InnerVolumeSpecName "kube-api-access-mkkmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:24:15.345225 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.345180 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09502ef6-0ff2-403b-b185-a2cf1e108d4e-extensions-socket-volume\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:15.345225 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.345224 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkkmw\" (UniqueName: \"kubernetes.io/projected/09502ef6-0ff2-403b-b185-a2cf1e108d4e-kube-api-access-mkkmw\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:15.886707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.886676 2577 generic.go:356] "Generic (PLEG): container finished" podID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" containerID="1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b" exitCode=0 Jul 07 13:24:15.887153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.886720 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" Jul 07 13:24:15.887153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.886771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" event={"ID":"09502ef6-0ff2-403b-b185-a2cf1e108d4e","Type":"ContainerDied","Data":"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b"} Jul 07 13:24:15.887153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.886841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4" event={"ID":"09502ef6-0ff2-403b-b185-a2cf1e108d4e","Type":"ContainerDied","Data":"91dcbb6e5f3e7a36b6aa130a7f99e5affe2a216063c581877c63f470791b4e3e"} Jul 07 13:24:15.887153 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.886874 2577 scope.go:117] "RemoveContainer" containerID="1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b" Jul 07 13:24:15.896281 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.896262 2577 scope.go:117] "RemoveContainer" containerID="1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b" Jul 07 13:24:15.896571 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:24:15.896553 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b\": container with ID starting with 1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b not found: ID does not exist" containerID="1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b" Jul 07 13:24:15.896632 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.896581 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b"} err="failed to get container status \"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b\": rpc error: code = NotFound desc = could not find container \"1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b\": container with ID starting with 1e3e4ab869002cdd33c0c6d38d6f0618dd374c6a784633b32e3994986e94885b not found: ID does not exist" Jul 07 13:24:15.907879 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.907854 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:24:15.913826 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:15.913802 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2ckj4"] Jul 07 13:24:17.296476 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:17.296440 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" path="/var/lib/kubelet/pods/09502ef6-0ff2-403b-b185-a2cf1e108d4e/volumes" Jul 07 13:24:19.255155 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255121 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t"] Jul 07 13:24:19.255553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255501 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" containerName="manager" Jul 07 13:24:19.255553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255513 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" containerName="manager" Jul 07 13:24:19.255553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255530 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" containerName="manager" Jul 07 13:24:19.255553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255535 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" containerName="manager" Jul 07 13:24:19.255692 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255596 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f075cf1-c2f5-4dcf-86c5-76b9de62d1c8" containerName="manager" Jul 07 13:24:19.255692 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.255607 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="09502ef6-0ff2-403b-b185-a2cf1e108d4e" containerName="manager" Jul 07 13:24:19.260011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.259995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.262689 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.262669 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 13:24:19.262833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.262669 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4522k\"" Jul 07 13:24:19.280067 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.280038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t"] Jul 07 13:24:19.374897 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.374868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375050 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.374904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375050 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.374932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375163 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375315 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375315 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv72k\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-kube-api-access-gv72k\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.375315 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.375250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.475894 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.475865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476029 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.475906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476029 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.475943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476029 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.475973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476029 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476285 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv72k\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-kube-api-access-gv72k\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476285 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476560 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476636 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.476803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.476788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.478395 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.478368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.478513 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.478497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.483833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.483806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.484028 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.484009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv72k\" (UniqueName: \"kubernetes.io/projected/32cfb76f-aed7-4447-be4c-a43a9ec7248b-kube-api-access-gv72k\") pod \"maas-default-gateway-openshift-default-56654dcf7-v885t\" (UID: \"32cfb76f-aed7-4447-be4c-a43a9ec7248b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.572603 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.572548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:19.708022 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.707994 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t"] Jul 07 13:24:19.710274 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:19.710246 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cfb76f_aed7_4447_be4c_a43a9ec7248b.slice/crio-e21ba7bcc205058a24d4c6c2180f00ad16495521316c2a242c646b9f65ea205a WatchSource:0}: Error finding container e21ba7bcc205058a24d4c6c2180f00ad16495521316c2a242c646b9f65ea205a: Status 404 returned error can't find the container with id e21ba7bcc205058a24d4c6c2180f00ad16495521316c2a242c646b9f65ea205a Jul 07 13:24:19.911085 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:19.911059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" event={"ID":"32cfb76f-aed7-4447-be4c-a43a9ec7248b","Type":"ContainerStarted","Data":"e21ba7bcc205058a24d4c6c2180f00ad16495521316c2a242c646b9f65ea205a"} Jul 07 13:24:22.189205 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:22.189152 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:24:22.189509 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:22.189276 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:24:22.189509 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:22.189313 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:24:22.931203 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:22.931163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" event={"ID":"32cfb76f-aed7-4447-be4c-a43a9ec7248b","Type":"ContainerStarted","Data":"b6ba4f06ab519cddbc9a3ada76810efe762bae5b088d8416681c67be60720302"} Jul 07 13:24:22.951958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:22.951913 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" podStartSLOduration=1.475448236 podStartE2EDuration="3.95189985s" totalImagesPullingTime="2.476451614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:22.949800087 +0000 UTC m=+482.145437295" watchObservedRunningTime="2026-07-07 13:24:22.95189985 +0000 UTC m=+482.147537058" Jul 07 13:24:23.573019 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:23.572987 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:23.577928 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:23.577901 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:23.937514 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:23.937483 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:23.938417 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:23.938394 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:24:31.233722 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.233688 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5747bd69-rh72z"] Jul 07 13:24:31.237513 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.237491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.247758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.247736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5747bd69-rh72z"] Jul 07 13:24:31.268016 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.267992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-oauth-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-service-ca\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-trusted-ca-bundle\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76fn\" (UniqueName: \"kubernetes.io/projected/c7afa261-c557-48e9-827d-4c38b0fbdba7-kube-api-access-w76fn\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.268357 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.268217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-oauth-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.368941 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.368914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-oauth-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369097 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.368946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369097 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.368965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-service-ca\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369097 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.368982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-trusted-ca-bundle\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369097 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.369005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369097 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.369059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76fn\" (UniqueName: \"kubernetes.io/projected/c7afa261-c557-48e9-827d-4c38b0fbdba7-kube-api-access-w76fn\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369380 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.369137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-oauth-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369819 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.369795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.369929 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.369854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-service-ca\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.370043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.370018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-trusted-ca-bundle\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.370087 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.370043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7afa261-c557-48e9-827d-4c38b0fbdba7-oauth-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.371530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.371507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-serving-cert\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.371638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.371621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7afa261-c557-48e9-827d-4c38b0fbdba7-console-oauth-config\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.378242 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.378184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76fn\" (UniqueName: \"kubernetes.io/projected/c7afa261-c557-48e9-827d-4c38b0fbdba7-kube-api-access-w76fn\") pod \"console-7d5747bd69-rh72z\" (UID: \"c7afa261-c557-48e9-827d-4c38b0fbdba7\") " pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.547569 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.547494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:31.689269 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.689247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5747bd69-rh72z"] Jul 07 13:24:31.690932 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:31.690905 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7afa261_c557_48e9_827d_4c38b0fbdba7.slice/crio-475dbf575e37ba99aa19cacfbfe2c8529a597efdfeaf81e5632cb7e015186862 WatchSource:0}: Error finding container 475dbf575e37ba99aa19cacfbfe2c8529a597efdfeaf81e5632cb7e015186862: Status 404 returned error can't find the container with id 475dbf575e37ba99aa19cacfbfe2c8529a597efdfeaf81e5632cb7e015186862 Jul 07 13:24:31.985143 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.985103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5747bd69-rh72z" event={"ID":"c7afa261-c557-48e9-827d-4c38b0fbdba7","Type":"ContainerStarted","Data":"ea947ed311c4aad0ce42094d2faf370f923d8eb3e79b6fadd03c9d6d4677d2d1"} Jul 07 13:24:31.985353 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:31.985159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5747bd69-rh72z" event={"ID":"c7afa261-c557-48e9-827d-4c38b0fbdba7","Type":"ContainerStarted","Data":"475dbf575e37ba99aa19cacfbfe2c8529a597efdfeaf81e5632cb7e015186862"} Jul 07 13:24:32.001695 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.001656 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d5747bd69-rh72z" podStartSLOduration=1.001642203 podStartE2EDuration="1.001642203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:32.00042716 +0000 UTC m=+491.196064394" watchObservedRunningTime="2026-07-07 13:24:32.001642203 +0000 UTC m=+491.197279411" Jul 07 13:24:32.717628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.717596 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:32.721323 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.721300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.723607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.723583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 13:24:32.723718 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.723631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ms98c\"" Jul 07 13:24:32.730059 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.730008 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:32.780445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.780406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.780611 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.780485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvz4\" (UniqueName: \"kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.815287 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.815249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:32.881879 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.881849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.882011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.881948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvz4\" (UniqueName: \"kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.882573 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.882554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:32.890500 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:32.890473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvz4\" (UniqueName: \"kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4\") pod \"limitador-limitador-64c94fd64f-fqzf2\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:33.032618 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.032541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:33.169041 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.169012 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:33.170861 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:33.170837 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7ee232_aa67_4e3d_b35c_f33ac3a18bd9.slice/crio-6bb09c8138ba352160a1be14701f1c5c41e5dafc764959874a5cd3752b60f611 WatchSource:0}: Error finding container 6bb09c8138ba352160a1be14701f1c5c41e5dafc764959874a5cd3752b60f611: Status 404 returned error can't find the container with id 6bb09c8138ba352160a1be14701f1c5c41e5dafc764959874a5cd3752b60f611 Jul 07 13:24:33.501232 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.501158 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:33.506220 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.506181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:33.508533 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.508508 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dsq5l\"" Jul 07 13:24:33.514151 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.514125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:33.588874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.588847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lw4\" (UniqueName: \"kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4\") pod \"authorino-58cd955675-sdz95\" (UID: \"102cad9d-163b-41e4-8607-cf3049c3d649\") " pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:33.631299 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.631276 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:24:33.634851 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.634836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:24:33.638772 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.638749 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:24:33.689818 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.689782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z75s\" (UniqueName: \"kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s\") pod \"authorino-75d556bd77-xb4v8\" (UID: \"96166bae-f044-4ca4-a498-3f07fb300421\") " pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:24:33.689949 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.689858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lw4\" (UniqueName: \"kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4\") pod \"authorino-58cd955675-sdz95\" (UID: \"102cad9d-163b-41e4-8607-cf3049c3d649\") " pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:33.698558 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.698528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lw4\" (UniqueName: \"kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4\") pod \"authorino-58cd955675-sdz95\" (UID: \"102cad9d-163b-41e4-8607-cf3049c3d649\") " pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:33.791124 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.791058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z75s\" (UniqueName: \"kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s\") pod \"authorino-75d556bd77-xb4v8\" (UID: \"96166bae-f044-4ca4-a498-3f07fb300421\") " pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:24:33.798969 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.798948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z75s\" (UniqueName: \"kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s\") pod \"authorino-75d556bd77-xb4v8\" (UID: \"96166bae-f044-4ca4-a498-3f07fb300421\") " pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:24:33.817798 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.817771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:33.945606 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.945572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:24:33.998934 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:33.998908 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:34.001231 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:34.001134 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod102cad9d_163b_41e4_8607_cf3049c3d649.slice/crio-6300e39b34875fce64201c7df3b69c2bb8274d06799f6d79386b6c7454ea2c3d WatchSource:0}: Error finding container 6300e39b34875fce64201c7df3b69c2bb8274d06799f6d79386b6c7454ea2c3d: Status 404 returned error can't find the container with id 6300e39b34875fce64201c7df3b69c2bb8274d06799f6d79386b6c7454ea2c3d Jul 07 13:24:34.008126 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:34.008067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" event={"ID":"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9","Type":"ContainerStarted","Data":"6bb09c8138ba352160a1be14701f1c5c41e5dafc764959874a5cd3752b60f611"} Jul 07 13:24:34.133701 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:34.133668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:24:34.136043 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:34.136008 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96166bae_f044_4ca4_a498_3f07fb300421.slice/crio-b26bfc58ade60a69b4d2e088f9c6bf8dbd3aeb027c85362d131ec6fc486c2f0b WatchSource:0}: Error finding container b26bfc58ade60a69b4d2e088f9c6bf8dbd3aeb027c85362d131ec6fc486c2f0b: Status 404 returned error can't find the container with id b26bfc58ade60a69b4d2e088f9c6bf8dbd3aeb027c85362d131ec6fc486c2f0b Jul 07 13:24:35.021676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:35.021604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sdz95" event={"ID":"102cad9d-163b-41e4-8607-cf3049c3d649","Type":"ContainerStarted","Data":"6300e39b34875fce64201c7df3b69c2bb8274d06799f6d79386b6c7454ea2c3d"} Jul 07 13:24:35.024551 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:35.024479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xb4v8" event={"ID":"96166bae-f044-4ca4-a498-3f07fb300421","Type":"ContainerStarted","Data":"b26bfc58ade60a69b4d2e088f9c6bf8dbd3aeb027c85362d131ec6fc486c2f0b"} Jul 07 13:24:39.052446 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.052402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sdz95" event={"ID":"102cad9d-163b-41e4-8607-cf3049c3d649","Type":"ContainerStarted","Data":"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5"} Jul 07 13:24:39.054094 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.054066 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xb4v8" event={"ID":"96166bae-f044-4ca4-a498-3f07fb300421","Type":"ContainerStarted","Data":"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1"} Jul 07 13:24:39.055686 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.055660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" event={"ID":"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9","Type":"ContainerStarted","Data":"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c"} Jul 07 13:24:39.055798 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.055735 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:39.067883 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.067841 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sdz95" podStartSLOduration=1.989762195 podStartE2EDuration="6.067826716s" totalImagesPullingTime="4.078064521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:39.065748995 +0000 UTC m=+498.261386202" watchObservedRunningTime="2026-07-07 13:24:39.067826716 +0000 UTC m=+498.263463923" Jul 07 13:24:39.081678 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.081629 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" podStartSLOduration=2.237795849 podStartE2EDuration="7.081618815s" totalImagesPullingTime="4.843822966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:39.081243836 +0000 UTC m=+498.276881066" watchObservedRunningTime="2026-07-07 13:24:39.081618815 +0000 UTC m=+498.277256010" Jul 07 13:24:39.096013 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.095970 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xb4v8" podStartSLOduration=2.139202854 podStartE2EDuration="6.095952141s" totalImagesPullingTime="3.956749287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:39.095011531 +0000 UTC m=+498.290648742" watchObservedRunningTime="2026-07-07 13:24:39.095952141 +0000 UTC m=+498.291589352" Jul 07 13:24:39.119362 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:39.119334 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:41.067182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.067144 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sdz95" podUID="102cad9d-163b-41e4-8607-cf3049c3d649" containerName="authorino" containerID="cri-o://6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5" gracePeriod=30 Jul 07 13:24:41.324763 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.324711 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:41.365132 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.365105 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2lw4\" (UniqueName: \"kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4\") pod \"102cad9d-163b-41e4-8607-cf3049c3d649\" (UID: \"102cad9d-163b-41e4-8607-cf3049c3d649\") " Jul 07 13:24:41.367183 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.367161 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4" (OuterVolumeSpecName: "kube-api-access-h2lw4") pod "102cad9d-163b-41e4-8607-cf3049c3d649" (UID: "102cad9d-163b-41e4-8607-cf3049c3d649"). InnerVolumeSpecName "kube-api-access-h2lw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:24:41.466401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.466380 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2lw4\" (UniqueName: \"kubernetes.io/projected/102cad9d-163b-41e4-8607-cf3049c3d649-kube-api-access-h2lw4\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:41.548575 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.548556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:41.548705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.548633 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:41.552988 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:41.552971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:42.074636 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.074604 2577 generic.go:356] "Generic (PLEG): container finished" podID="102cad9d-163b-41e4-8607-cf3049c3d649" containerID="6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5" exitCode=0 Jul 07 13:24:42.075062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.074658 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sdz95" Jul 07 13:24:42.075062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.074689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sdz95" event={"ID":"102cad9d-163b-41e4-8607-cf3049c3d649","Type":"ContainerDied","Data":"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5"} Jul 07 13:24:42.075062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.074729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sdz95" event={"ID":"102cad9d-163b-41e4-8607-cf3049c3d649","Type":"ContainerDied","Data":"6300e39b34875fce64201c7df3b69c2bb8274d06799f6d79386b6c7454ea2c3d"} Jul 07 13:24:42.075062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.074746 2577 scope.go:117] "RemoveContainer" containerID="6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5" Jul 07 13:24:42.080249 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.080226 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5747bd69-rh72z" Jul 07 13:24:42.085063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.085043 2577 scope.go:117] "RemoveContainer" containerID="6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5" Jul 07 13:24:42.085370 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:24:42.085347 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5\": container with ID starting with 6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5 not found: ID does not exist" containerID="6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5" Jul 07 13:24:42.085517 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.085375 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5"} err="failed to get container status \"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5\": rpc error: code = NotFound desc = could not find container \"6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5\": container with ID starting with 6ffaf100c13317b24ea6c1af73f65221b06ad119633ad1bfdfc698a2b811caa5 not found: ID does not exist" Jul 07 13:24:42.112314 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.112271 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:42.116831 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.116800 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sdz95"] Jul 07 13:24:42.125442 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:42.125410 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:24:43.297184 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:43.297148 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="102cad9d-163b-41e4-8607-cf3049c3d649" path="/var/lib/kubelet/pods/102cad9d-163b-41e4-8607-cf3049c3d649/volumes" Jul 07 13:24:47.219803 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.219767 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:47.220272 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.219976 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" podUID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" containerName="limitador" containerID="cri-o://c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c" gracePeriod=30 Jul 07 13:24:47.220683 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.220662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:47.784597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.784544 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:47.811465 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.811440 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdvz4\" (UniqueName: \"kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4\") pod \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " Jul 07 13:24:47.811603 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.811516 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file\") pod \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\" (UID: \"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9\") " Jul 07 13:24:47.811861 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.811839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file" (OuterVolumeSpecName: "config-file") pod "3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" (UID: "3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:24:47.813444 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.813423 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4" (OuterVolumeSpecName: "kube-api-access-pdvz4") pod "3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" (UID: "3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9"). InnerVolumeSpecName "kube-api-access-pdvz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:24:47.913057 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.913033 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdvz4\" (UniqueName: \"kubernetes.io/projected/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-kube-api-access-pdvz4\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:47.913057 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:47.913054 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9-config-file\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:24:48.116513 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.116474 2577 generic.go:356] "Generic (PLEG): container finished" podID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" containerID="c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c" exitCode=0 Jul 07 13:24:48.116607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.116514 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" Jul 07 13:24:48.116607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.116516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" event={"ID":"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9","Type":"ContainerDied","Data":"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c"} Jul 07 13:24:48.116607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.116580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fqzf2" event={"ID":"3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9","Type":"ContainerDied","Data":"6bb09c8138ba352160a1be14701f1c5c41e5dafc764959874a5cd3752b60f611"} Jul 07 13:24:48.116607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.116605 2577 scope.go:117] "RemoveContainer" containerID="c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c" Jul 07 13:24:48.128012 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.127990 2577 scope.go:117] "RemoveContainer" containerID="c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c" Jul 07 13:24:48.128472 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:24:48.128439 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c\": container with ID starting with c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c not found: ID does not exist" containerID="c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c" Jul 07 13:24:48.128565 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.128484 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c"} err="failed to get container status \"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c\": rpc error: code = NotFound desc = could not find container \"c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c\": container with ID starting with c781100632bddc21f0cd1df329c204c3a3e76f65c4829291daf2312cd395bf3c not found: ID does not exist" Jul 07 13:24:48.139088 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.139066 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:48.142143 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:48.142121 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fqzf2"] Jul 07 13:24:49.296734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:49.296698 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" path="/var/lib/kubelet/pods/3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9/volumes" Jul 07 13:24:50.799216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.799162 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-npczk"] Jul 07 13:24:50.799837 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.799812 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" containerName="limitador" Jul 07 13:24:50.799906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.799841 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" containerName="limitador" Jul 07 13:24:50.799906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.799864 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102cad9d-163b-41e4-8607-cf3049c3d649" containerName="authorino" Jul 07 13:24:50.799906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.799874 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="102cad9d-163b-41e4-8607-cf3049c3d649" containerName="authorino" Jul 07 13:24:50.800021 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.800005 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="102cad9d-163b-41e4-8607-cf3049c3d649" containerName="authorino" Jul 07 13:24:50.800062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.800032 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7ee232-aa67-4e3d-b35c-f33ac3a18bd9" containerName="limitador" Jul 07 13:24:50.804953 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.804923 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:50.807749 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.807722 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 13:24:50.807901 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.807752 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ngfq4\"" Jul 07 13:24:50.811013 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.810987 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-npczk"] Jul 07 13:24:50.935725 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.935695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/334fc259-7570-40cd-8294-1d50d1e929ca-data\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:50.935850 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:50.935770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jll8\" (UniqueName: \"kubernetes.io/projected/334fc259-7570-40cd-8294-1d50d1e929ca-kube-api-access-7jll8\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.037049 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.037022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jll8\" (UniqueName: \"kubernetes.io/projected/334fc259-7570-40cd-8294-1d50d1e929ca-kube-api-access-7jll8\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.037180 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.037087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/334fc259-7570-40cd-8294-1d50d1e929ca-data\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.037454 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.037436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/334fc259-7570-40cd-8294-1d50d1e929ca-data\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.044888 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.044870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jll8\" (UniqueName: \"kubernetes.io/projected/334fc259-7570-40cd-8294-1d50d1e929ca-kube-api-access-7jll8\") pod \"postgres-69fb4594cf-npczk\" (UID: \"334fc259-7570-40cd-8294-1d50d1e929ca\") " pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.118875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.118855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:51.252823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:51.252794 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-npczk"] Jul 07 13:24:51.254306 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:24:51.254278 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334fc259_7570_40cd_8294_1d50d1e929ca.slice/crio-67511b068c6efde0027ea86c7707c0eaf0a5223180b310e116881dd143a83c5b WatchSource:0}: Error finding container 67511b068c6efde0027ea86c7707c0eaf0a5223180b310e116881dd143a83c5b: Status 404 returned error can't find the container with id 67511b068c6efde0027ea86c7707c0eaf0a5223180b310e116881dd143a83c5b Jul 07 13:24:52.146009 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:52.145972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-npczk" event={"ID":"334fc259-7570-40cd-8294-1d50d1e929ca","Type":"ContainerStarted","Data":"67511b068c6efde0027ea86c7707c0eaf0a5223180b310e116881dd143a83c5b"} Jul 07 13:24:57.182225 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:57.182162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-npczk" event={"ID":"334fc259-7570-40cd-8294-1d50d1e929ca","Type":"ContainerStarted","Data":"ce3c6014680474acd88820023ae8b39c234449bf665eba23685dc31aa9845ef2"} Jul 07 13:24:57.182604 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:57.182401 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:24:57.199085 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:24:57.199041 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-npczk" podStartSLOduration=2.077409105 podStartE2EDuration="7.199028001s" totalImagesPullingTime="5.121618896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:24:57.197268963 +0000 UTC m=+516.392906170" watchObservedRunningTime="2026-07-07 13:24:57.199028001 +0000 UTC m=+516.394665234" Jul 07 13:25:03.218207 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:03.218163 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-npczk" Jul 07 13:25:03.798663 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:03.798631 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7rspw"] Jul 07 13:25:03.803441 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:03.803422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:03.808613 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:03.808587 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7rspw"] Jul 07 13:25:03.949822 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:03.949794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5pq\" (UniqueName: \"kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq\") pod \"authorino-5d4b67c446-7rspw\" (UID: \"0f34a089-5aad-457f-a20e-6a29cdb8f4e0\") " pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:04.040613 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.040583 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7rspw"] Jul 07 13:25:04.040801 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:04.040782 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qh5pq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7rspw" podUID="0f34a089-5aad-457f-a20e-6a29cdb8f4e0" Jul 07 13:25:04.050376 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.050310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5pq\" (UniqueName: \"kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq\") pod \"authorino-5d4b67c446-7rspw\" (UID: \"0f34a089-5aad-457f-a20e-6a29cdb8f4e0\") " pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:04.064554 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.064528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5pq\" (UniqueName: \"kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq\") pod \"authorino-5d4b67c446-7rspw\" (UID: \"0f34a089-5aad-457f-a20e-6a29cdb8f4e0\") " pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:04.068988 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.068967 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:04.072685 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.072665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:04.080235 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.079930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:04.151340 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.151312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6r4\" (UniqueName: \"kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4\") pod \"authorino-5c6f7d4c77-92fdb\" (UID: \"4f4e412c-a9ae-4d04-8138-42c48ad7d954\") " pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:04.222562 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.222536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:04.229169 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.229149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:04.252679 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.252656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6r4\" (UniqueName: \"kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4\") pod \"authorino-5c6f7d4c77-92fdb\" (UID: \"4f4e412c-a9ae-4d04-8138-42c48ad7d954\") " pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:04.260799 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.260777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6r4\" (UniqueName: \"kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4\") pod \"authorino-5c6f7d4c77-92fdb\" (UID: \"4f4e412c-a9ae-4d04-8138-42c48ad7d954\") " pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:04.329522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.329460 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:04.329707 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.329692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:04.353632 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.353605 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh5pq\" (UniqueName: \"kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq\") pod \"0f34a089-5aad-457f-a20e-6a29cdb8f4e0\" (UID: \"0f34a089-5aad-457f-a20e-6a29cdb8f4e0\") " Jul 07 13:25:04.356048 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.356020 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq" (OuterVolumeSpecName: "kube-api-access-qh5pq") pod "0f34a089-5aad-457f-a20e-6a29cdb8f4e0" (UID: "0f34a089-5aad-457f-a20e-6a29cdb8f4e0"). InnerVolumeSpecName "kube-api-access-qh5pq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:25:04.357004 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.356982 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:25:04.361628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.361608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.364016 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.363996 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 13:25:04.367510 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.367488 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:25:04.454543 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.454514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9d6\" (UniqueName: \"kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.454681 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.454646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.454779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.454766 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh5pq\" (UniqueName: \"kubernetes.io/projected/0f34a089-5aad-457f-a20e-6a29cdb8f4e0-kube-api-access-qh5pq\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:04.472843 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.472814 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:04.475471 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:04.475448 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f4e412c_a9ae_4d04_8138_42c48ad7d954.slice/crio-bf602f689b1647f94ff733dd17dbc82fa38d05a0acf7a747d67a299740ee8876 WatchSource:0}: Error finding container bf602f689b1647f94ff733dd17dbc82fa38d05a0acf7a747d67a299740ee8876: Status 404 returned error can't find the container with id bf602f689b1647f94ff733dd17dbc82fa38d05a0acf7a747d67a299740ee8876 Jul 07 13:25:04.555354 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.555333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9d6\" (UniqueName: \"kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.555451 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.555397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.557695 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.557677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.562758 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.562740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9d6\" (UniqueName: \"kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6\") pod \"authorino-867bf9b9bf-ptx69\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.673529 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.673511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:25:04.806783 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:04.806755 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:25:04.807839 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:04.807810 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410ff94c_187a_41be_9c85_5cf70a57bcfb.slice/crio-5bbb0ce386f350ec5daf127ce7daaeffaf3ffab551e47b657e630a55cf42955f WatchSource:0}: Error finding container 5bbb0ce386f350ec5daf127ce7daaeffaf3ffab551e47b657e630a55cf42955f: Status 404 returned error can't find the container with id 5bbb0ce386f350ec5daf127ce7daaeffaf3ffab551e47b657e630a55cf42955f Jul 07 13:25:05.230030 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.229933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" event={"ID":"410ff94c-187a-41be-9c85-5cf70a57bcfb","Type":"ContainerStarted","Data":"5bbb0ce386f350ec5daf127ce7daaeffaf3ffab551e47b657e630a55cf42955f"} Jul 07 13:25:05.231447 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.231421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" event={"ID":"4f4e412c-a9ae-4d04-8138-42c48ad7d954","Type":"ContainerStarted","Data":"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41"} Jul 07 13:25:05.231581 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.231455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" event={"ID":"4f4e412c-a9ae-4d04-8138-42c48ad7d954","Type":"ContainerStarted","Data":"bf602f689b1647f94ff733dd17dbc82fa38d05a0acf7a747d67a299740ee8876"} Jul 07 13:25:05.231581 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.231461 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" podUID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" containerName="authorino" containerID="cri-o://1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41" gracePeriod=30 Jul 07 13:25:05.231722 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.231590 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7rspw" Jul 07 13:25:05.247308 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.247266 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" podStartSLOduration=0.763408851 podStartE2EDuration="1.247249855s" totalImagesPullingTime="483.841004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:05.244039175 +0000 UTC m=+524.439676384" watchObservedRunningTime="2026-07-07 13:25:05.247249855 +0000 UTC m=+524.442887066" Jul 07 13:25:05.316906 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.316884 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7rspw"] Jul 07 13:25:05.320531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.320510 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7rspw"] Jul 07 13:25:05.479391 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.479370 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:05.565336 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.565275 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp6r4\" (UniqueName: \"kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4\") pod \"4f4e412c-a9ae-4d04-8138-42c48ad7d954\" (UID: \"4f4e412c-a9ae-4d04-8138-42c48ad7d954\") " Jul 07 13:25:05.567256 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.567225 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4" (OuterVolumeSpecName: "kube-api-access-wp6r4") pod "4f4e412c-a9ae-4d04-8138-42c48ad7d954" (UID: "4f4e412c-a9ae-4d04-8138-42c48ad7d954"). InnerVolumeSpecName "kube-api-access-wp6r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:25:05.666435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:05.666407 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp6r4\" (UniqueName: \"kubernetes.io/projected/4f4e412c-a9ae-4d04-8138-42c48ad7d954-kube-api-access-wp6r4\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:06.239156 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.239056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" event={"ID":"410ff94c-187a-41be-9c85-5cf70a57bcfb","Type":"ContainerStarted","Data":"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d"} Jul 07 13:25:06.240410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.240381 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" containerID="1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41" exitCode=0 Jul 07 13:25:06.240553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.240438 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" Jul 07 13:25:06.240553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.240442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" event={"ID":"4f4e412c-a9ae-4d04-8138-42c48ad7d954","Type":"ContainerDied","Data":"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41"} Jul 07 13:25:06.240553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.240551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6f7d4c77-92fdb" event={"ID":"4f4e412c-a9ae-4d04-8138-42c48ad7d954","Type":"ContainerDied","Data":"bf602f689b1647f94ff733dd17dbc82fa38d05a0acf7a747d67a299740ee8876"} Jul 07 13:25:06.240714 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.240568 2577 scope.go:117] "RemoveContainer" containerID="1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41" Jul 07 13:25:06.253938 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.253888 2577 scope.go:117] "RemoveContainer" containerID="1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41" Jul 07 13:25:06.254347 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:06.254313 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41\": container with ID starting with 1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41 not found: ID does not exist" containerID="1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41" Jul 07 13:25:06.254461 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.254355 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41"} err="failed to get container status \"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41\": rpc error: code = NotFound desc = could not find container \"1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41\": container with ID starting with 1f2a7170f5b629a6b3f8817653e72bc672394dba09645472b52d3c8972cfbc41 not found: ID does not exist" Jul 07 13:25:06.256440 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.256395 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" podStartSLOduration=1.079007402 podStartE2EDuration="2.256382695s" totalImagesPullingTime="1.177375293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:06.253653163 +0000 UTC m=+525.449290371" watchObservedRunningTime="2026-07-07 13:25:06.256382695 +0000 UTC m=+525.452019903" Jul 07 13:25:06.270306 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.270283 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:06.272862 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.272836 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c6f7d4c77-92fdb"] Jul 07 13:25:06.282504 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.282480 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:25:06.282709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.282672 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xb4v8" podUID="96166bae-f044-4ca4-a498-3f07fb300421" containerName="authorino" containerID="cri-o://b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1" gracePeriod=30 Jul 07 13:25:06.542804 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.542782 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:25:06.675847 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.675821 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z75s\" (UniqueName: \"kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s\") pod \"96166bae-f044-4ca4-a498-3f07fb300421\" (UID: \"96166bae-f044-4ca4-a498-3f07fb300421\") " Jul 07 13:25:06.677842 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.677816 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s" (OuterVolumeSpecName: "kube-api-access-6z75s") pod "96166bae-f044-4ca4-a498-3f07fb300421" (UID: "96166bae-f044-4ca4-a498-3f07fb300421"). InnerVolumeSpecName "kube-api-access-6z75s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:25:06.776423 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:06.776369 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z75s\" (UniqueName: \"kubernetes.io/projected/96166bae-f044-4ca4-a498-3f07fb300421-kube-api-access-6z75s\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.149676 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.149617 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58dbfdb677-gxhnh" podUID="a2860c60-9ab3-4749-8266-a2da208e23a3" containerName="console" containerID="cri-o://d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098" gracePeriod=15 Jul 07 13:25:07.247806 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.247776 2577 generic.go:356] "Generic (PLEG): container finished" podID="96166bae-f044-4ca4-a498-3f07fb300421" containerID="b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1" exitCode=0 Jul 07 13:25:07.248119 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.247814 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xb4v8" Jul 07 13:25:07.248119 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.247857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xb4v8" event={"ID":"96166bae-f044-4ca4-a498-3f07fb300421","Type":"ContainerDied","Data":"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1"} Jul 07 13:25:07.248119 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.247897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xb4v8" event={"ID":"96166bae-f044-4ca4-a498-3f07fb300421","Type":"ContainerDied","Data":"b26bfc58ade60a69b4d2e088f9c6bf8dbd3aeb027c85362d131ec6fc486c2f0b"} Jul 07 13:25:07.248119 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.247923 2577 scope.go:117] "RemoveContainer" containerID="b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1" Jul 07 13:25:07.261234 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.261217 2577 scope.go:117] "RemoveContainer" containerID="b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1" Jul 07 13:25:07.261509 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:07.261491 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1\": container with ID starting with b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1 not found: ID does not exist" containerID="b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1" Jul 07 13:25:07.261575 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.261518 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1"} err="failed to get container status \"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1\": rpc error: code = NotFound desc = could not find container \"b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1\": container with ID starting with b510841f9970a2878bfac79b0e7ec30888e45083cfd7db2e14a73a25bcaa69a1 not found: ID does not exist" Jul 07 13:25:07.268641 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.268614 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:25:07.274081 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.274061 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xb4v8"] Jul 07 13:25:07.298739 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.298715 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f34a089-5aad-457f-a20e-6a29cdb8f4e0" path="/var/lib/kubelet/pods/0f34a089-5aad-457f-a20e-6a29cdb8f4e0/volumes" Jul 07 13:25:07.298944 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.298929 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" path="/var/lib/kubelet/pods/4f4e412c-a9ae-4d04-8138-42c48ad7d954/volumes" Jul 07 13:25:07.299264 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.299248 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96166bae-f044-4ca4-a498-3f07fb300421" path="/var/lib/kubelet/pods/96166bae-f044-4ca4-a498-3f07fb300421/volumes" Jul 07 13:25:07.401750 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.401697 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:25:07.482383 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482357 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482519 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482393 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dlcb\" (UniqueName: \"kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482519 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482463 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482519 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482514 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482679 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482553 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482679 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482577 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482679 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config\") pod \"a2860c60-9ab3-4749-8266-a2da208e23a3\" (UID: \"a2860c60-9ab3-4749-8266-a2da208e23a3\") " Jul 07 13:25:07.482825 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.482688 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:25:07.483058 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.483039 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-service-ca\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.483173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.483037 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config" (OuterVolumeSpecName: "console-config") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:25:07.483173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.483051 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:25:07.483173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.483057 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:25:07.484651 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.484625 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb" (OuterVolumeSpecName: "kube-api-access-9dlcb") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "kube-api-access-9dlcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:25:07.484741 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.484652 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:25:07.484741 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.484715 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2860c60-9ab3-4749-8266-a2da208e23a3" (UID: "a2860c60-9ab3-4749-8266-a2da208e23a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:25:07.584166 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584145 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-oauth-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.584166 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584166 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-oauth-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.584304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584175 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-trusted-ca-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.584304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584183 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2860c60-9ab3-4749-8266-a2da208e23a3-console-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.584304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584226 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dlcb\" (UniqueName: \"kubernetes.io/projected/a2860c60-9ab3-4749-8266-a2da208e23a3-kube-api-access-9dlcb\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:07.584304 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:07.584237 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2860c60-9ab3-4749-8266-a2da208e23a3-console-serving-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:08.256794 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.256764 2577 generic.go:356] "Generic (PLEG): container finished" podID="a2860c60-9ab3-4749-8266-a2da208e23a3" containerID="d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098" exitCode=0 Jul 07 13:25:08.257282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.256810 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58dbfdb677-gxhnh" Jul 07 13:25:08.257282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.256847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58dbfdb677-gxhnh" event={"ID":"a2860c60-9ab3-4749-8266-a2da208e23a3","Type":"ContainerDied","Data":"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098"} Jul 07 13:25:08.257282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.256904 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58dbfdb677-gxhnh" event={"ID":"a2860c60-9ab3-4749-8266-a2da208e23a3","Type":"ContainerDied","Data":"ccca8406fadc8beef2ee4659bf39ed49a4b93d7ba94235aa6a59f8a2ebebab88"} Jul 07 13:25:08.257282 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.256940 2577 scope.go:117] "RemoveContainer" containerID="d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098" Jul 07 13:25:08.267245 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.267226 2577 scope.go:117] "RemoveContainer" containerID="d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098" Jul 07 13:25:08.267502 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:08.267484 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098\": container with ID starting with d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098 not found: ID does not exist" containerID="d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098" Jul 07 13:25:08.267557 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.267511 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098"} err="failed to get container status \"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098\": rpc error: code = NotFound desc = could not find container \"d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098\": container with ID starting with d5881ae2d1ac2e16f95b906e6dab5c0fbe4952a1cef7c3dd8fac58b636134098 not found: ID does not exist" Jul 07 13:25:08.279790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.279764 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:25:08.284732 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:08.284709 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58dbfdb677-gxhnh"] Jul 07 13:25:09.296461 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:09.296430 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2860c60-9ab3-4749-8266-a2da208e23a3" path="/var/lib/kubelet/pods/a2860c60-9ab3-4749-8266-a2da208e23a3/volumes" Jul 07 13:25:10.742359 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742326 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:10.742920 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742900 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2860c60-9ab3-4749-8266-a2da208e23a3" containerName="console" Jul 07 13:25:10.742920 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742922 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2860c60-9ab3-4749-8266-a2da208e23a3" containerName="console" Jul 07 13:25:10.743063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742964 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96166bae-f044-4ca4-a498-3f07fb300421" containerName="authorino" Jul 07 13:25:10.743063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742974 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96166bae-f044-4ca4-a498-3f07fb300421" containerName="authorino" Jul 07 13:25:10.743063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742987 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" containerName="authorino" Jul 07 13:25:10.743063 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.742995 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" containerName="authorino" Jul 07 13:25:10.743280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.743108 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2860c60-9ab3-4749-8266-a2da208e23a3" containerName="console" Jul 07 13:25:10.743280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.743124 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f4e412c-a9ae-4d04-8138-42c48ad7d954" containerName="authorino" Jul 07 13:25:10.743280 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.743136 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="96166bae-f044-4ca4-a498-3f07fb300421" containerName="authorino" Jul 07 13:25:10.750646 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.750625 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:10.753517 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.753489 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 13:25:10.753517 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.753503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 13:25:10.753687 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.753579 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2msk6\"" Jul 07 13:25:10.765240 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.765185 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:10.907823 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.907794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zkd\" (UniqueName: \"kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:10.907926 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.907903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:10.917540 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.917519 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:25:10.920173 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.920158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:10.929277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:10.929251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:25:11.009223 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.009140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.009223 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.009176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcr62\" (UniqueName: \"kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.009410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.009250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zkd\" (UniqueName: \"kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.009410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.009280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.009410 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:11.009298 2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 13:25:11.009410 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:11.009374 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert podName:cc3e3a45-2d2e-42f1-9fce-b7540afcba19 nodeName:}" failed. No retries permitted until 2026-07-07 13:25:11.509353486 +0000 UTC m=+530.704990676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert") pod "maas-controller-84dd895788-7db5h" (UID: "cc3e3a45-2d2e-42f1-9fce-b7540afcba19") : secret "maas-controller-webhook-cert" not found Jul 07 13:25:11.017889 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.017861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zkd\" (UniqueName: \"kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.110127 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.110102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcr62\" (UniqueName: \"kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.110273 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.110150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.110341 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:11.110279 2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 13:25:11.110341 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:11.110328 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert podName:0a398936-2c2e-4d2c-bfac-9b71ccd333c5 nodeName:}" failed. No retries permitted until 2026-07-07 13:25:11.610313958 +0000 UTC m=+530.805951145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert") pod "maas-controller-94cc7fdf5-5ckw7" (UID: "0a398936-2c2e-4d2c-bfac-9b71ccd333c5") : secret "maas-controller-webhook-cert" not found Jul 07 13:25:11.118912 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.118889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcr62\" (UniqueName: \"kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.513640 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.513612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.515926 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.515899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") pod \"maas-controller-84dd895788-7db5h\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.614534 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.614510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.616724 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.616695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") pod \"maas-controller-94cc7fdf5-5ckw7\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.661740 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.661718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:11.793183 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.793149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:11.795320 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:11.795292 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3e3a45_2d2e_42f1_9fce_b7540afcba19.slice/crio-8febeded76d86acd603cef14a7ce1eb8d99cb9f0b238208b6a8bc7356a2d7809 WatchSource:0}: Error finding container 8febeded76d86acd603cef14a7ce1eb8d99cb9f0b238208b6a8bc7356a2d7809: Status 404 returned error can't find the container with id 8febeded76d86acd603cef14a7ce1eb8d99cb9f0b238208b6a8bc7356a2d7809 Jul 07 13:25:11.831580 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.831555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:11.964748 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:11.964721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:25:11.965875 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:11.965853 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a398936_2c2e_4d2c_bfac_9b71ccd333c5.slice/crio-a065bcfb63c2c74cd8051bfd46ba38c2547d115831c678e70163ecd5d5d4eee0 WatchSource:0}: Error finding container a065bcfb63c2c74cd8051bfd46ba38c2547d115831c678e70163ecd5d5d4eee0: Status 404 returned error can't find the container with id a065bcfb63c2c74cd8051bfd46ba38c2547d115831c678e70163ecd5d5d4eee0 Jul 07 13:25:12.284441 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:12.284408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" event={"ID":"0a398936-2c2e-4d2c-bfac-9b71ccd333c5","Type":"ContainerStarted","Data":"a065bcfb63c2c74cd8051bfd46ba38c2547d115831c678e70163ecd5d5d4eee0"} Jul 07 13:25:12.285477 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:12.285455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84dd895788-7db5h" event={"ID":"cc3e3a45-2d2e-42f1-9fce-b7540afcba19","Type":"ContainerStarted","Data":"8febeded76d86acd603cef14a7ce1eb8d99cb9f0b238208b6a8bc7356a2d7809"} Jul 07 13:25:14.302862 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.302819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" event={"ID":"0a398936-2c2e-4d2c-bfac-9b71ccd333c5","Type":"ContainerStarted","Data":"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379"} Jul 07 13:25:14.303364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.302957 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:14.304984 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.304957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84dd895788-7db5h" event={"ID":"cc3e3a45-2d2e-42f1-9fce-b7540afcba19","Type":"ContainerStarted","Data":"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332"} Jul 07 13:25:14.305094 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.305042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:14.330532 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.330446 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" podStartSLOduration=2.219459903 podStartE2EDuration="4.330432198s" totalImagesPullingTime="2.110972295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:14.327053119 +0000 UTC m=+533.522690348" watchObservedRunningTime="2026-07-07 13:25:14.330432198 +0000 UTC m=+533.526069419" Jul 07 13:25:14.350239 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:14.350186 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84dd895788-7db5h" podStartSLOduration=2.05716342 podStartE2EDuration="4.350172822s" totalImagesPullingTime="2.293009402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:14.348610049 +0000 UTC m=+533.544247257" watchObservedRunningTime="2026-07-07 13:25:14.350172822 +0000 UTC m=+533.545810029" Jul 07 13:25:25.315131 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.315099 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:25:25.315531 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.315170 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:25.376565 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.376528 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:25.376759 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.376718 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84dd895788-7db5h" podUID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" containerName="manager" containerID="cri-o://3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332" gracePeriod=30 Jul 07 13:25:25.623610 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.623587 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:25.629469 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.629448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87zkd\" (UniqueName: \"kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd\") pod \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " Jul 07 13:25:25.629608 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.629476 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") pod \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\" (UID: \"cc3e3a45-2d2e-42f1-9fce-b7540afcba19\") " Jul 07 13:25:25.631530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.631503 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd" (OuterVolumeSpecName: "kube-api-access-87zkd") pod "cc3e3a45-2d2e-42f1-9fce-b7540afcba19" (UID: "cc3e3a45-2d2e-42f1-9fce-b7540afcba19"). InnerVolumeSpecName "kube-api-access-87zkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:25:25.631621 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.631581 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc3e3a45-2d2e-42f1-9fce-b7540afcba19" (UID: "cc3e3a45-2d2e-42f1-9fce-b7540afcba19"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:25:25.730931 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.730896 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87zkd\" (UniqueName: \"kubernetes.io/projected/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-kube-api-access-87zkd\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:25.730931 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:25.730931 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc3e3a45-2d2e-42f1-9fce-b7540afcba19-webhook-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:25:26.379822 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.379796 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" containerID="3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332" exitCode=0 Jul 07 13:25:26.380226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.379834 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84dd895788-7db5h" Jul 07 13:25:26.380226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.379882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84dd895788-7db5h" event={"ID":"cc3e3a45-2d2e-42f1-9fce-b7540afcba19","Type":"ContainerDied","Data":"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332"} Jul 07 13:25:26.380226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.379939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84dd895788-7db5h" event={"ID":"cc3e3a45-2d2e-42f1-9fce-b7540afcba19","Type":"ContainerDied","Data":"8febeded76d86acd603cef14a7ce1eb8d99cb9f0b238208b6a8bc7356a2d7809"} Jul 07 13:25:26.380226 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.379966 2577 scope.go:117] "RemoveContainer" containerID="3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332" Jul 07 13:25:26.390255 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.390237 2577 scope.go:117] "RemoveContainer" containerID="3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332" Jul 07 13:25:26.390504 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:26.390487 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332\": container with ID starting with 3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332 not found: ID does not exist" containerID="3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332" Jul 07 13:25:26.390568 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.390511 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332"} err="failed to get container status \"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332\": rpc error: code = NotFound desc = could not find container \"3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332\": container with ID starting with 3fc04de9f2ad9a6d464df4ede2cc2b671ea6fc4495ed2b4bc490638031f33332 not found: ID does not exist" Jul 07 13:25:26.401874 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.401854 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:26.407201 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:26.407170 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84dd895788-7db5h"] Jul 07 13:25:27.297040 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:27.297008 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" path="/var/lib/kubelet/pods/cc3e3a45-2d2e-42f1-9fce-b7540afcba19/volumes" Jul 07 13:25:44.903336 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.903301 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-57c77f8f76-g448b"] Jul 07 13:25:44.903779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.903764 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" containerName="manager" Jul 07 13:25:44.903872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.903781 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" containerName="manager" Jul 07 13:25:44.903872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.903856 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc3e3a45-2d2e-42f1-9fce-b7540afcba19" containerName="manager" Jul 07 13:25:44.906368 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.906339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:44.908974 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.908952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 13:25:44.909088 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.909014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9r9sk\"" Jul 07 13:25:44.918068 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.918044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-57c77f8f76-g448b"] Jul 07 13:25:44.990564 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.990533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:44.990751 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.990595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75qn\" (UniqueName: \"kubernetes.io/projected/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-kube-api-access-x75qn\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:44.990751 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:44.990696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-openshift-service-ca\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.092012 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.091983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.092290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.092027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75qn\" (UniqueName: \"kubernetes.io/projected/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-kube-api-access-x75qn\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.092290 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.092071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-openshift-service-ca\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.092290 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:45.092138 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 07 13:25:45.092290 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:25:45.092238 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls podName:6bb07e1f-ccb6-4f47-afe7-33d03fcd0688 nodeName:}" failed. No retries permitted until 2026-07-07 13:25:45.59221962 +0000 UTC m=+564.787856810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls") pod "maas-api-57c77f8f76-g448b" (UID: "6bb07e1f-ccb6-4f47-afe7-33d03fcd0688") : secret "maas-api-serving-cert" not found Jul 07 13:25:45.092728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.092709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-openshift-service-ca\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.102444 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.102418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75qn\" (UniqueName: \"kubernetes.io/projected/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-kube-api-access-x75qn\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.397378 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.397347 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n8mxd"] Jul 07 13:25:45.400361 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.400341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.403479 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.403457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 13:25:45.403652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.403632 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vc4lg\"" Jul 07 13:25:45.413782 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.413759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n8mxd"] Jul 07 13:25:45.497348 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.497312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzzt\" (UniqueName: \"kubernetes.io/projected/20c1ec57-7265-4125-8a84-256656b119f7-kube-api-access-mgzzt\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.497664 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.497634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20c1ec57-7265-4125-8a84-256656b119f7-plugins-config-volume\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.598895 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.598859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.598895 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.598902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzzt\" (UniqueName: \"kubernetes.io/projected/20c1ec57-7265-4125-8a84-256656b119f7-kube-api-access-mgzzt\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.599116 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.598939 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20c1ec57-7265-4125-8a84-256656b119f7-plugins-config-volume\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.599736 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.599717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20c1ec57-7265-4125-8a84-256656b119f7-plugins-config-volume\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.601466 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.601446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb07e1f-ccb6-4f47-afe7-33d03fcd0688-maas-api-tls\") pod \"maas-api-57c77f8f76-g448b\" (UID: \"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688\") " pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.606264 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.606246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzzt\" (UniqueName: \"kubernetes.io/projected/20c1ec57-7265-4125-8a84-256656b119f7-kube-api-access-mgzzt\") pod \"payload-processing-58f86c7798-n8mxd\" (UID: \"20c1ec57-7265-4125-8a84-256656b119f7\") " pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.712524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.712460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:45.817925 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.817875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:45.854318 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.854292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-n8mxd"] Jul 07 13:25:45.855420 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:45.855393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c1ec57_7265_4125_8a84_256656b119f7.slice/crio-cbc93c6002f76eb3db45de01692307c9ec6df33f3e8964720568c7f41d45b482 WatchSource:0}: Error finding container cbc93c6002f76eb3db45de01692307c9ec6df33f3e8964720568c7f41d45b482: Status 404 returned error can't find the container with id cbc93c6002f76eb3db45de01692307c9ec6df33f3e8964720568c7f41d45b482 Jul 07 13:25:45.972731 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:45.972707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-57c77f8f76-g448b"] Jul 07 13:25:45.975817 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:25:45.975777 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb07e1f_ccb6_4f47_afe7_33d03fcd0688.slice/crio-8e34c41fb893a362db97d7929e95bd9b6e9420d22b85e47d4ce751cb2c222243 WatchSource:0}: Error finding container 8e34c41fb893a362db97d7929e95bd9b6e9420d22b85e47d4ce751cb2c222243: Status 404 returned error can't find the container with id 8e34c41fb893a362db97d7929e95bd9b6e9420d22b85e47d4ce751cb2c222243 Jul 07 13:25:46.498088 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:46.498046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-57c77f8f76-g448b" event={"ID":"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688","Type":"ContainerStarted","Data":"8e34c41fb893a362db97d7929e95bd9b6e9420d22b85e47d4ce751cb2c222243"} Jul 07 13:25:46.499829 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:46.499794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" event={"ID":"20c1ec57-7265-4125-8a84-256656b119f7","Type":"ContainerStarted","Data":"cbc93c6002f76eb3db45de01692307c9ec6df33f3e8964720568c7f41d45b482"} Jul 07 13:25:48.513894 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.513853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-57c77f8f76-g448b" event={"ID":"6bb07e1f-ccb6-4f47-afe7-33d03fcd0688","Type":"ContainerStarted","Data":"e0faa9f498732ef6ead07656ed4ee9492ccf6449da79be3be216033f869f5f9f"} Jul 07 13:25:48.514352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.513963 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:48.515462 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.515439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" event={"ID":"20c1ec57-7265-4125-8a84-256656b119f7","Type":"ContainerStarted","Data":"31fe21d9bb8647808cf887c4ec173a8fa88b9984d079a6833f6c88d91b8bf541"} Jul 07 13:25:48.515583 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.515570 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:25:48.533599 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.533539 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-57c77f8f76-g448b" podStartSLOduration=2.699962691 podStartE2EDuration="4.533523798s" totalImagesPullingTime="1.833561107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:48.529114319 +0000 UTC m=+567.724751559" watchObservedRunningTime="2026-07-07 13:25:48.533523798 +0000 UTC m=+567.729161008" Jul 07 13:25:48.545958 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:48.545907 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" podStartSLOduration=1.5945606909999999 podStartE2EDuration="3.545890914s" totalImagesPullingTime="1.951330223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:25:48.544012003 +0000 UTC m=+567.739649216" watchObservedRunningTime="2026-07-07 13:25:48.545890914 +0000 UTC m=+567.741528124" Jul 07 13:25:53.546242 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.546178 2577 generic.go:356] "Generic (PLEG): container finished" podID="32cfb76f-aed7-4447-be4c-a43a9ec7248b" containerID="b6ba4f06ab519cddbc9a3ada76810efe762bae5b088d8416681c67be60720302" exitCode=0 Jul 07 13:25:53.546648 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.546264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" event={"ID":"32cfb76f-aed7-4447-be4c-a43a9ec7248b","Type":"ContainerDied","Data":"b6ba4f06ab519cddbc9a3ada76810efe762bae5b088d8416681c67be60720302"} Jul 07 13:25:53.546648 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.546620 2577 scope.go:117] "RemoveContainer" containerID="b6ba4f06ab519cddbc9a3ada76810efe762bae5b088d8416681c67be60720302" Jul 07 13:25:53.547558 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.547529 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:25:53.547611 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.547597 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:25:53.547652 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.547628 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 13:25:53.938263 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:53.938234 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:25:54.526593 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:54.526565 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-57c77f8f76-g448b" Jul 07 13:25:54.560219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:54.559520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" event={"ID":"32cfb76f-aed7-4447-be4c-a43a9ec7248b","Type":"ContainerStarted","Data":"11f04c930c926cd81fec99cb94a6a62f590736eb8a569f68025df0cdaae10336"} Jul 07 13:25:54.573060 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:54.573031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:25:54.573856 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:54.573837 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-v885t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 07 13:25:54.573918 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:54.573882 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" podUID="32cfb76f-aed7-4447-be4c-a43a9ec7248b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 07 13:25:55.573824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:55.573795 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-v885t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 07 13:25:55.574258 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:55.573845 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" podUID="32cfb76f-aed7-4447-be4c-a43a9ec7248b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 07 13:25:56.573004 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:56.572969 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-v885t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 07 13:25:56.573221 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:56.573031 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" podUID="32cfb76f-aed7-4447-be4c-a43a9ec7248b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 07 13:25:57.573386 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:57.573347 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-v885t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 07 13:25:57.573784 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:57.573408 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" podUID="32cfb76f-aed7-4447-be4c-a43a9ec7248b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 07 13:25:58.576907 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:58.576877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:25:58.577396 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:58.577313 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:25:58.578105 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:58.578087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-v885t" Jul 07 13:25:59.523920 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:25:59.523880 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-n8mxd" Jul 07 13:26:09.377160 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.377121 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs"] Jul 07 13:26:09.381891 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.381872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.385488 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.385457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 13:26:09.385630 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.385556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 07 13:26:09.385630 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.385605 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 13:26:09.385754 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.385631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qgt7b\"" Jul 07 13:26:09.393584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.393559 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs"] Jul 07 13:26:09.512265 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.512427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f6b9c8-1791-45f4-a169-ebd352b28d51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.512427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.512427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7794\" (UniqueName: \"kubernetes.io/projected/30f6b9c8-1791-45f4-a169-ebd352b28d51-kube-api-access-m7794\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.512427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.512639 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.512506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613479 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613644 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613644 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613644 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f6b9c8-1791-45f4-a169-ebd352b28d51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7794\" (UniqueName: \"kubernetes.io/projected/30f6b9c8-1791-45f4-a169-ebd352b28d51-kube-api-access-m7794\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.613872 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.614039 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.613912 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.614039 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.614013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.615838 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.615809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f6b9c8-1791-45f4-a169-ebd352b28d51-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.615984 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.615968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f6b9c8-1791-45f4-a169-ebd352b28d51-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.621471 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.621450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7794\" (UniqueName: \"kubernetes.io/projected/30f6b9c8-1791-45f4-a169-ebd352b28d51-kube-api-access-m7794\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs\" (UID: \"30f6b9c8-1791-45f4-a169-ebd352b28d51\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.693875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.693818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:09.839790 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:09.839756 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs"] Jul 07 13:26:09.843023 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:26:09.842995 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f6b9c8_1791_45f4_a169_ebd352b28d51.slice/crio-2accebf11e0c5119733c293cc482d237bb906802e2ed0f11f2db352aacb623c7 WatchSource:0}: Error finding container 2accebf11e0c5119733c293cc482d237bb906802e2ed0f11f2db352aacb623c7: Status 404 returned error can't find the container with id 2accebf11e0c5119733c293cc482d237bb906802e2ed0f11f2db352aacb623c7 Jul 07 13:26:10.656670 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:10.656629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" event={"ID":"30f6b9c8-1791-45f4-a169-ebd352b28d51","Type":"ContainerStarted","Data":"2accebf11e0c5119733c293cc482d237bb906802e2ed0f11f2db352aacb623c7"} Jul 07 13:26:11.664363 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:11.664322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" event={"ID":"30f6b9c8-1791-45f4-a169-ebd352b28d51","Type":"ContainerStarted","Data":"e14f14bb5fe904117f46797b86c038b04fc55ec04338cf1b156c553f29965b2b"} Jul 07 13:26:11.682972 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:11.682927 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" podStartSLOduration=1.46881437 podStartE2EDuration="2.682912559s" totalImagesPullingTime="1.214098189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:26:11.680518456 +0000 UTC m=+590.876155663" watchObservedRunningTime="2026-07-07 13:26:11.682912559 +0000 UTC m=+590.878549767" Jul 07 13:26:19.693912 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:19.693873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:19.694375 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:19.693938 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:19.705973 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:19.705949 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:19.720806 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:19.720781 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs" Jul 07 13:26:21.211037 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.211009 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:26:21.212507 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.212483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:26:21.214548 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.214529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:26:21.216113 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.216094 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:26:21.220873 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.220857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:26:21.222370 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:21.222353 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:26:53.298911 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.298880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4"] Jul 07 13:26:53.302649 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.302630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.305387 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.305369 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 13:26:53.312827 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.312800 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4"] Jul 07 13:26:53.353302 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.353473 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.353549 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjrf8\" (UniqueName: \"kubernetes.io/projected/ab72d0c8-b007-4751-8c59-0b6c3e218d35-kube-api-access-qjrf8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.353623 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.353623 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.353745 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.353661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454313 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjrf8\" (UniqueName: \"kubernetes.io/projected/ab72d0c8-b007-4751-8c59-0b6c3e218d35-kube-api-access-qjrf8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454435 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454668 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454668 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.454824 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.454802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.456713 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.456692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab72d0c8-b007-4751-8c59-0b6c3e218d35-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.456881 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.456863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab72d0c8-b007-4751-8c59-0b6c3e218d35-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.461793 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.461771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjrf8\" (UniqueName: \"kubernetes.io/projected/ab72d0c8-b007-4751-8c59-0b6c3e218d35-kube-api-access-qjrf8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lczx4\" (UID: \"ab72d0c8-b007-4751-8c59-0b6c3e218d35\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.615158 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.615133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:26:53.753913 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.753887 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4"] Jul 07 13:26:53.756121 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:26:53.756087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab72d0c8_b007_4751_8c59_0b6c3e218d35.slice/crio-333d5b85aa389eae9e1b7da260ccb81088f41a4b7b1ebb50a6ec61a2812a0760 WatchSource:0}: Error finding container 333d5b85aa389eae9e1b7da260ccb81088f41a4b7b1ebb50a6ec61a2812a0760: Status 404 returned error can't find the container with id 333d5b85aa389eae9e1b7da260ccb81088f41a4b7b1ebb50a6ec61a2812a0760 Jul 07 13:26:53.757782 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.757760 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:26:53.914297 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:53.914222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" event={"ID":"ab72d0c8-b007-4751-8c59-0b6c3e218d35","Type":"ContainerStarted","Data":"333d5b85aa389eae9e1b7da260ccb81088f41a4b7b1ebb50a6ec61a2812a0760"} Jul 07 13:26:54.925928 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:54.925883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" event={"ID":"ab72d0c8-b007-4751-8c59-0b6c3e218d35","Type":"ContainerStarted","Data":"b77d95bbff031445bfa26893285d470b93060a1c852f6ac72d40685b4ea13494"} Jul 07 13:26:54.969812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:26:54.969760 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" podStartSLOduration=1.465039344 podStartE2EDuration="1.969743651s" totalImagesPullingTime="504.704307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:26:54.967305476 +0000 UTC m=+634.162942705" watchObservedRunningTime="2026-07-07 13:26:54.969743651 +0000 UTC m=+634.165380858" Jul 07 13:27:03.616270 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:03.616233 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:27:03.616747 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:03.616290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:27:03.634979 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:03.634941 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:27:03.996123 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:03.996035 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lczx4" Jul 07 13:27:14.384779 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.384738 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w"] Jul 07 13:27:14.389644 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.389615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.392131 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.392106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 13:27:14.401713 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.401683 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w"] Jul 07 13:27:14.538408 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwvt9\" (UniqueName: \"kubernetes.io/projected/2c30ada8-2066-4c16-9f07-642068cf870e-kube-api-access-lwvt9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.538556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.538556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.538556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.538556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c30ada8-2066-4c16-9f07-642068cf870e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.538723 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.538570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639401 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwvt9\" (UniqueName: \"kubernetes.io/projected/2c30ada8-2066-4c16-9f07-642068cf870e-kube-api-access-lwvt9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639594 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c30ada8-2066-4c16-9f07-642068cf870e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639769 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639875 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.639927 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.639915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.641773 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.641750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c30ada8-2066-4c16-9f07-642068cf870e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.642072 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.642055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c30ada8-2066-4c16-9f07-642068cf870e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.648289 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.648270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwvt9\" (UniqueName: \"kubernetes.io/projected/2c30ada8-2066-4c16-9f07-642068cf870e-kube-api-access-lwvt9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8k67w\" (UID: \"2c30ada8-2066-4c16-9f07-642068cf870e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.703294 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.703263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:14.839140 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:14.839108 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w"] Jul 07 13:27:14.840381 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:27:14.840354 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c30ada8_2066_4c16_9f07_642068cf870e.slice/crio-8b01d4be6c53750d7e5deab50fa8c0583de4919b8faceb59e6d401e9d56a2b2f WatchSource:0}: Error finding container 8b01d4be6c53750d7e5deab50fa8c0583de4919b8faceb59e6d401e9d56a2b2f: Status 404 returned error can't find the container with id 8b01d4be6c53750d7e5deab50fa8c0583de4919b8faceb59e6d401e9d56a2b2f Jul 07 13:27:15.053811 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:15.053775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" event={"ID":"2c30ada8-2066-4c16-9f07-642068cf870e","Type":"ContainerStarted","Data":"8b01d4be6c53750d7e5deab50fa8c0583de4919b8faceb59e6d401e9d56a2b2f"} Jul 07 13:27:16.062204 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:16.062157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" event={"ID":"2c30ada8-2066-4c16-9f07-642068cf870e","Type":"ContainerStarted","Data":"e8e4c45a58d6dfc82d129d161225ddde8515a576356778d631dfd86b305f2c1a"} Jul 07 13:27:16.081174 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:16.081125 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" podStartSLOduration=1.899177248 podStartE2EDuration="2.081109203s" totalImagesPullingTime="181.931955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:27:16.078677621 +0000 UTC m=+655.274314850" watchObservedRunningTime="2026-07-07 13:27:16.081109203 +0000 UTC m=+655.276746410" Jul 07 13:27:24.703814 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:24.703775 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:24.704326 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:24.703841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:24.716361 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:24.716340 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:27:25.129522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:27:25.129491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8k67w" Jul 07 13:29:09.508203 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.508160 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5987ddb7b4-kv7bd"] Jul 07 13:29:09.511705 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.511689 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.523379 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.523353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5987ddb7b4-kv7bd"] Jul 07 13:29:09.667881 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.667853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9fg\" (UniqueName: \"kubernetes.io/projected/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-kube-api-access-8z9fg\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.668009 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.667962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-tls-cert\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.768766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.768702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-tls-cert\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.768766 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.768742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9fg\" (UniqueName: \"kubernetes.io/projected/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-kube-api-access-8z9fg\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.771155 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.771130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-tls-cert\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.776043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.776020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9fg\" (UniqueName: \"kubernetes.io/projected/7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c-kube-api-access-8z9fg\") pod \"authorino-5987ddb7b4-kv7bd\" (UID: \"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c\") " pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.820690 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.820672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" Jul 07 13:29:09.966891 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:09.966866 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5987ddb7b4-kv7bd"] Jul 07 13:29:09.968531 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:29:09.968499 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a13e1f7_1e2d_4334_b8ee_1f0a1cb4625c.slice/crio-27ec86b2c7071dd8623d182fd1bb8d71df72daeb1f1af2560e3d87f627123380 WatchSource:0}: Error finding container 27ec86b2c7071dd8623d182fd1bb8d71df72daeb1f1af2560e3d87f627123380: Status 404 returned error can't find the container with id 27ec86b2c7071dd8623d182fd1bb8d71df72daeb1f1af2560e3d87f627123380 Jul 07 13:29:10.761145 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:10.761047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" event={"ID":"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c","Type":"ContainerStarted","Data":"9592d87976d32c3e0822d381b2dd5dc91920c11185063a8d4e755e035836705f"} Jul 07 13:29:10.761145 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:10.761099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" event={"ID":"7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c","Type":"ContainerStarted","Data":"27ec86b2c7071dd8623d182fd1bb8d71df72daeb1f1af2560e3d87f627123380"} Jul 07 13:29:10.793620 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:10.793554 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5987ddb7b4-kv7bd" podStartSLOduration=1.3722387600000001 podStartE2EDuration="1.79351898s" totalImagesPullingTime="421.28022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:10.792250818 +0000 UTC m=+769.987888027" watchObservedRunningTime="2026-07-07 13:29:10.79351898 +0000 UTC m=+769.989156189" Jul 07 13:29:10.860014 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:10.859973 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:29:10.860355 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:10.860310 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" podUID="410ff94c-187a-41be-9c85-5cf70a57bcfb" containerName="authorino" containerID="cri-o://1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d" gracePeriod=30 Jul 07 13:29:11.144574 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.144550 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:29:11.282552 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.282508 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw9d6\" (UniqueName: \"kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6\") pod \"410ff94c-187a-41be-9c85-5cf70a57bcfb\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " Jul 07 13:29:11.282747 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.282594 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert\") pod \"410ff94c-187a-41be-9c85-5cf70a57bcfb\" (UID: \"410ff94c-187a-41be-9c85-5cf70a57bcfb\") " Jul 07 13:29:11.284694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.284661 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6" (OuterVolumeSpecName: "kube-api-access-sw9d6") pod "410ff94c-187a-41be-9c85-5cf70a57bcfb" (UID: "410ff94c-187a-41be-9c85-5cf70a57bcfb"). InnerVolumeSpecName "kube-api-access-sw9d6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:11.296656 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.296623 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "410ff94c-187a-41be-9c85-5cf70a57bcfb" (UID: "410ff94c-187a-41be-9c85-5cf70a57bcfb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:11.384329 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.384297 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw9d6\" (UniqueName: \"kubernetes.io/projected/410ff94c-187a-41be-9c85-5cf70a57bcfb-kube-api-access-sw9d6\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:29:11.384329 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.384327 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/410ff94c-187a-41be-9c85-5cf70a57bcfb-tls-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:29:11.770291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.770250 2577 generic.go:356] "Generic (PLEG): container finished" podID="410ff94c-187a-41be-9c85-5cf70a57bcfb" containerID="1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d" exitCode=0 Jul 07 13:29:11.770775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.770304 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" Jul 07 13:29:11.770775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.770331 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" event={"ID":"410ff94c-187a-41be-9c85-5cf70a57bcfb","Type":"ContainerDied","Data":"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d"} Jul 07 13:29:11.770775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.770373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867bf9b9bf-ptx69" event={"ID":"410ff94c-187a-41be-9c85-5cf70a57bcfb","Type":"ContainerDied","Data":"5bbb0ce386f350ec5daf127ce7daaeffaf3ffab551e47b657e630a55cf42955f"} Jul 07 13:29:11.770775 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.770389 2577 scope.go:117] "RemoveContainer" containerID="1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d" Jul 07 13:29:11.790709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.790688 2577 scope.go:117] "RemoveContainer" containerID="1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d" Jul 07 13:29:11.791032 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:29:11.791013 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d\": container with ID starting with 1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d not found: ID does not exist" containerID="1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d" Jul 07 13:29:11.791096 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.791039 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d"} err="failed to get container status \"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d\": rpc error: code = NotFound desc = could not find container \"1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d\": container with ID starting with 1a3b1da3fda0ee34bf29378f26b1f74bc3cad5f5e8317ff6afb130aaf446d64d not found: ID does not exist" Jul 07 13:29:11.798987 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.798963 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:29:11.804862 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:11.804841 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-867bf9b9bf-ptx69"] Jul 07 13:29:13.297801 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:29:13.297769 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410ff94c-187a-41be-9c85-5cf70a57bcfb" path="/var/lib/kubelet/pods/410ff94c-187a-41be-9c85-5cf70a57bcfb/volumes" Jul 07 13:30:22.827716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:22.827682 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:30:22.828291 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:22.827885 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" podUID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" containerName="manager" containerID="cri-o://6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379" gracePeriod=30 Jul 07 13:30:23.082813 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.082749 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:30:23.209797 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.209769 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") pod \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " Jul 07 13:30:23.209953 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.209861 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcr62\" (UniqueName: \"kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62\") pod \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\" (UID: \"0a398936-2c2e-4d2c-bfac-9b71ccd333c5\") " Jul 07 13:30:23.211734 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.211701 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0a398936-2c2e-4d2c-bfac-9b71ccd333c5" (UID: "0a398936-2c2e-4d2c-bfac-9b71ccd333c5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:23.211876 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.211847 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62" (OuterVolumeSpecName: "kube-api-access-mcr62") pod "0a398936-2c2e-4d2c-bfac-9b71ccd333c5" (UID: "0a398936-2c2e-4d2c-bfac-9b71ccd333c5"). InnerVolumeSpecName "kube-api-access-mcr62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:30:23.228092 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.228070 2577 generic.go:356] "Generic (PLEG): container finished" podID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" containerID="6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379" exitCode=0 Jul 07 13:30:23.228236 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.228101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" event={"ID":"0a398936-2c2e-4d2c-bfac-9b71ccd333c5","Type":"ContainerDied","Data":"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379"} Jul 07 13:30:23.228236 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.228127 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" Jul 07 13:30:23.228236 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.228138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-5ckw7" event={"ID":"0a398936-2c2e-4d2c-bfac-9b71ccd333c5","Type":"ContainerDied","Data":"a065bcfb63c2c74cd8051bfd46ba38c2547d115831c678e70163ecd5d5d4eee0"} Jul 07 13:30:23.228236 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.228158 2577 scope.go:117] "RemoveContainer" containerID="6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379" Jul 07 13:30:23.238621 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.238604 2577 scope.go:117] "RemoveContainer" containerID="6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379" Jul 07 13:30:23.238902 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:30:23.238882 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379\": container with ID starting with 6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379 not found: ID does not exist" containerID="6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379" Jul 07 13:30:23.239013 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.238908 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379"} err="failed to get container status \"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379\": rpc error: code = NotFound desc = could not find container \"6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379\": container with ID starting with 6cc10730a7bf6c2d9139a1bce8c41b63fa514279cd30ad885f8b2fa2ed925379 not found: ID does not exist" Jul 07 13:30:23.252469 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.252446 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:30:23.260211 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.260177 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-5ckw7"] Jul 07 13:30:23.296081 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.296058 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" path="/var/lib/kubelet/pods/0a398936-2c2e-4d2c-bfac-9b71ccd333c5/volumes" Jul 07 13:30:23.311455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.311438 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcr62\" (UniqueName: \"kubernetes.io/projected/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-kube-api-access-mcr62\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:30:23.311537 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:23.311457 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a398936-2c2e-4d2c-bfac-9b71ccd333c5-webhook-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:30:24.075647 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.075609 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-mpgrz"] Jul 07 13:30:24.076062 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076046 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" containerName="manager" Jul 07 13:30:24.076106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076064 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" containerName="manager" Jul 07 13:30:24.076106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076077 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410ff94c-187a-41be-9c85-5cf70a57bcfb" containerName="authorino" Jul 07 13:30:24.076106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076082 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="410ff94c-187a-41be-9c85-5cf70a57bcfb" containerName="authorino" Jul 07 13:30:24.076218 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076148 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a398936-2c2e-4d2c-bfac-9b71ccd333c5" containerName="manager" Jul 07 13:30:24.076218 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.076156 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="410ff94c-187a-41be-9c85-5cf70a57bcfb" containerName="authorino" Jul 07 13:30:24.080582 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.080564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.083252 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.083233 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 13:30:24.083369 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.083290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2msk6\"" Jul 07 13:30:24.084403 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.084387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 13:30:24.089170 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.089145 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-mpgrz"] Jul 07 13:30:24.118954 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.118934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7tq\" (UniqueName: \"kubernetes.io/projected/9947b744-c6f1-46ba-8abe-be7c490ba62a-kube-api-access-sh7tq\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.119082 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.118978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9947b744-c6f1-46ba-8abe-be7c490ba62a-webhook-cert\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.219572 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.219543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7tq\" (UniqueName: \"kubernetes.io/projected/9947b744-c6f1-46ba-8abe-be7c490ba62a-kube-api-access-sh7tq\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.219685 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.219582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9947b744-c6f1-46ba-8abe-be7c490ba62a-webhook-cert\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.221927 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.221907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9947b744-c6f1-46ba-8abe-be7c490ba62a-webhook-cert\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.228165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.228146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7tq\" (UniqueName: \"kubernetes.io/projected/9947b744-c6f1-46ba-8abe-be7c490ba62a-kube-api-access-sh7tq\") pod \"maas-controller-94cc7fdf5-mpgrz\" (UID: \"9947b744-c6f1-46ba-8abe-be7c490ba62a\") " pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.392750 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.392729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:24.529323 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:24.529295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94cc7fdf5-mpgrz"] Jul 07 13:30:24.530531 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:30:24.530503 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9947b744_c6f1_46ba_8abe_be7c490ba62a.slice/crio-2744a934db63fdbec33e0078e80d16f145d13a226dabb5acf08859bc28bfe5c3 WatchSource:0}: Error finding container 2744a934db63fdbec33e0078e80d16f145d13a226dabb5acf08859bc28bfe5c3: Status 404 returned error can't find the container with id 2744a934db63fdbec33e0078e80d16f145d13a226dabb5acf08859bc28bfe5c3 Jul 07 13:30:25.243559 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:25.243528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" event={"ID":"9947b744-c6f1-46ba-8abe-be7c490ba62a","Type":"ContainerStarted","Data":"2744a934db63fdbec33e0078e80d16f145d13a226dabb5acf08859bc28bfe5c3"} Jul 07 13:30:26.251708 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:26.251668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" event={"ID":"9947b744-c6f1-46ba-8abe-be7c490ba62a","Type":"ContainerStarted","Data":"cd556bfa5636e97ef27a6cc75a5a7ffad7f2005482c6263f9fa737651660cdda"} Jul 07 13:30:26.252150 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:26.251792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:30:26.266883 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:26.266835 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" podStartSLOduration=1.619765631 podStartE2EDuration="2.266822926s" totalImagesPullingTime="647.057295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:26.266599546 +0000 UTC m=+845.462236755" watchObservedRunningTime="2026-07-07 13:30:26.266822926 +0000 UTC m=+845.462460134" Jul 07 13:30:37.264025 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:30:37.263986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-94cc7fdf5-mpgrz" Jul 07 13:31:21.265263 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.265162 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:31:21.266455 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.266434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:31:21.269234 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.269211 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:31:21.270728 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.270710 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:31:21.276393 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.276116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:31:21.277353 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:31:21.277336 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:35:11.210778 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:11.210743 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:35:11.211402 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:11.210997 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" podUID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" containerName="manager" containerID="cri-o://58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c" gracePeriod=10 Jul 07 13:35:13.971977 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.971954 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:35:13.976650 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.976627 2577 generic.go:356] "Generic (PLEG): container finished" podID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" containerID="58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c" exitCode=0 Jul 07 13:35:13.976780 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.976660 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" Jul 07 13:35:13.976780 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.976699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" event={"ID":"e08bc5f4-19bf-4c6d-8b35-77414aa52aff","Type":"ContainerDied","Data":"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c"} Jul 07 13:35:13.976780 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.976764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6" event={"ID":"e08bc5f4-19bf-4c6d-8b35-77414aa52aff","Type":"ContainerDied","Data":"75132981d306f7a3f51a71be88038e04c882c1a7de25eac242a54d541158dd3c"} Jul 07 13:35:13.976900 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.976796 2577 scope.go:117] "RemoveContainer" containerID="58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c" Jul 07 13:35:13.987311 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.987289 2577 scope.go:117] "RemoveContainer" containerID="58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c" Jul 07 13:35:13.987603 ip-10-0-131-128 kubenswrapper[2577]: E0707 13:35:13.987584 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c\": container with ID starting with 58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c not found: ID does not exist" containerID="58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c" Jul 07 13:35:13.987691 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:13.987611 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c"} err="failed to get container status \"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c\": rpc error: code = NotFound desc = could not find container \"58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c\": container with ID starting with 58358c0ef4c6b38d3903ef5d2dde15dbd92dc7428a7e8f3621b13f461955d79c not found: ID does not exist" Jul 07 13:35:14.133398 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.133373 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v45m4\" (UniqueName: \"kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4\") pod \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " Jul 07 13:35:14.133556 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.133419 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume\") pod \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\" (UID: \"e08bc5f4-19bf-4c6d-8b35-77414aa52aff\") " Jul 07 13:35:14.133834 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.133812 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e08bc5f4-19bf-4c6d-8b35-77414aa52aff" (UID: "e08bc5f4-19bf-4c6d-8b35-77414aa52aff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:14.135524 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.135505 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4" (OuterVolumeSpecName: "kube-api-access-v45m4") pod "e08bc5f4-19bf-4c6d-8b35-77414aa52aff" (UID: "e08bc5f4-19bf-4c6d-8b35-77414aa52aff"). InnerVolumeSpecName "kube-api-access-v45m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:35:14.234334 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.234311 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-extensions-socket-volume\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:35:14.234334 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.234330 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v45m4\" (UniqueName: \"kubernetes.io/projected/e08bc5f4-19bf-4c6d-8b35-77414aa52aff-kube-api-access-v45m4\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:35:14.304275 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.304250 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:35:14.309800 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:14.309781 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqzt6"] Jul 07 13:35:15.297204 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:35:15.297167 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" path="/var/lib/kubelet/pods/e08bc5f4-19bf-4c6d-8b35-77414aa52aff/volumes" Jul 07 13:36:12.524587 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.524554 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984"] Jul 07 13:36:12.526947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.524987 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" containerName="manager" Jul 07 13:36:12.526947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.524998 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" containerName="manager" Jul 07 13:36:12.526947 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.525064 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08bc5f4-19bf-4c6d-8b35-77414aa52aff" containerName="manager" Jul 07 13:36:12.528004 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.527988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.530553 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.530536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2j7s9\"" Jul 07 13:36:12.541469 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.541448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984"] Jul 07 13:36:12.616319 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.616294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/310a6808-2d04-4009-a703-317e2852da2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.616423 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.616349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jc6\" (UniqueName: \"kubernetes.io/projected/310a6808-2d04-4009-a703-317e2852da2b-kube-api-access-j6jc6\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.716977 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.716955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jc6\" (UniqueName: \"kubernetes.io/projected/310a6808-2d04-4009-a703-317e2852da2b-kube-api-access-j6jc6\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.717069 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.717019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/310a6808-2d04-4009-a703-317e2852da2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.717357 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.717342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/310a6808-2d04-4009-a703-317e2852da2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.724942 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.724924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jc6\" (UniqueName: \"kubernetes.io/projected/310a6808-2d04-4009-a703-317e2852da2b-kube-api-access-j6jc6\") pod \"kuadrant-operator-controller-manager-86878c769f-rv984\" (UID: \"310a6808-2d04-4009-a703-317e2852da2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.838307 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.838286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:12.987976 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:12.987946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984"] Jul 07 13:36:12.989126 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:36:12.989100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310a6808_2d04_4009_a703_317e2852da2b.slice/crio-5feb18c84f85646660c14ba64f1cf74eb452bbda02d1963bdb9df641c0a64e89 WatchSource:0}: Error finding container 5feb18c84f85646660c14ba64f1cf74eb452bbda02d1963bdb9df641c0a64e89: Status 404 returned error can't find the container with id 5feb18c84f85646660c14ba64f1cf74eb452bbda02d1963bdb9df641c0a64e89 Jul 07 13:36:13.342720 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:13.342687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" event={"ID":"310a6808-2d04-4009-a703-317e2852da2b","Type":"ContainerStarted","Data":"41576d3357db8c8adfb9bd9f324cacb65bc5e76d86962614eae3fafa05abd7f5"} Jul 07 13:36:13.342903 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:13.342765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" event={"ID":"310a6808-2d04-4009-a703-317e2852da2b","Type":"ContainerStarted","Data":"5feb18c84f85646660c14ba64f1cf74eb452bbda02d1963bdb9df641c0a64e89"} Jul 07 13:36:13.342903 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:13.342786 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:36:13.372523 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:13.372477 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" podStartSLOduration=1.372461025 podStartE2EDuration="1.372461025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:36:13.370254695 +0000 UTC m=+1192.565891930" watchObservedRunningTime="2026-07-07 13:36:13.372461025 +0000 UTC m=+1192.568098233" Jul 07 13:36:21.309776 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.309745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:36:21.313109 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.313086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:36:21.314216 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.314178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:36:21.317297 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.317280 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:36:21.319045 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.319028 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:36:21.323021 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:21.323003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:36:24.352187 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:36:24.352152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rv984" Jul 07 13:41:21.355262 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.355233 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:41:21.358956 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.358931 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:41:21.361187 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.361164 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:41:21.364946 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.364928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:41:21.365931 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.365911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:41:21.371510 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:41:21.371492 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:45:00.134767 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.134729 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723865-zb8gs"] Jul 07 13:45:00.139233 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.139214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:00.143905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.143879 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723865-zb8gs"] Jul 07 13:45:00.290643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.290611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lxf\" (UniqueName: \"kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf\") pod \"maas-api-key-cleanup-29723865-zb8gs\" (UID: \"77609b43-1ea6-42ec-b42b-03737a02b8f5\") " pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:00.391895 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.391829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lxf\" (UniqueName: \"kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf\") pod \"maas-api-key-cleanup-29723865-zb8gs\" (UID: \"77609b43-1ea6-42ec-b42b-03737a02b8f5\") " pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:00.400596 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.400565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lxf\" (UniqueName: \"kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf\") pod \"maas-api-key-cleanup-29723865-zb8gs\" (UID: \"77609b43-1ea6-42ec-b42b-03737a02b8f5\") " pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:00.451905 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.451880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:00.797697 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.797669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723865-zb8gs"] Jul 07 13:45:00.799665 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:45:00.799637 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77609b43_1ea6_42ec_b42b_03737a02b8f5.slice/crio-d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36 WatchSource:0}: Error finding container d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36: Status 404 returned error can't find the container with id d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36 Jul 07 13:45:00.802011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:00.801994 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:45:01.577619 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:01.577584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" event={"ID":"77609b43-1ea6-42ec-b42b-03737a02b8f5","Type":"ContainerStarted","Data":"d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36"} Jul 07 13:45:03.593265 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:03.593231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" event={"ID":"77609b43-1ea6-42ec-b42b-03737a02b8f5","Type":"ContainerStarted","Data":"768130de77d99ecfd757577ea5eec9254d2f56e52d9dfe7d24e7bade6227e5d2"} Jul 07 13:45:03.610166 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:03.610113 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" podStartSLOduration=1.251123577 podStartE2EDuration="3.610099135s" totalImagesPullingTime="2.358975558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:45:03.607013819 +0000 UTC m=+1722.802651021" watchObservedRunningTime="2026-07-07 13:45:03.610099135 +0000 UTC m=+1722.805736342" Jul 07 13:45:04.601066 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:04.601036 2577 generic.go:356] "Generic (PLEG): container finished" podID="77609b43-1ea6-42ec-b42b-03737a02b8f5" containerID="768130de77d99ecfd757577ea5eec9254d2f56e52d9dfe7d24e7bade6227e5d2" exitCode=0 Jul 07 13:45:04.601450 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:04.601087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" event={"ID":"77609b43-1ea6-42ec-b42b-03737a02b8f5","Type":"ContainerDied","Data":"768130de77d99ecfd757577ea5eec9254d2f56e52d9dfe7d24e7bade6227e5d2"} Jul 07 13:45:05.741778 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:05.741748 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:05.843316 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:05.843288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72lxf\" (UniqueName: \"kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf\") pod \"77609b43-1ea6-42ec-b42b-03737a02b8f5\" (UID: \"77609b43-1ea6-42ec-b42b-03737a02b8f5\") " Jul 07 13:45:05.845376 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:05.845350 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf" (OuterVolumeSpecName: "kube-api-access-72lxf") pod "77609b43-1ea6-42ec-b42b-03737a02b8f5" (UID: "77609b43-1ea6-42ec-b42b-03737a02b8f5"). InnerVolumeSpecName "kube-api-access-72lxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:45:05.944698 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:05.944642 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72lxf\" (UniqueName: \"kubernetes.io/projected/77609b43-1ea6-42ec-b42b-03737a02b8f5-kube-api-access-72lxf\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\"" Jul 07 13:45:06.614079 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:06.614048 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" Jul 07 13:45:06.614287 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:06.614077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723865-zb8gs" event={"ID":"77609b43-1ea6-42ec-b42b-03737a02b8f5","Type":"ContainerDied","Data":"d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36"} Jul 07 13:45:06.614287 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:45:06.614158 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d779ea48a0d4b06097916c6591ce883a023e5a6e58ed6e0b43b132ffdc692f36" Jul 07 13:46:21.398528 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.398425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:46:21.403681 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.401910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:46:21.408134 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.408112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:46:21.408917 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.408896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:46:21.412201 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.412170 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:46:21.417653 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:46:21.417629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:51:21.442500 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.442395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:51:21.446412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.446390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:51:21.452942 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.452920 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:51:21.453670 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.453643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:51:21.457271 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.457254 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:51:21.464068 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:51:21.464052 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:56:21.485833 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.485721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:56:21.489398 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.489372 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:56:21.495926 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.495908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:56:21.499782 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.499763 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:56:21.502930 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.502903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:56:21.508713 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:56:21.508694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pkcmn_06e902d4-0cd8-43ab-a74d-5e8cff5b96b1/ovn-acl-logging/0.log" Jul 07 13:57:09.700669 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:09.700639 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5987ddb7b4-kv7bd_7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c/authorino/0.log" Jul 07 13:57:14.554175 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:14.554141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4hdlb_6010ceb6-2b77-4f88-83e6-3981800e5180/manager/0.log" Jul 07 13:57:14.681314 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:14.681289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2cxgf_e6492719-eeff-45c6-9fce-0bf21be9c8b9/manager/0.log" Jul 07 13:57:14.807364 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:14.807299 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-57c77f8f76-g448b_6bb07e1f-ccb6-4f47-afe7-33d03fcd0688/maas-api/0.log" Jul 07 13:57:15.064181 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.064105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723865-zb8gs_77609b43-1ea6-42ec-b42b-03737a02b8f5/cleanup/0.log" Jul 07 13:57:15.201303 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.201276 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-94cc7fdf5-mpgrz_9947b744-c6f1-46ba-8abe-be7c490ba62a/manager/0.log" Jul 07 13:57:15.316361 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.316297 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ndhpb_315c9774-e951-451e-a6fd-e123171f5c18/server/0.log" Jul 07 13:57:15.446105 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.446079 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fj7ms_9ab99f60-1f9c-4df1-9ce8-e38c722f7a69/manager/0.log" Jul 07 13:57:15.702700 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.702672 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fbc88fbc-rqjns_7efa4a64-63d2-4481-832e-0c3a9d624ab1/copy-manifests/0.log" Jul 07 13:57:15.708100 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:15.708081 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fbc88fbc-rqjns_7efa4a64-63d2-4481-832e-0c3a9d624ab1/manager/0.log" Jul 07 13:57:16.012233 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.012150 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-npczk_334fc259-7570-40cd-8294-1d50d1e929ca/postgres/0.log" Jul 07 13:57:16.852348 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.852317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/util/0.log" Jul 07 13:57:16.858206 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.858166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/pull/0.log" Jul 07 13:57:16.863604 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.863587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/extract/0.log" Jul 07 13:57:16.981641 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.981616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/util/0.log" Jul 07 13:57:16.986550 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.986533 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/pull/0.log" Jul 07 13:57:16.991419 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:16.991391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/extract/0.log" Jul 07 13:57:17.112649 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.112590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/util/0.log" Jul 07 13:57:17.117694 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.117668 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/pull/0.log" Jul 07 13:57:17.122637 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.122619 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/extract/0.log" Jul 07 13:57:17.245796 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.245775 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/util/0.log" Jul 07 13:57:17.251146 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.251130 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/pull/0.log" Jul 07 13:57:17.256451 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.256431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/extract/0.log" Jul 07 13:57:17.381735 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.381665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5987ddb7b4-kv7bd_7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c/authorino/0.log" Jul 07 13:57:17.505475 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.505456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cx24r_347ec94b-5506-43a4-8aa4-4699a67d3c69/manager/0.log" Jul 07 13:57:17.629293 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.629271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z4d9r_1b3de95d-8336-4662-a8f0-05a43774b228/manager/0.log" Jul 07 13:57:17.864279 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.864253 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72nfb_73ff743e-a27c-40ba-a58b-30e536ea35ca/registry-server/0.log" Jul 07 13:57:17.987534 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:17.987515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rv984_310a6808-2d04-4009-a703-317e2852da2b/manager/0.log" Jul 07 13:57:18.843949 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:18.843919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577c5f8c7-4jhjv_5b0daae9-0329-4e0b-a713-73e12266207d/kube-auth-proxy/0.log" Jul 07 13:57:19.088405 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:19.088378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/1.log" Jul 07 13:57:19.345935 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:19.345906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n8mxd_20c1ec57-7265-4125-8a84-256656b119f7/payload-processing/0.log" Jul 07 13:57:19.466208 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:19.466170 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5874b88bf5-twgml_b17f6e88-5a54-4b02-96b2-28788c73a2ad/router/0.log" Jul 07 13:57:19.829009 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:19.828927 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sm9hs_30f6b9c8-1791-45f4-a169-ebd352b28d51/main/0.log" Jul 07 13:57:20.067250 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:20.067224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lczx4_ab72d0c8-b007-4751-8c59-0b6c3e218d35/main/0.log" Jul 07 13:57:20.310596 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:20.310567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8k67w_2c30ada8-2066-4c16-9f07-642068cf870e/main/0.log" Jul 07 13:57:27.788040 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:27.787990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-69bps_50ce6155-474e-4f48-b121-f02cc920ce9a/global-pull-secret-syncer/0.log" Jul 07 13:57:27.948182 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:27.948153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cx68l_4ddc2fa0-10aa-40a1-96eb-56064b6a187f/konnectivity-agent/0.log" Jul 07 13:57:28.006110 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:28.006085 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-128.ec2.internal_80af575249a2d128086706deb675b402/haproxy/0.log" Jul 07 13:57:32.874800 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.874737 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/extract/0.log" Jul 07 13:57:32.896183 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.896158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/util/0.log" Jul 07 13:57:32.914484 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.914465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qpq42_dbab0f1e-dda5-4a88-9ad5-1f1c73cc70ab/pull/0.log" Jul 07 13:57:32.938762 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.938739 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/extract/0.log" Jul 07 13:57:32.958210 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.958173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/util/0.log" Jul 07 13:57:32.975135 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:32.975114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cjx54_1fb6ddfd-e5eb-4f5a-a07c-9e969f96b3ca/pull/0.log" Jul 07 13:57:33.001243 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.001213 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/extract/0.log" Jul 07 13:57:33.022068 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.022053 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/util/0.log" Jul 07 13:57:33.042499 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.042482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lsh8j_9d02c094-c344-47cd-8564-ea4040006009/pull/0.log" Jul 07 13:57:33.066868 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.066827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/extract/0.log" Jul 07 13:57:33.094808 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.094790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/util/0.log" Jul 07 13:57:33.131648 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.131597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19xzpr_8368c41d-1c33-488f-af32-2d2006fb4cc1/pull/0.log" Jul 07 13:57:33.388445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.388378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5987ddb7b4-kv7bd_7a13e1f7-1e2d-4334-b8ee-1f0a1cb4625c/authorino/0.log" Jul 07 13:57:33.421611 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.421587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cx24r_347ec94b-5506-43a4-8aa4-4699a67d3c69/manager/0.log" Jul 07 13:57:33.475157 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.475135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z4d9r_1b3de95d-8336-4662-a8f0-05a43774b228/manager/0.log" Jul 07 13:57:33.545527 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.545503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72nfb_73ff743e-a27c-40ba-a58b-30e536ea35ca/registry-server/0.log" Jul 07 13:57:33.652858 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:33.652784 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rv984_310a6808-2d04-4009-a703-317e2852da2b/manager/0.log" Jul 07 13:57:35.453438 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.453413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/alertmanager/0.log" Jul 07 13:57:35.478415 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.478390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/config-reloader/0.log" Jul 07 13:57:35.502054 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.502033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/kube-rbac-proxy-web/0.log" Jul 07 13:57:35.520518 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.520498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/kube-rbac-proxy/0.log" Jul 07 13:57:35.539535 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.539460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/kube-rbac-proxy-metric/0.log" Jul 07 13:57:35.558903 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.558873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/prom-label-proxy/0.log" Jul 07 13:57:35.578267 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.578229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1d2fad69-576f-4d07-ba36-e5a7a95b8fbe/init-config-reloader/0.log" Jul 07 13:57:35.617716 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.617678 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/1.log" Jul 07 13:57:35.699219 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.699177 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pjz4p_ac9b555d-20fd-4a11-91f1-b9b830e9ef44/cluster-monitoring-operator/0.log" Jul 07 13:57:35.816051 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.815995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-zlph4_a9220665-816d-40ea-abf1-9e50d1d77f66/monitoring-plugin/0.log" Jul 07 13:57:35.931613 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.931591 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhd65_993ab59f-113c-4213-b103-efe69a9ece9f/node-exporter/0.log" Jul 07 13:57:35.949516 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.949496 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhd65_993ab59f-113c-4213-b103-efe69a9ece9f/kube-rbac-proxy/0.log" Jul 07 13:57:35.971405 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:35.971385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhd65_993ab59f-113c-4213-b103-efe69a9ece9f/init-textfile/0.log" Jul 07 13:57:36.339071 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:36.339048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd485cbd-9ggrd_0e45717a-c2e9-4d5a-8881-6d082f54fe4f/telemeter-client/0.log" Jul 07 13:57:36.359160 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:36.359140 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd485cbd-9ggrd_0e45717a-c2e9-4d5a-8881-6d082f54fe4f/reload/0.log" Jul 07 13:57:36.377597 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:36.377576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcd485cbd-9ggrd_0e45717a-c2e9-4d5a-8881-6d082f54fe4f/kube-rbac-proxy/0.log" Jul 07 13:57:37.626011 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:37.625983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-n9z84_f1ab24e1-6dba-4a85-83da-42b7b3692268/networking-console-plugin/0.log" Jul 07 13:57:38.207530 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.207501 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r"] Jul 07 13:57:38.207932 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.207920 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77609b43-1ea6-42ec-b42b-03737a02b8f5" containerName="cleanup" Jul 07 13:57:38.207978 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.207933 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77609b43-1ea6-42ec-b42b-03737a02b8f5" containerName="cleanup" Jul 07 13:57:38.208031 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.208021 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77609b43-1ea6-42ec-b42b-03737a02b8f5" containerName="cleanup" Jul 07 13:57:38.211393 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.211367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.214142 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.213983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4dq5n\"/\"kube-root-ca.crt\"" Jul 07 13:57:38.214142 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.214116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4dq5n\"/\"default-dockercfg-5mq4r\"" Jul 07 13:57:38.215422 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.215400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4dq5n\"/\"openshift-service-ca.crt\"" Jul 07 13:57:38.219427 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.219407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r"] Jul 07 13:57:38.275380 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.275345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/1.log" Jul 07 13:57:38.279625 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.279607 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-njxlf_2c891437-b0d1-4110-862c-e7814184f260/console-operator/2.log" Jul 07 13:57:38.332246 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.332224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-lib-modules\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.332352 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.332273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b8b7\" (UniqueName: \"kubernetes.io/projected/e34ba8bb-d4bf-4a09-b4df-feeb17367271-kube-api-access-9b8b7\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.332421 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.332386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-sys\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.332484 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.332416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-podres\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.332484 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.332455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-proc\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433544 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-proc\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-lib-modules\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b8b7\" (UniqueName: \"kubernetes.io/projected/e34ba8bb-d4bf-4a09-b4df-feeb17367271-kube-api-access-9b8b7\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433643 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-proc\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-sys\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-podres\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-sys\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433812 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-podres\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.433961 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.433809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e34ba8bb-d4bf-4a09-b4df-feeb17367271-lib-modules\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.442128 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.442102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b8b7\" (UniqueName: \"kubernetes.io/projected/e34ba8bb-d4bf-4a09-b4df-feeb17367271-kube-api-access-9b8b7\") pod \"perf-node-gather-daemonset-xzs4r\" (UID: \"e34ba8bb-d4bf-4a09-b4df-feeb17367271\") " pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.522892 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.522838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:38.659319 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.659290 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r"] Jul 07 13:57:38.660338 ip-10-0-131-128 kubenswrapper[2577]: W0707 13:57:38.660311 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode34ba8bb_d4bf_4a09_b4df_feeb17367271.slice/crio-04af921599481d33bfb4e3eef3b9d89db520d23b167710522407b9a8174fa168 WatchSource:0}: Error finding container 04af921599481d33bfb4e3eef3b9d89db520d23b167710522407b9a8174fa168: Status 404 returned error can't find the container with id 04af921599481d33bfb4e3eef3b9d89db520d23b167710522407b9a8174fa168 Jul 07 13:57:38.838638 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:38.838612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d5747bd69-rh72z_c7afa261-c557-48e9-827d-4c38b0fbdba7/console/0.log" Jul 07 13:57:39.247043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:39.246965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" event={"ID":"e34ba8bb-d4bf-4a09-b4df-feeb17367271","Type":"ContainerStarted","Data":"51b581199f8f6aeec069541e3548e9bf9d30e1c2c75d073e4d12b53fb5e333fe"} Jul 07 13:57:39.247043 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:39.247019 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:39.247242 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:39.247045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" event={"ID":"e34ba8bb-d4bf-4a09-b4df-feeb17367271","Type":"ContainerStarted","Data":"04af921599481d33bfb4e3eef3b9d89db520d23b167710522407b9a8174fa168"} Jul 07 13:57:39.266033 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:39.265989 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" podStartSLOduration=1.2659751369999999 podStartE2EDuration="1.265975137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:57:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:57:39.263917845 +0000 UTC m=+2478.459555076" watchObservedRunningTime="2026-07-07 13:57:39.265975137 +0000 UTC m=+2478.461612345" Jul 07 13:57:39.454502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:39.454479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-67jfx_8b65ba20-e18a-43f1-a9ec-cf69b6a4b3e4/volume-data-source-validator/0.log" Jul 07 13:57:40.429512 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:40.429484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9jzp_383c811f-4e82-42cc-9273-0c8b0086710f/dns/0.log" Jul 07 13:57:40.448056 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:40.448034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9jzp_383c811f-4e82-42cc-9273-0c8b0086710f/kube-rbac-proxy/0.log" Jul 07 13:57:40.557180 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:40.557152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2pc5c_a5e5170a-098f-448e-996d-b7c039c2b3a9/dns-node-resolver/0.log" Jul 07 13:57:41.163065 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:41.163033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m255s_43a92b87-4acc-4aec-99f6-f75ea3ae7de9/node-ca/0.log" Jul 07 13:57:42.300335 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:42.300310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577c5f8c7-4jhjv_5b0daae9-0329-4e0b-a713-73e12266207d/kube-auth-proxy/0.log" Jul 07 13:57:42.347404 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:42.347378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/0.log" Jul 07 13:57:42.377020 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:42.376997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/1.log" Jul 07 13:57:42.457611 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:42.457582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n8mxd_20c1ec57-7265-4125-8a84-256656b119f7/payload-processing/0.log" Jul 07 13:57:42.476811 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:42.476791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5874b88bf5-twgml_b17f6e88-5a54-4b02-96b2-28788c73a2ad/router/0.log" Jul 07 13:57:43.133365 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.133328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-69ffc_61b4e213-d827-4b00-ad59-7ff002b64d8a/serve-healthcheck-canary/0.log" Jul 07 13:57:43.606125 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.606097 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8k5xf_877f0aa1-2394-4755-b32c-3ec26ae972a9/insights-operator/0.log" Jul 07 13:57:43.606817 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.606798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8k5xf_877f0aa1-2394-4755-b32c-3ec26ae972a9/insights-operator/1.log" Jul 07 13:57:43.739689 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.739666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6ms_3bc9d0fe-adbd-4425-9984-485d82521781/kube-rbac-proxy/0.log" Jul 07 13:57:43.756854 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.756839 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6ms_3bc9d0fe-adbd-4425-9984-485d82521781/exporter/0.log" Jul 07 13:57:43.774522 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:43.774503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6ms_3bc9d0fe-adbd-4425-9984-485d82521781/extractor/0.log" Jul 07 13:57:45.263628 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:45.263599 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4dq5n/perf-node-gather-daemonset-xzs4r" Jul 07 13:57:45.902647 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:45.902620 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4hdlb_6010ceb6-2b77-4f88-83e6-3981800e5180/manager/0.log" Jul 07 13:57:46.035483 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.035458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2cxgf_e6492719-eeff-45c6-9fce-0bf21be9c8b9/manager/0.log" Jul 07 13:57:46.066202 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.066167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-57c77f8f76-g448b_6bb07e1f-ccb6-4f47-afe7-33d03fcd0688/maas-api/0.log" Jul 07 13:57:46.102740 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.102718 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723865-zb8gs_77609b43-1ea6-42ec-b42b-03737a02b8f5/cleanup/0.log" Jul 07 13:57:46.198208 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.198131 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-94cc7fdf5-mpgrz_9947b744-c6f1-46ba-8abe-be7c490ba62a/manager/0.log" Jul 07 13:57:46.215682 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.215661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ndhpb_315c9774-e951-451e-a6fd-e123171f5c18/server/0.log" Jul 07 13:57:46.278784 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.278765 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fj7ms_9ab99f60-1f9c-4df1-9ce8-e38c722f7a69/manager/0.log" Jul 07 13:57:46.350607 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.350586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fbc88fbc-rqjns_7efa4a64-63d2-4481-832e-0c3a9d624ab1/manager/0.log" Jul 07 13:57:46.368410 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.368394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fbc88fbc-rqjns_7efa4a64-63d2-4481-832e-0c3a9d624ab1/copy-manifests/0.log" Jul 07 13:57:46.527166 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:46.527098 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-npczk_334fc259-7570-40cd-8294-1d50d1e929ca/postgres/0.log" Jul 07 13:57:48.105551 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:48.105487 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9f6hj_c3bc2550-ae5d-4fa3-bfa8-4196c6f23a33/openshift-lws-operator/0.log" Jul 07 13:57:48.857445 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:48.857416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577c5f8c7-4jhjv_5b0daae9-0329-4e0b-a713-73e12266207d/kube-auth-proxy/0.log" Jul 07 13:57:48.888830 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:48.888785 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/0.log" Jul 07 13:57:48.916030 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:48.916005 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/1.log" Jul 07 13:57:48.985412 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:48.985390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n8mxd_20c1ec57-7265-4125-8a84-256656b119f7/payload-processing/0.log" Jul 07 13:57:49.000992 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:49.000973 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5874b88bf5-twgml_b17f6e88-5a54-4b02-96b2-28788c73a2ad/router/0.log" Jul 07 13:57:50.403456 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:50.403426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577c5f8c7-4jhjv_5b0daae9-0329-4e0b-a713-73e12266207d/kube-auth-proxy/0.log" Jul 07 13:57:50.434330 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:50.434305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/0.log" Jul 07 13:57:50.462914 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:50.462879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-v885t_32cfb76f-aed7-4447-be4c-a43a9ec7248b/istio-proxy/1.log" Jul 07 13:57:50.527584 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:50.527559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-n8mxd_20c1ec57-7265-4125-8a84-256656b119f7/payload-processing/0.log" Jul 07 13:57:50.544709 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:50.544688 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5874b88bf5-twgml_b17f6e88-5a54-4b02-96b2-28788c73a2ad/router/0.log" Jul 07 13:57:53.471111 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:53.471070 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cjc42_19043063-7585-4e5c-81b6-06de25fb13eb/kube-storage-version-migrator-operator/1.log" Jul 07 13:57:53.472165 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:53.472143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cjc42_19043063-7585-4e5c-81b6-06de25fb13eb/kube-storage-version-migrator-operator/0.log" Jul 07 13:57:54.524428 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.524395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8crtf_f18c5b9d-5ed6-42ba-be8c-d53af50fe308/kube-multus/0.log" Jul 07 13:57:54.546245 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.546218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/kube-multus-additional-cni-plugins/0.log" Jul 07 13:57:54.564776 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.564759 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/egress-router-binary-copy/0.log" Jul 07 13:57:54.581877 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.581858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/cni-plugins/0.log" Jul 07 13:57:54.599665 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.599645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/bond-cni-plugin/0.log" Jul 07 13:57:54.617074 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.617051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/routeoverride-cni/0.log" Jul 07 13:57:54.635106 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.635085 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/whereabouts-cni-bincopy/0.log" Jul 07 13:57:54.654277 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:54.654258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gsqm_97b5df38-5aa2-4080-8485-5a8038a2534a/whereabouts-cni/0.log" Jul 07 13:57:55.048311 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:55.048285 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-htntq_8e89071b-1cee-41b0-8da7-55fc65345799/network-metrics-daemon/0.log" Jul 07 13:57:55.067502 ip-10-0-131-128 kubenswrapper[2577]: I0707 13:57:55.067479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-htntq_8e89071b-1cee-41b0-8da7-55fc65345799/kube-rbac-proxy/0.log"