Jul 01 18:27:22.635055 ip-10-0-135-235 systemd[1]: Starting Kubernetes Kubelet... Jul 01 18:27:23.058717 ip-10-0-135-235 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:23.058717 ip-10-0-135-235 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 18:27:23.058717 ip-10-0-135-235 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:23.058717 ip-10-0-135-235 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 18:27:23.058717 ip-10-0-135-235 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:23.059591 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.059484 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 18:27:23.062920 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062904 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.062920 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062919 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062923 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062926 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062929 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062931 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062934 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062936 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062939 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062941 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062944 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062946 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062949 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062951 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062953 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062956 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062959 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062961 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062963 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062966 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062969 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.062982 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062971 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062974 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062976 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062979 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062981 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062985 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062988 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062990 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062993 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062996 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.062999 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063001 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063003 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063006 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063008 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063011 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063013 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063017 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063020 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.063491 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063023 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063025 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063027 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063030 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063032 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063035 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063037 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063040 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063042 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063046 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063050 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063053 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063056 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063058 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063061 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063064 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063069 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063072 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063075 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.063960 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063078 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063081 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063083 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063086 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063089 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063092 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063094 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063097 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063100 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063102 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063104 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063108 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063111 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063113 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063116 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063118 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063121 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063123 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063125 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063128 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.064420 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063131 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063133 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063136 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063138 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063141 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063144 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063147 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063149 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063153 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063156 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063159 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063162 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063164 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063167 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063170 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063172 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063175 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063177 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063180 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063182 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.064936 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063930 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063937 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063940 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063944 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063946 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063949 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063952 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063955 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063957 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063961 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063965 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063968 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063970 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063973 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063975 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063978 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063981 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063983 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063986 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063989 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.065413 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063992 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063995 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.063998 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064001 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064003 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064006 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064008 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064010 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064013 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064015 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064018 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064020 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064022 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064025 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064028 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064030 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064032 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064034 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064038 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064041 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.065941 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064044 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064046 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064048 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064052 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064054 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064057 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064059 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064061 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064064 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064066 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064069 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064073 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064076 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064079 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064083 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064086 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064089 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064092 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064095 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.066432 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064097 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064102 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064104 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064107 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064109 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064112 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064114 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064117 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064119 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064121 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064123 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064126 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064129 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064131 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064134 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064137 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064139 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064141 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064144 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.066909 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064147 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064150 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064152 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064155 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064157 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064159 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064162 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064164 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064167 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064169 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064171 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064174 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064176 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064178 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064181 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064183 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064186 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064188 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064190 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.067412 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064193 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064528 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064532 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064535 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064538 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064543 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064547 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064550 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064554 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064557 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064559 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064562 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064577 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064580 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064584 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064587 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064590 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064592 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064595 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064598 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.067889 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064601 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064603 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064606 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064609 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064611 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064614 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064617 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064619 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064621 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064624 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064626 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064628 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064631 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064633 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064635 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064638 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064640 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064643 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064646 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.068377 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064649 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064653 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064656 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064658 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064661 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064663 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064666 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064668 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064670 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064673 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064675 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064677 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064680 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064682 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064685 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064687 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064689 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064692 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064694 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064697 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.068886 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064699 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064701 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064704 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064706 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064709 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064711 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064715 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064718 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064720 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064722 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064725 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064727 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064730 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064735 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064737 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064739 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064742 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064744 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064747 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064749 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.069369 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064751 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064754 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064756 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064758 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064761 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064763 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064765 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064768 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064770 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064773 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064775 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064777 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064797 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064800 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064804 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064808 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064812 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064814 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064824 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.069924 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064828 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.064830 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064893 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064899 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064906 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064910 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064916 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064919 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064923 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064927 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064930 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064933 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064937 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064940 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064943 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064946 2566 flags.go:64] FLAG: --cgroup-root="" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064949 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064952 2566 flags.go:64] FLAG: --client-ca-file="" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064954 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064957 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064961 2566 flags.go:64] FLAG: --cluster-domain="" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064964 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064967 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064970 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 18:27:23.070411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064973 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064977 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064979 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064982 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064985 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064988 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064991 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064993 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064996 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.064999 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065003 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065006 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065011 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065013 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065017 2566 flags.go:64] FLAG: --enable-server="true" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065020 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065025 2566 flags.go:64] FLAG: --event-burst="100" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065028 2566 flags.go:64] FLAG: --event-qps="50" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065031 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065033 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065036 2566 flags.go:64] FLAG: --eviction-hard="" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065039 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065042 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065045 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065048 2566 flags.go:64] FLAG: --eviction-soft="" Jul 01 18:27:23.071002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065051 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065053 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065056 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065058 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065061 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065064 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065066 2566 flags.go:64] FLAG: --feature-gates="" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065069 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065072 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065075 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065078 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065080 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065083 2566 flags.go:64] FLAG: --help="false" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065085 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065088 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065091 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065094 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065097 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065100 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065103 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065106 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065109 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065112 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 18:27:23.071588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065115 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065118 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065121 2566 flags.go:64] FLAG: --kube-reserved="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065123 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065126 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065129 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065131 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065134 2566 flags.go:64] FLAG: --lock-file="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065137 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065139 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065142 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065147 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065150 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065152 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065155 2566 flags.go:64] FLAG: --logging-format="text" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065157 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065160 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065163 2566 flags.go:64] FLAG: --manifest-url="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065166 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065170 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065172 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065176 2566 flags.go:64] FLAG: --max-pods="110" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065179 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065181 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065184 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 18:27:23.072179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065186 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065189 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065192 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065196 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065202 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065206 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065209 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065211 2566 flags.go:64] FLAG: --pod-cidr="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065215 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065219 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065222 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065225 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065228 2566 flags.go:64] FLAG: --port="10250" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065231 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065233 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00fd5c9ebbfc9e1df" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065236 2566 flags.go:64] FLAG: --qos-reserved="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065239 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065242 2566 flags.go:64] FLAG: --register-node="true" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065244 2566 flags.go:64] FLAG: --register-with-taints="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065248 2566 flags.go:64] FLAG: --registry-burst="10" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065250 2566 flags.go:64] FLAG: --registry-qps="5" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065253 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065255 2566 flags.go:64] FLAG: --reserved-memory="" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065259 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065262 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 18:27:23.072774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065265 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065268 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065270 2566 flags.go:64] FLAG: --runonce="false" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065273 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065275 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065278 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065281 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065283 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065286 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065289 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065293 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065296 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065299 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065301 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065304 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065307 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065310 2566 flags.go:64] FLAG: --system-cgroups="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065313 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065317 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065320 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065323 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065326 2566 flags.go:64] FLAG: --tls-min-version="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065329 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065331 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065334 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 18:27:23.073505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065336 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065339 2566 flags.go:64] FLAG: --v="2" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065342 2566 flags.go:64] FLAG: --version="false" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065346 2566 flags.go:64] FLAG: --vmodule="" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065349 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065352 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065458 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065462 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065465 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065467 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065470 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065473 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065475 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065478 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065480 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065483 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065485 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065488 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065491 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065493 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065497 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.074202 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065499 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065502 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065504 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065507 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065509 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065512 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065514 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065517 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065519 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065521 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065524 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065526 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065528 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065531 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065533 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065535 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065538 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065540 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065543 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065545 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.074801 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065548 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065550 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065553 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065555 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065557 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065560 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065562 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065564 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065568 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065570 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065573 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065576 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065579 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065581 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065584 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065586 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065589 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065592 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065594 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065596 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.075447 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065599 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065601 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065604 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065606 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065610 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065614 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065617 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065620 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065623 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065626 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065628 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065630 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065633 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065635 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065638 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065640 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065642 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065645 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065647 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.076075 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065649 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065653 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065657 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065660 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065664 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065667 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065669 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065671 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065674 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065676 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065679 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065681 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065684 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065686 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065689 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065691 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065694 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065696 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065698 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.076662 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065701 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065703 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065705 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065708 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065710 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.065713 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.065718 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.071871 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.071884 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.071896 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.071904 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071958 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071963 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071967 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071970 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.077178 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071973 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071976 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071979 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071981 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071984 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071987 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071989 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071992 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071995 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.071997 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072000 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072002 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072005 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072007 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072010 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072012 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072015 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072017 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072019 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072022 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.077584 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072025 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072028 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072032 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072036 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072039 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072042 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072045 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072048 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072051 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072054 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072056 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072059 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072062 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072064 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072067 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072070 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072072 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072075 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072078 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.078155 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072080 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072083 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072086 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072089 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072091 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072094 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072096 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072101 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072104 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072106 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072108 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072111 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072113 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072116 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072119 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072121 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072124 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072127 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.078675 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072129 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072132 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072134 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072137 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072139 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072141 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072144 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072146 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072148 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072151 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072154 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072156 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072158 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072161 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072163 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072165 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072168 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072171 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072173 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072175 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.079193 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072178 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072180 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072183 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072186 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072188 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072191 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072195 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072199 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072202 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072204 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072207 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072210 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072212 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072215 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072217 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072220 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.079679 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072223 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.072228 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072346 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072351 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072354 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072356 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072359 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072362 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072364 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072367 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072369 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072372 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072374 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072377 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072380 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:23.080304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072382 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072384 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072387 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072389 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072391 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072393 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072396 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072399 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072401 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072404 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072406 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072408 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072411 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072415 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072418 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072421 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072425 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072428 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072431 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:23.081084 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072434 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072437 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072439 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072442 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072444 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072447 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072449 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072452 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072454 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072457 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072459 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072461 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072464 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072466 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072469 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072471 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072473 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072476 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072478 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072480 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:23.081897 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072482 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072485 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072487 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072490 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072492 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072495 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072497 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072499 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072502 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072504 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072507 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072509 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072511 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072514 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072516 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072518 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072521 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072523 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072525 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072528 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:23.082500 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072530 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072532 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072535 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072537 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072539 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072542 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072544 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072547 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072549 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072551 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072553 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072556 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072558 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072561 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072563 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072565 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072568 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072570 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072573 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:23.083052 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072575 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072578 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072581 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072583 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072586 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072588 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072591 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:23.072593 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.072597 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.072687 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.076075 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.077631 2566 server.go:1019] "Starting client certificate rotation" Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.077728 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:23.083508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.077760 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:23.083868 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.080411 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:23.083868 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.082111 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:23.090682 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.090667 2566 log.go:25] "Validated CRI v1 runtime API" Jul 01 18:27:23.092762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.092747 2566 log.go:25] "Validated CRI v1 image API" Jul 01 18:27:23.093554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.093534 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 18:27:23.098446 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.098427 2566 fs.go:135] Filesystem UUIDs: map[432194ec-ced7-4fc3-957c-4c940139d998:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d7404872-6ff1-48f2-98c9-70455766e3f3:/dev/nvme0n1p3] Jul 01 18:27:23.098510 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.098443 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 18:27:23.103476 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.103375 2566 manager.go:216] Machine: {Timestamp:2026-07-01 18:27:23.102897499 +0000 UTC m=+0.352780603 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3166877 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6483863b2ef559fee339098089b7 SystemUUID:ec2a6483-863b-2ef5-59fe-e339098089b7 BootID:7cba1c2b-5ab1-4022-b76b-325c1c2fdbdb Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:c9:92:8c:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:c9:92:8c:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:b7:53:27:4c:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 18:27:23.103476 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.103473 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 18:27:23.103587 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.103539 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 18:27:23.106278 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.106253 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 18:27:23.106398 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.106281 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 18:27:23.107016 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.107006 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 18:27:23.107048 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.107019 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 18:27:23.107048 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.107027 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:23.107048 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.107045 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:23.107718 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.107709 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 18:27:23.111279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111257 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:23.111380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111367 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:23.111488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111479 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 18:27:23.111530 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111507 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 01 18:27:23.111530 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111516 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 18:27:23.111530 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111529 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 18:27:23.111625 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111538 2566 kubelet.go:398] "Adding apiserver pod source" Jul 01 18:27:23.111625 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111552 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 18:27:23.111869 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111855 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:23.111930 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.111873 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:23.114818 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.114800 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 18:27:23.116229 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116211 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 18:27:23.116287 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116245 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 18:27:23.116853 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116838 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116867 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116875 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116881 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116895 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116901 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116909 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 18:27:23.116912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116914 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 18:27:23.117096 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116922 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 18:27:23.117096 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116927 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 18:27:23.117096 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116941 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 18:27:23.117096 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.116947 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 18:27:23.118352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.118329 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 18:27:23.118352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.118354 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 18:27:23.121647 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.121633 2566 server.go:1268] "Started kubelet" Jul 01 18:27:23.121763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.121712 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 18:27:23.121763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.121734 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 18:27:23.121932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.121799 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 18:27:23.122408 ip-10-0-135-235 systemd[1]: Started Kubernetes Kubelet. Jul 01 18:27:23.122568 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.122550 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 18:27:23.122651 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.122550 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 18:27:23.122706 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.122665 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 18:27:23.122706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.122686 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 18:27:23.123958 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.123943 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 01 18:27:23.127151 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.127134 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 18:27:23.128020 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128002 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 18:27:23.128020 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128017 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:23.128224 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.128207 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.128714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128666 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 18:27:23.128812 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128769 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 18:27:23.128812 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128802 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 18:27:23.128914 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128815 2566 factory.go:55] Registering systemd factory Jul 01 18:27:23.128914 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128838 2566 factory.go:223] Registration of the systemd container factory successfully Jul 01 18:27:23.129008 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128930 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 01 18:27:23.129008 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.128938 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 01 18:27:23.129072 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129059 2566 factory.go:153] Registering CRI-O factory Jul 01 18:27:23.129119 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129072 2566 factory.go:223] Registration of the crio container factory successfully Jul 01 18:27:23.129119 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129117 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 18:27:23.129196 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129136 2566 factory.go:103] Registering Raw factory Jul 01 18:27:23.129196 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129151 2566 manager.go:1196] Started watching for new ooms in manager Jul 01 18:27:23.129577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.129561 2566 manager.go:349] Starting recovery of all containers Jul 01 18:27:23.132260 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.132039 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 18:27:23.132528 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.132508 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 18:27:23.133139 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.132081 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18be3dcaa97e31a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-01 18:27:23.121602984 +0000 UTC m=+0.371486087,LastTimestamp:2026-07-01 18:27:23.121602984 +0000 UTC m=+0.371486087,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}" Jul 01 18:27:23.140072 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.140052 2566 manager.go:354] Recovery completed Jul 01 18:27:23.145164 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.145153 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.146945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.146928 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.147029 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.146963 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.147029 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.146978 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.147464 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.147443 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 18:27:23.147464 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.147455 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.147464 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.147459 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 18:27:23.147556 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.147479 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:23.148240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.148224 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.148310 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.148250 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.148310 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.148263 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.149402 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.149346 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18be3dcaab00e882 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-01 18:27:23.14694669 +0000 UTC m=+0.396829801,LastTimestamp:2026-07-01 18:27:23.14694669 +0000 UTC m=+0.396829801,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}" Jul 01 18:27:23.149603 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.149593 2566 policy_none.go:49] "None policy: Start" Jul 01 18:27:23.149638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.149608 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 18:27:23.149638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.149619 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 18:27:23.151629 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.151619 2566 policy_none.go:47] "Start" Jul 01 18:27:23.160977 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.160918 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18be3dcaab014508 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-235.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-01 18:27:23.146970376 +0000 UTC m=+0.396853486,LastTimestamp:2026-07-01 18:27:23.146970376 +0000 UTC m=+0.396853486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}" Jul 01 18:27:23.172865 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.172844 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xchr" Jul 01 18:27:23.173616 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.173558 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18be3dcaab017ac8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-235.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-01 18:27:23.146984136 +0000 UTC m=+0.396867246,LastTimestamp:2026-07-01 18:27:23.146984136 +0000 UTC m=+0.396867246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}" Jul 01 18:27:23.179680 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.179665 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xchr" Jul 01 18:27:23.185355 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.185294 2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-235.ec2.internal.18be3dcaab00e882\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18be3dcaab00e882 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-01 18:27:23.14694669 +0000 UTC m=+0.396829801,LastTimestamp:2026-07-01 18:27:23.14823745 +0000 UTC m=+0.398120554,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}" Jul 01 18:27:23.185437 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185383 2566 manager.go:337] "Starting Device Plugin manager" Jul 01 18:27:23.185478 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.185460 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 18:27:23.185478 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185472 2566 server.go:87] "Starting device plugin registration server" Jul 01 18:27:23.185715 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185699 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 18:27:23.186115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185716 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 18:27:23.186115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185910 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 18:27:23.186115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185980 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 18:27:23.186115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.185989 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 18:27:23.187131 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.187108 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 18:27:23.187210 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.187163 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.198309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.198274 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 18:27:23.199565 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.199548 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 18:27:23.199607 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.199593 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 18:27:23.199650 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.199614 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 18:27:23.199687 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.199656 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 18:27:23.202136 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.202119 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:23.285832 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.285809 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.287271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.287257 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.287328 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.287285 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.287328 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.287295 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.287328 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.287316 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.294657 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.294643 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.294723 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.294664 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-235.ec2.internal\": node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.300709 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.300687 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"] Jul 01 18:27:23.300800 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.300733 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.301387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.301374 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.301467 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.301400 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.301467 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.301414 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.303614 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.303599 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.303716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.303699 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.303766 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.303739 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.304248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304232 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.304320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304263 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.304320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304268 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.304320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304277 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.304320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304287 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.304320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.304296 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.306332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.306316 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.306399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.306347 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:23.307022 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.307009 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:23.307087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.307031 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:23.307087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.307045 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:23.323937 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.323918 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.329827 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.329813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ba0a29899ef0b7c5ebc60f477e47a02-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"1ba0a29899ef0b7c5ebc60f477e47a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.329886 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.329838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.329886 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.329856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.337317 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.337297 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.ec2.internal\" not found" node="ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.341635 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.341619 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.ec2.internal\" not found" node="ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.424577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.424560 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.430893 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.430946 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.430946 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430916 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ba0a29899ef0b7c5ebc60f477e47a02-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"1ba0a29899ef0b7c5ebc60f477e47a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.431021 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ba0a29899ef0b7c5ebc60f477e47a02-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"1ba0a29899ef0b7c5ebc60f477e47a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.431021 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.431021 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.430973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed95cd50bbe285ed8e8b0ce78fda50a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"2ed95cd50bbe285ed8e8b0ce78fda50a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.525056 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.525023 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.625779 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.625724 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.640224 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.640206 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.646290 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:23.646273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:23.726080 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.726052 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.826569 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.826544 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:23.928556 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:23.928495 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:24.036110 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:24.036084 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:24.076637 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.076607 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 18:27:24.077066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.076760 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:27:24.136211 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:24.136184 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:24.184576 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.184487 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:22:23 +0000 UTC" deadline="2027-11-28 16:15:48.62823796 +0000 UTC" Jul 01 18:27:24.184576 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.184532 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12357h48m24.443709953s" Jul 01 18:27:24.219844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.219817 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:24.220925 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.220909 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:24.221011 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.220943 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:24.221011 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.220955 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:24.236911 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:24.236888 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:24.263352 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:24.263320 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba0a29899ef0b7c5ebc60f477e47a02.slice/crio-73fe7da58ae261e6bf0102884ed88e64ffffac67afcbac93016de76a86772e48 WatchSource:0}: Error finding container 73fe7da58ae261e6bf0102884ed88e64ffffac67afcbac93016de76a86772e48: Status 404 returned error can't find the container with id 73fe7da58ae261e6bf0102884ed88e64ffffac67afcbac93016de76a86772e48 Jul 01 18:27:24.268418 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.268404 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:27:24.274037 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:24.274018 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed95cd50bbe285ed8e8b0ce78fda50a.slice/crio-bb9ed967fd694a05bf4b2f319e1f63393edb8e343ff8b03a25fb08dc67586d5e WatchSource:0}: Error finding container bb9ed967fd694a05bf4b2f319e1f63393edb8e343ff8b03a25fb08dc67586d5e: Status 404 returned error can't find the container with id bb9ed967fd694a05bf4b2f319e1f63393edb8e343ff8b03a25fb08dc67586d5e Jul 01 18:27:24.296966 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.296944 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:24.337975 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:24.337946 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found" Jul 01 18:27:24.388831 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.388810 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:24.429415 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.429387 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" Jul 01 18:27:24.440268 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.440216 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:24.441610 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.441596 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" Jul 01 18:27:24.454389 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.454369 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:24.676618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:24.676590 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:25.114631 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.114601 2566 apiserver.go:52] "Watching apiserver" Jul 01 18:27:25.122549 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.122519 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 18:27:25.123118 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.123089 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-p8df6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t","openshift-dns/node-resolver-xvvtc","openshift-image-registry/node-ca-wjqw8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal","openshift-multus/network-metrics-daemon-kvf8h","openshift-network-diagnostics/network-check-target-sz29l","kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wb6vq","openshift-multus/multus-2dbpb","openshift-multus/multus-additional-cni-plugins-dlz2z","openshift-network-operator/iptables-alerter-g77vt","openshift-ovn-kubernetes/ovnkube-node-xxmfj","kube-system/global-pull-secret-syncer-lkhbg"] Jul 01 18:27:25.126221 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.126200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:25.126330 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.126281 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:25.128439 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.128416 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.129320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.129302 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:25.131466 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.131446 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pfxfn\"" Jul 01 18:27:25.131823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.131799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 18:27:25.131823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.131819 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.132059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.132041 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 18:27:25.132130 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.132070 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.132194 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.132049 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.132249 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.132201 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 18:27:25.134380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.134354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.134902 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.134883 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.135118 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.135099 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.135624 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.135603 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5chw\"" Jul 01 18:27:25.136702 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.136684 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.136791 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.136761 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:25.137493 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.137473 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.137493 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.137485 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf7xc\"" Jul 01 18:27:25.137666 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.137651 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.137774 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.137756 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 18:27:25.139355 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.139270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.139355 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.139332 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:25.140583 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.140518 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:25.142221 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:25.142317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-system-cni-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-os-release\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-cnibin\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426dm\" (UniqueName: \"kubernetes.io/projected/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-kube-api-access-426dm\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-hosts-file\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.142702 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ztn\" (UniqueName: \"kubernetes.io/projected/540758a6-32b9-47b3-8967-f57fd6dfad7d-kube-api-access-t7ztn\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.142702 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-tmp-dir\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.142702 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.142562 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.144675 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.144600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.145301 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.145274 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8ztt\"" Jul 01 18:27:25.145400 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.145279 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.145729 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.145708 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.147429 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.147410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.150527 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.150505 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-98v95\"" Jul 01 18:27:25.150603 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.150591 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 18:27:25.150826 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.150810 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 18:27:25.150910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.150505 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 18:27:25.151269 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.151246 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.151823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.151799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 18:27:25.151960 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.151907 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.152910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.152270 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.152910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.152622 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 18:27:25.153074 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.153055 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.154084 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.154062 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.154762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.154743 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xvt8c\"" Jul 01 18:27:25.155715 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.155693 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.156303 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.156251 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 18:27:25.156407 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.156331 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hxfb5\"" Jul 01 18:27:25.158364 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.158344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.158681 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.158665 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 18:27:25.158769 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.158674 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 18:27:25.158847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.158772 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6l8dk\"" Jul 01 18:27:25.161189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.161163 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:25.161285 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.161239 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-znz9s\"" Jul 01 18:27:25.161345 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.161312 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:25.161601 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.161582 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 18:27:25.163350 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.163329 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vrcqg" Jul 01 18:27:25.170092 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.170073 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vrcqg" Jul 01 18:27:25.205945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.205893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"2ed95cd50bbe285ed8e8b0ce78fda50a","Type":"ContainerStarted","Data":"bb9ed967fd694a05bf4b2f319e1f63393edb8e343ff8b03a25fb08dc67586d5e"} Jul 01 18:27:25.207258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.207206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" event={"ID":"1ba0a29899ef0b7c5ebc60f477e47a02","Type":"ContainerStarted","Data":"73fe7da58ae261e6bf0102884ed88e64ffffac67afcbac93016de76a86772e48"} Jul 01 18:27:25.229843 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.229825 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 18:27:25.243330 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c25280f-7541-49f2-868c-f016beda8087-konnectivity-ca\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.243432 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.243432 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ztn\" (UniqueName: \"kubernetes.io/projected/540758a6-32b9-47b3-8967-f57fd6dfad7d-kube-api-access-t7ztn\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.243432 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-tmp-dir\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.243432 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-kubelet\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-env-overrides\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-tmp\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-kubelet\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-conf-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-config\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b355b77e-da6d-49db-bd9e-bffef89d7165-serviceca\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-bin\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.243655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-slash\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-ovn\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-tmp-dir\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cnibin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-netns\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shvt\" (UniqueName: \"kubernetes.io/projected/6133928e-c4d9-459e-9dd9-26c6a0ae0708-kube-api-access-4shvt\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-script-lib\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-registration-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8p6\" (UniqueName: \"kubernetes.io/projected/f526d902-c6df-4aff-b973-f35f20d8a28b-kube-api-access-xx8p6\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.243998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-netns\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-netd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-systemd-units\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-modprobe-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-tuned\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-daemon-config\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-dbus\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244248 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-426dm\" (UniqueName: \"kubernetes.io/projected/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-kube-api-access-426dm\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-node-log\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-sys-fs\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-systemd\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-socket-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-run\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-sys\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-host\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-multus\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-etc-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c98246-de8f-489c-9fbb-a1b4b4566411-ovn-node-metrics-cert\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b355b77e-da6d-49db-bd9e-bffef89d7165-host\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.244664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-conf\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-k8s-cni-cncf-io\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-os-release\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244834 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-hostroot\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-multus-certs\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244885 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-os-release\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-iptables-alerter-script\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.244955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.245552 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245535 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zx7\" (UniqueName: \"kubernetes.io/projected/13c98246-de8f-489c-9fbb-a1b4b4566411-kube-api-access-g7zx7\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-lib-modules\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-host-slash\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqztx\" (UniqueName: \"kubernetes.io/projected/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-kube-api-access-vqztx\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-kubernetes\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-etc-kubernetes\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-systemd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245869 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w4hn\" (UniqueName: \"kubernetes.io/projected/4feaed47-614f-4c4d-98fb-79f37095c05d-kube-api-access-4w4hn\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-var-lib-kubelet\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-system-cni-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.245995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-log-socket\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.246100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-system-cni-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-device-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj69j\" (UniqueName: \"kubernetes.io/projected/b355b77e-da6d-49db-bd9e-bffef89d7165-kube-api-access-fj69j\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246083 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysconfig\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-socket-dir-parent\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-cnibin\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-var-lib-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-cnibin\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/540758a6-32b9-47b3-8967-f57fd6dfad7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-system-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-bin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-kubelet-config\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/540758a6-32b9-47b3-8967-f57fd6dfad7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slkbg\" (UniqueName: \"kubernetes.io/projected/5b67e645-9631-4417-874d-4be91078ecbd-kube-api-access-slkbg\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-hosts-file\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.246837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-os-release\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.247447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cni-binary-copy\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.247447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c25280f-7541-49f2-868c-f016beda8087-agent-certs\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.247447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.246427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-hosts-file\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.250855 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.250825 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 18:27:25.251195 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.251174 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:25.251195 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.251196 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:25.251318 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.251212 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:25.251318 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.251277 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:25.751251434 +0000 UTC m=+3.001134548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:25.254106 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.254081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-426dm\" (UniqueName: \"kubernetes.io/projected/7f58e5e2-fbdb-46ca-8588-4da4d639ff3c-kube-api-access-426dm\") pod \"node-resolver-xvvtc\" (UID: \"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c\") " pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.254173 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.254083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ztn\" (UniqueName: \"kubernetes.io/projected/540758a6-32b9-47b3-8967-f57fd6dfad7d-kube-api-access-t7ztn\") pod \"multus-additional-cni-plugins-dlz2z\" (UID: \"540758a6-32b9-47b3-8967-f57fd6dfad7d\") " pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.346876 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346843 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-systemd-units\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-modprobe-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-tuned\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-daemon-config\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-dbus\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-node-log\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.346973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-systemd-units\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-sys-fs\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-modprobe-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347054 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-systemd\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-socket-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-sys-fs\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347119 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-run\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347137 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-systemd\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-sys\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-host\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-multus\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-run\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-etc-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c98246-de8f-489c-9fbb-a1b4b4566411-ovn-node-metrics-cert\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347250 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-socket-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-host\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b355b77e-da6d-49db-bd9e-bffef89d7165-host\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347297 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-sys\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-dbus\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-conf\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b355b77e-da6d-49db-bd9e-bffef89d7165-host\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.347519 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-k8s-cni-cncf-io\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-multus\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-k8s-cni-cncf-io\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-etc-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-hostroot\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347458 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-conf\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-hostroot\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-multus-certs\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-iptables-alerter-script\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-multus-certs\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-node-log\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zx7\" (UniqueName: \"kubernetes.io/projected/13c98246-de8f-489c-9fbb-a1b4b4566411-kube-api-access-g7zx7\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-daemon-config\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-lib-modules\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-host-slash\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.348403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-host-slash\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347733 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-lib-modules\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqztx\" (UniqueName: \"kubernetes.io/projected/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-kube-api-access-vqztx\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347815 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-kubernetes\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-etc-kubernetes\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-systemd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347920 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-systemd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-kubernetes\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w4hn\" (UniqueName: \"kubernetes.io/projected/4feaed47-614f-4c4d-98fb-79f37095c05d-kube-api-access-4w4hn\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-var-lib-kubelet\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.347967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-etc-kubernetes\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-log-socket\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-device-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-log-socket\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-var-lib-kubelet\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj69j\" (UniqueName: \"kubernetes.io/projected/b355b77e-da6d-49db-bd9e-bffef89d7165-kube-api-access-fj69j\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-iptables-alerter-script\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.349309 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysconfig\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-device-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-socket-dir-parent\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348169 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-var-lib-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348218 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-system-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-socket-dir-parent\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-bin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-var-lib-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348288 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-cni-bin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348291 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-kubelet-config\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slkbg\" (UniqueName: \"kubernetes.io/projected/5b67e645-9631-4417-874d-4be91078ecbd-kube-api-access-slkbg\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysconfig\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-kubelet-config\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-system-cni-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-os-release\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350225 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cni-binary-copy\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c25280f-7541-49f2-868c-f016beda8087-agent-certs\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c25280f-7541-49f2-868c-f016beda8087-konnectivity-ca\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348601 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-os-release\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-kubelet\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-env-overrides\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-tmp\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.348707 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-kubelet\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-conf-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-config\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.348782 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:25.848762434 +0000 UTC m=+3.098645545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b355b77e-da6d-49db-bd9e-bffef89d7165-serviceca\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-bin\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-slash\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-ovn\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.350931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cnibin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.348997 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cni-binary-copy\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-bin\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349340 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-config\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-env-overrides\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-cnibin\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c25280f-7541-49f2-868c-f016beda8087-konnectivity-ca\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-slash\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-ovn\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b355b77e-da6d-49db-bd9e-bffef89d7165-serviceca\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-kubelet\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-netns\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-var-lib-kubelet\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-sysctl-d\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shvt\" (UniqueName: \"kubernetes.io/projected/6133928e-c4d9-459e-9dd9-26c6a0ae0708-kube-api-access-4shvt\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-host-run-netns\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6133928e-c4d9-459e-9dd9-26c6a0ae0708-multus-conf-dir\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.351618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-run-openvswitch\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.349923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-script-lib\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-registration-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8p6\" (UniqueName: \"kubernetes.io/projected/f526d902-c6df-4aff-b973-f35f20d8a28b-kube-api-access-xx8p6\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350122 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f526d902-c6df-4aff-b973-f35f20d8a28b-registration-dir\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350139 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-netns\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350194 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-netns\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.350306 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-netd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c98246-de8f-489c-9fbb-a1b4b4566411-ovn-node-metrics-cert\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.350415 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:25.850396705 +0000 UTC m=+3.100279813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-etc-tuned\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c98246-de8f-489c-9fbb-a1b4b4566411-ovnkube-script-lib\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.350504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c98246-de8f-489c-9fbb-a1b4b4566411-host-cni-netd\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.352917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.351562 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4feaed47-614f-4c4d-98fb-79f37095c05d-tmp\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.352917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.352837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c25280f-7541-49f2-868c-f016beda8087-agent-certs\") pod \"konnectivity-agent-p8df6\" (UID: \"3c25280f-7541-49f2-868c-f016beda8087\") " pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.359197 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.359173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqztx\" (UniqueName: \"kubernetes.io/projected/2f6e7ddb-13da-4f62-9528-43ecd96e4c8f-kube-api-access-vqztx\") pod \"iptables-alerter-g77vt\" (UID: \"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f\") " pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.361161 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.361095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8p6\" (UniqueName: \"kubernetes.io/projected/f526d902-c6df-4aff-b973-f35f20d8a28b-kube-api-access-xx8p6\") pod \"aws-ebs-csi-driver-node-zqh2t\" (UID: \"f526d902-c6df-4aff-b973-f35f20d8a28b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.361263 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.361169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w4hn\" (UniqueName: \"kubernetes.io/projected/4feaed47-614f-4c4d-98fb-79f37095c05d-kube-api-access-4w4hn\") pod \"tuned-wb6vq\" (UID: \"4feaed47-614f-4c4d-98fb-79f37095c05d\") " pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.362687 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.362570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slkbg\" (UniqueName: \"kubernetes.io/projected/5b67e645-9631-4417-874d-4be91078ecbd-kube-api-access-slkbg\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.362687 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.362661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj69j\" (UniqueName: \"kubernetes.io/projected/b355b77e-da6d-49db-bd9e-bffef89d7165-kube-api-access-fj69j\") pod \"node-ca-wjqw8\" (UID: \"b355b77e-da6d-49db-bd9e-bffef89d7165\") " pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.362930 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.362905 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shvt\" (UniqueName: \"kubernetes.io/projected/6133928e-c4d9-459e-9dd9-26c6a0ae0708-kube-api-access-4shvt\") pod \"multus-2dbpb\" (UID: \"6133928e-c4d9-459e-9dd9-26c6a0ae0708\") " pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.363019 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.362908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zx7\" (UniqueName: \"kubernetes.io/projected/13c98246-de8f-489c-9fbb-a1b4b4566411-kube-api-access-g7zx7\") pod \"ovnkube-node-xxmfj\" (UID: \"13c98246-de8f-489c-9fbb-a1b4b4566411\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.386489 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.386427 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:25.443983 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.443958 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" Jul 01 18:27:25.454266 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.454234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xvvtc" Jul 01 18:27:25.464987 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.464966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wjqw8" Jul 01 18:27:25.471891 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.471870 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" Jul 01 18:27:25.479846 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.479828 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:25.488801 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.488755 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" Jul 01 18:27:25.499626 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.499608 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dbpb" Jul 01 18:27:25.511387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.511370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:25.519628 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.519612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g77vt" Jul 01 18:27:25.753545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.753451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:25.753757 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.753586 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:25.753757 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.753618 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:25.753757 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.753633 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:25.753757 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.753699 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:26.753679629 +0000 UTC m=+4.003562754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:25.854078 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.854043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:25.854252 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:25.854098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:25.854252 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.854224 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:25.854366 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.854295 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:26.854278239 +0000 UTC m=+4.104161331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:25.854366 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.854229 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:25.854478 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:25.854408 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:26.854386146 +0000 UTC m=+4.104269240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:26.173943 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:26.173874 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:25 +0000 UTC" deadline="2027-12-29 07:13:05.99151513 +0000 UTC" Jul 01 18:27:26.173943 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:26.173941 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13092h45m39.817579717s" Jul 01 18:27:26.351938 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.351901 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540758a6_32b9_47b3_8967_f57fd6dfad7d.slice/crio-009544d30fcf6d356447317e5e76552eed3a7f3fe9a52355d874098e9c3bb0e5 WatchSource:0}: Error finding container 009544d30fcf6d356447317e5e76552eed3a7f3fe9a52355d874098e9c3bb0e5: Status 404 returned error can't find the container with id 009544d30fcf6d356447317e5e76552eed3a7f3fe9a52355d874098e9c3bb0e5 Jul 01 18:27:26.380557 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.380533 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4feaed47_614f_4c4d_98fb_79f37095c05d.slice/crio-5657e5a749cca81e4bbb139ecb732b819f561fe2cec3649adb327959533a2b14 WatchSource:0}: Error finding container 5657e5a749cca81e4bbb139ecb732b819f561fe2cec3649adb327959533a2b14: Status 404 returned error can't find the container with id 5657e5a749cca81e4bbb139ecb732b819f561fe2cec3649adb327959533a2b14 Jul 01 18:27:26.381975 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.381948 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb355b77e_da6d_49db_bd9e_bffef89d7165.slice/crio-16c55533d109c0ba7d0c4f3951240dc03a2f7f96c6207370fcfdb304d63df79f WatchSource:0}: Error finding container 16c55533d109c0ba7d0c4f3951240dc03a2f7f96c6207370fcfdb304d63df79f: Status 404 returned error can't find the container with id 16c55533d109c0ba7d0c4f3951240dc03a2f7f96c6207370fcfdb304d63df79f Jul 01 18:27:26.382873 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.382844 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6133928e_c4d9_459e_9dd9_26c6a0ae0708.slice/crio-20b10bf8b85837ca7501da00f6a3f680cdc9ea1cc17bf04678b3714c4de1ba68 WatchSource:0}: Error finding container 20b10bf8b85837ca7501da00f6a3f680cdc9ea1cc17bf04678b3714c4de1ba68: Status 404 returned error can't find the container with id 20b10bf8b85837ca7501da00f6a3f680cdc9ea1cc17bf04678b3714c4de1ba68 Jul 01 18:27:26.385804 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.383681 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c25280f_7541_49f2_868c_f016beda8087.slice/crio-f14b079bd8fa8012c4dac59cc8b55bc8a621092fb2b17d357cbbc9b380119e8d WatchSource:0}: Error finding container f14b079bd8fa8012c4dac59cc8b55bc8a621092fb2b17d357cbbc9b380119e8d: Status 404 returned error can't find the container with id f14b079bd8fa8012c4dac59cc8b55bc8a621092fb2b17d357cbbc9b380119e8d Jul 01 18:27:26.385804 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:26.384932 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c98246_de8f_489c_9fbb_a1b4b4566411.slice/crio-710e5b4c4bb8943c5cd2054f17a5b5922338b332a203ae3c58a5efe72cd30046 WatchSource:0}: Error finding container 710e5b4c4bb8943c5cd2054f17a5b5922338b332a203ae3c58a5efe72cd30046: Status 404 returned error can't find the container with id 710e5b4c4bb8943c5cd2054f17a5b5922338b332a203ae3c58a5efe72cd30046 Jul 01 18:27:26.762295 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:26.762123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:26.762434 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.762309 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:26.762434 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.762334 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:26.762434 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.762345 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:26.762434 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.762400 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:28.762377918 +0000 UTC m=+6.012261014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:26.863625 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:26.863543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:26.863625 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:26.863610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:26.863851 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.863748 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:26.863851 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.863812 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:28.863792062 +0000 UTC m=+6.113675161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:26.864331 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.864266 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:26.864331 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:26.864320 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:28.864302954 +0000 UTC m=+6.114186052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:27.174945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.174777 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:25 +0000 UTC" deadline="2028-02-19 02:22:49.438006752 +0000 UTC" Jul 01 18:27:27.174945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.174856 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14335h55m22.263154598s" Jul 01 18:27:27.202739 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.202001 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:27.202739 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:27.202124 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:27.202739 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.202572 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:27.202739 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:27.202676 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:27.203438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.203193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:27.203438 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:27.203305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:27.215813 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.215780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xvvtc" event={"ID":"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c","Type":"ContainerStarted","Data":"ec29bc7d46cb1cdee91f70c18824d511ffb9cdb3220aee0db1e6911574ce96bb"} Jul 01 18:27:27.221229 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.221197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerStarted","Data":"009544d30fcf6d356447317e5e76552eed3a7f3fe9a52355d874098e9c3bb0e5"} Jul 01 18:27:27.229168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.229096 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8df6" event={"ID":"3c25280f-7541-49f2-868c-f016beda8087","Type":"ContainerStarted","Data":"f14b079bd8fa8012c4dac59cc8b55bc8a621092fb2b17d357cbbc9b380119e8d"} Jul 01 18:27:27.239804 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.239758 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dbpb" event={"ID":"6133928e-c4d9-459e-9dd9-26c6a0ae0708","Type":"ContainerStarted","Data":"20b10bf8b85837ca7501da00f6a3f680cdc9ea1cc17bf04678b3714c4de1ba68"} Jul 01 18:27:27.260974 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.260944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wjqw8" event={"ID":"b355b77e-da6d-49db-bd9e-bffef89d7165","Type":"ContainerStarted","Data":"16c55533d109c0ba7d0c4f3951240dc03a2f7f96c6207370fcfdb304d63df79f"} Jul 01 18:27:27.268116 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.268086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" event={"ID":"f526d902-c6df-4aff-b973-f35f20d8a28b","Type":"ContainerStarted","Data":"9e2e343bca57aeed5a2c2f37a1f68ce01cde1f8ca4a5afe3698d5c11a0dfd0f3"} Jul 01 18:27:27.293829 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.293781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g77vt" event={"ID":"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f","Type":"ContainerStarted","Data":"107daf1ea75fe31a3a1cf9cd0cea6aa1f3e41d76c7254ecc50a40c8f82ebd024"} Jul 01 18:27:27.311500 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.311467 2566 generic.go:356] "Generic (PLEG): container finished" podID="2ed95cd50bbe285ed8e8b0ce78fda50a" containerID="78af087fdac6065d8ffe9348f317f8cab64f8ac435de471eaae8ccf100ab7fcd" exitCode=0 Jul 01 18:27:27.311598 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.311561 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"2ed95cd50bbe285ed8e8b0ce78fda50a","Type":"ContainerDied","Data":"78af087fdac6065d8ffe9348f317f8cab64f8ac435de471eaae8ccf100ab7fcd"} Jul 01 18:27:27.343358 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.342769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" event={"ID":"1ba0a29899ef0b7c5ebc60f477e47a02","Type":"ContainerStarted","Data":"c3e408ce5cde87d9a9faa878180db9b5aa03310e2b027af0b465c24616d79971"} Jul 01 18:27:27.352239 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.352206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"710e5b4c4bb8943c5cd2054f17a5b5922338b332a203ae3c58a5efe72cd30046"} Jul 01 18:27:27.359691 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:27.359666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" event={"ID":"4feaed47-614f-4c4d-98fb-79f37095c05d","Type":"ContainerStarted","Data":"5657e5a749cca81e4bbb139ecb732b819f561fe2cec3649adb327959533a2b14"} Jul 01 18:27:28.374005 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:28.373951 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"2ed95cd50bbe285ed8e8b0ce78fda50a","Type":"ContainerStarted","Data":"1d6b57ae99575526aa80f8fa78f09d6f69a8c2484836df3f5767b16060c58238"} Jul 01 18:27:28.391243 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:28.391178 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" podStartSLOduration=3.391157581 podStartE2EDuration="3.391157581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:27.359678918 +0000 UTC m=+4.609562033" watchObservedRunningTime="2026-07-01 18:27:28.391157581 +0000 UTC m=+5.641040699" Jul 01 18:27:28.780572 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:28.779865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:28.780572 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.780033 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:28.780572 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.780055 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:28.780572 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.780068 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:28.780572 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.780126 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:32.780107203 +0000 UTC m=+10.029990304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:28.880259 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:28.880209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:28.880452 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:28.880305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:28.880452 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.880433 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:28.880573 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.880498 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:32.880477347 +0000 UTC m=+10.130360455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:28.881019 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.880929 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:28.881019 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:28.880984 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:32.8809675 +0000 UTC m=+10.130850608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:29.207812 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:29.206924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:29.207812 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:29.207125 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:29.207812 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:29.207598 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:29.211889 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:29.208209 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:29.211889 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:29.208308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:29.211889 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:29.208429 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:31.202951 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:31.203083 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:31.203460 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:31.203559 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:31.203633 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:31.203763 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:31.203719 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:32.812610 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:32.811989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:32.812610 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.812157 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:32.812610 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.812181 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:32.812610 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.812194 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:32.812610 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.812256 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:40.812235185 +0000 UTC m=+18.062118306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:32.913044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:32.913106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.913237 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.913293 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:40.913274904 +0000 UTC m=+18.163157999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.913658 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:32.913764 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:32.913707 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:40.913690868 +0000 UTC m=+18.163573960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:33.201102 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:33.201022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:33.201265 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:33.201105 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:33.201265 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:33.201141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:33.201265 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:33.201228 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:33.201265 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:33.201228 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:33.201495 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:33.201303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:35.201015 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:35.200987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:35.201369 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:35.201106 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:35.201504 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:35.201486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:35.201596 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:35.201578 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:35.203691 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:35.200943 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:35.203905 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:35.203769 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:37.199820 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:37.199772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:37.199820 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:37.199815 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:37.200409 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:37.199800 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:37.200409 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:37.199908 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:37.200409 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:37.199997 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:37.200409 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:37.200081 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:39.200821 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:39.200770 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:39.200821 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:39.200801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:39.201351 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:39.200884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:39.201351 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:39.200886 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:39.201351 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:39.200954 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:39.201351 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:39.200998 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:40.876646 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:40.876602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:40.877125 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.876756 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:40.877125 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.876773 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:40.877125 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.876797 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:40.877125 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.876844 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:56.876831449 +0000 UTC m=+34.126714540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:40.977632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:40.977604 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:40.977832 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:40.977652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:40.977832 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.977761 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:40.977832 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.977761 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:40.978003 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.977835 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:56.977817791 +0000 UTC m=+34.227700885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:40.978003 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:40.977854 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:27:56.977844397 +0000 UTC m=+34.227727489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:41.199976 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:41.199901 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:41.199976 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:41.199927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:41.200194 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:41.199901 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:41.200194 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:41.200021 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:41.200194 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:41.200111 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:41.200194 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:41.200167 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:43.201409 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:43.201374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:43.201808 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:43.201454 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:43.201808 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:43.201474 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:43.201808 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:43.201550 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:43.201808 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:43.201577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:43.201808 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:43.201634 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:45.200697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:45.200652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:45.200697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:45.200679 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:45.201251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:45.200655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:45.201251 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:45.200777 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:45.201251 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:45.200858 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:45.201251 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:45.200970 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:46.412724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.412404 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"3cb69d83cddf590d8f71c219fff0dbe161567ce7674fa3224916afac69bd569d"} Jul 01 18:27:46.413236 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.412868 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"d1d1cdabee13f331f92aa3d946035321a60f12481babac8224256eca9ce5b92b"} Jul 01 18:27:46.413236 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.412928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"060fa96f17734fabdc20dd1f53ddfeb4384c4036a55ff93f94cc0f5f4f54c2f4"} Jul 01 18:27:46.414051 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.414030 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" event={"ID":"4feaed47-614f-4c4d-98fb-79f37095c05d","Type":"ContainerStarted","Data":"0b963f9bc31f7a24768efebbda2191c1b7253306042344a67b1d049833c7adf9"} Jul 01 18:27:46.415480 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.415456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xvvtc" event={"ID":"7f58e5e2-fbdb-46ca-8588-4da4d639ff3c","Type":"ContainerStarted","Data":"bfad679b786c8fa6f79c231ccecfabb3f67c79ff24bf637ab7883d3a6e53aca4"} Jul 01 18:27:46.416749 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.416726 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="63d81d06b9e978ea297b5a8c5baddbcf7b2dc8f1422f02b3174f8b7255fabb94" exitCode=0 Jul 01 18:27:46.416866 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.416813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"63d81d06b9e978ea297b5a8c5baddbcf7b2dc8f1422f02b3174f8b7255fabb94"} Jul 01 18:27:46.418354 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.418328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8df6" event={"ID":"3c25280f-7541-49f2-868c-f016beda8087","Type":"ContainerStarted","Data":"63176df5696e3eeb853203f060a7683831dabd2cbe88f91b06021a0a65273ec0"} Jul 01 18:27:46.419801 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.419754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dbpb" event={"ID":"6133928e-c4d9-459e-9dd9-26c6a0ae0708","Type":"ContainerStarted","Data":"fdbefefb4d5bd1531956c1eedeb91558346e3755a33b4a5ebcb6a3aeef42de16"} Jul 01 18:27:46.421172 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.421145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wjqw8" event={"ID":"b355b77e-da6d-49db-bd9e-bffef89d7165","Type":"ContainerStarted","Data":"27c61f4b9b3762161dc7e073ddaf92033c6ab75eb631d836e9368c464c7eb12f"} Jul 01 18:27:46.424240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.423229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" event={"ID":"f526d902-c6df-4aff-b973-f35f20d8a28b","Type":"ContainerStarted","Data":"6ff086cd203e03f5da64f71eafa7fcde805948ccde4b04d55fa62a1800189270"} Jul 01 18:27:46.433133 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.433098 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" podStartSLOduration=21.433087356 podStartE2EDuration="21.433087356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:28.391605328 +0000 UTC m=+5.641488446" watchObservedRunningTime="2026-07-01 18:27:46.433087356 +0000 UTC m=+23.682970469" Jul 01 18:27:46.433289 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.433269 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wb6vq" podStartSLOduration=2.876014113 podStartE2EDuration="22.433264109s" totalImagesPullingTime="19.557249996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:46.432955033 +0000 UTC m=+23.682838147" watchObservedRunningTime="2026-07-01 18:27:46.433264109 +0000 UTC m=+23.683147222" Jul 01 18:27:46.475587 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.475552 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p8df6" podStartSLOduration=7.145139044 podStartE2EDuration="22.475540641s" totalImagesPullingTime="15.330401597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:46.47480187 +0000 UTC m=+23.724684974" watchObservedRunningTime="2026-07-01 18:27:46.475540641 +0000 UTC m=+23.725423752" Jul 01 18:27:46.475920 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.475898 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2dbpb" podStartSLOduration=2.868219833 podStartE2EDuration="22.475890017s" totalImagesPullingTime="19.607670184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:46.452248291 +0000 UTC m=+23.702131403" watchObservedRunningTime="2026-07-01 18:27:46.475890017 +0000 UTC m=+23.725773129" Jul 01 18:27:46.529458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.529421 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xvvtc" podStartSLOduration=2.9747016889999998 podStartE2EDuration="22.529408703s" totalImagesPullingTime="19.554707014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:46.52922449 +0000 UTC m=+23.779107602" watchObservedRunningTime="2026-07-01 18:27:46.529408703 +0000 UTC m=+23.779291816" Jul 01 18:27:46.553441 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:46.553406 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wjqw8" podStartSLOduration=3.006423636 podStartE2EDuration="22.553393968s" totalImagesPullingTime="19.546970332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:46.553179932 +0000 UTC m=+23.803063046" watchObservedRunningTime="2026-07-01 18:27:46.553393968 +0000 UTC m=+23.803277107" Jul 01 18:27:47.200916 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.200887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:47.201135 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.200887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:47.201135 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:47.201020 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:47.201135 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:47.201098 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:47.201135 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.200893 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:47.201314 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:47.201187 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:47.429394 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.429136 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"84b6eee85f02cefcd540200a0f172a93550561cfff4ec93bb9552301161235ef"} Jul 01 18:27:47.429394 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.429232 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"bdf7e7b4d109a54ad9831af0cc0f009f3029eb0ba36a964fd0456b3fad2be8c1"} Jul 01 18:27:47.429394 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.429284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"41b949df4316e8a14132dd3c63ffe8bc8fcbc521831b135c7a692f46eeb5226a"} Jul 01 18:27:47.431509 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.430905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g77vt" event={"ID":"2f6e7ddb-13da-4f62-9528-43ecd96e4c8f","Type":"ContainerStarted","Data":"81e9f4fae6b7f4ce46fb5e9fee15b0fea0a356f72bda8ada4e51dbd64a576d1c"} Jul 01 18:27:47.966583 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:47.966559 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 18:27:48.199149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:48.199001 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:27:47.966582739Z","UUID":"dcdd66e6-ca58-4ccb-831b-34efb1b11316","Handler":null,"Name":"","Endpoint":""} Jul 01 18:27:48.200646 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:48.200624 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 18:27:48.200767 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:48.200670 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 18:27:48.435439 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:48.435398 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" event={"ID":"f526d902-c6df-4aff-b973-f35f20d8a28b","Type":"ContainerStarted","Data":"aa80d6213bd33714278c27e912a3bd1407d027013341b2dfe42abfb08c3e187f"} Jul 01 18:27:49.200281 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.200251 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:49.200508 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:49.200370 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:49.200508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.200446 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:49.200588 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:49.200550 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:49.200588 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.200453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:49.200672 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:49.200648 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:49.438825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.438772 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" event={"ID":"f526d902-c6df-4aff-b973-f35f20d8a28b","Type":"ContainerStarted","Data":"64f3efe9160a051a729063072bcf72b799e5abf1a552a3b9d716e9881ab27f1e"} Jul 01 18:27:49.441937 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.441914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"5cdb57a0527676afd920d4fce13032c7189ff19987c34049e279ccc9a7abf21b"} Jul 01 18:27:49.459285 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.459206 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g77vt" podStartSLOduration=5.906055936 podStartE2EDuration="25.459188005s" totalImagesPullingTime="19.553132069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:47.447005286 +0000 UTC m=+24.696888401" watchObservedRunningTime="2026-07-01 18:27:49.459188005 +0000 UTC m=+26.709071120" Jul 01 18:27:49.459532 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:49.459505 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqh2t" podStartSLOduration=2.8435336700000002 podStartE2EDuration="25.459494386s" totalImagesPullingTime="22.615960716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:49.458922235 +0000 UTC m=+26.708805348" watchObservedRunningTime="2026-07-01 18:27:49.459494386 +0000 UTC m=+26.709377537" Jul 01 18:27:50.535826 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:50.535774 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:50.536387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:50.536368 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:51.200434 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.200221 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:51.200597 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.200247 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:51.200597 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.200294 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:51.200597 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:51.200539 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:51.200597 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:51.200586 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:51.200823 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:51.200658 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:51.449714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.449636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" event={"ID":"13c98246-de8f-489c-9fbb-a1b4b4566411","Type":"ContainerStarted","Data":"b9e1d2c701d6ceb7a0b04467fc926b415d629e177c8a6be1bcf80490639ec506"} Jul 01 18:27:51.449999 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.449981 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:51.451688 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.451665 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="58c1c022469d445df7a4cc324c4f220bc5ac4ba8c4ab57c2bc69df6159bc9fa2" exitCode=0 Jul 01 18:27:51.451777 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.451721 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"58c1c022469d445df7a4cc324c4f220bc5ac4ba8c4ab57c2bc69df6159bc9fa2"} Jul 01 18:27:51.451777 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.451773 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:51.452409 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.452382 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p8df6" Jul 01 18:27:51.465661 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.465645 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:51.482072 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.482025 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" podStartSLOduration=7.871316209 podStartE2EDuration="27.482011578s" totalImagesPullingTime="19.610695369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:51.480120037 +0000 UTC m=+28.730003142" watchObservedRunningTime="2026-07-01 18:27:51.482011578 +0000 UTC m=+28.731894690" Jul 01 18:27:51.518430 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:51.518415 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:52.454648 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:52.454482 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:52.468916 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:52.468895 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:27:53.201838 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.201808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:53.202082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.201906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:53.202082 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.201923 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:53.202082 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.201968 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:53.202082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.201995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:53.202082 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.202038 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:53.235083 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.235058 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz29l"] Jul 01 18:27:53.238489 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.238463 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkhbg"] Jul 01 18:27:53.239053 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.239018 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kvf8h"] Jul 01 18:27:53.457877 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.457810 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="0d1a0ba5ca182777ea9a1f5a35fe6f31de061f1afa098d6328158b0acd41303b" exitCode=0 Jul 01 18:27:53.457877 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.457866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.457901 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"0d1a0ba5ca182777ea9a1f5a35fe6f31de061f1afa098d6328158b0acd41303b"} Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.457981 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.458088 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.458124 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:53.458145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:53.458286 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:53.458217 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:55.203007 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:55.202935 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:55.203437 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:55.203045 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:55.203437 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:55.203054 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:55.203437 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:55.203049 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:55.203437 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:55.203157 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:55.203437 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:55.203243 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:55.464534 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:55.464454 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="0f0b808811e627a7d3f2d44f7bdaa943ca50ac0aea4a482577dccca0dde1c01c" exitCode=0 Jul 01 18:27:55.464534 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:55.464503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"0f0b808811e627a7d3f2d44f7bdaa943ca50ac0aea4a482577dccca0dde1c01c"} Jul 01 18:27:56.892880 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:56.892849 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:56.893269 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.893028 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:56.893269 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.893048 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:56.893269 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.893060 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pjfrx for pod openshift-network-diagnostics/network-check-target-sz29l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:56.893269 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.893118 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx podName:bd5753af-bd79-4d06-bcd6-db4ccbe3e896 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:28.893098197 +0000 UTC m=+66.142981305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjfrx" (UniqueName: "kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx") pod "network-check-target-sz29l" (UID: "bd5753af-bd79-4d06-bcd6-db4ccbe3e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:56.993221 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:56.993190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:56.993402 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:56.993238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:56.993402 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.993344 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:56.993402 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.993349 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:56.993402 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.993403 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret podName:09ccbf9c-12aa-4a97-a41a-398bfeaef7a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:28.993386088 +0000 UTC m=+66.243269194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret") pod "global-pull-secret-syncer-lkhbg" (UID: "09ccbf9c-12aa-4a97-a41a-398bfeaef7a3") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:56.993745 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:56.993422 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:28:28.993412281 +0000 UTC m=+66.243295372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:57.200937 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:57.200836 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:57.201089 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:57.200847 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:57.201089 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:57.200955 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz29l" podUID="bd5753af-bd79-4d06-bcd6-db4ccbe3e896" Jul 01 18:27:57.201089 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:57.201034 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkhbg" podUID="09ccbf9c-12aa-4a97-a41a-398bfeaef7a3" Jul 01 18:27:57.201089 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:57.200847 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:57.201301 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:57.201160 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kvf8h" podUID="5b67e645-9631-4417-874d-4be91078ecbd" Jul 01 18:27:58.523013 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.522856 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeReady" Jul 01 18:27:58.523378 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.523141 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 18:27:58.562664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.562628 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:27:58.565346 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.565322 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.568278 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.568259 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8xwh\"" Jul 01 18:27:58.568411 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.568388 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 18:27:58.568570 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.568531 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 18:27:58.568697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.568683 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 18:27:58.575078 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.575008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 18:27:58.583849 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.583827 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:27:58.584614 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.584595 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zmpvf"] Jul 01 18:27:58.586293 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.586277 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.589448 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.589427 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 18:27:58.589547 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.589471 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:27:58.589730 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.589715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 18:27:58.590358 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.590325 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cdvf2"] Jul 01 18:27:58.593345 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.592522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.595512 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.595492 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hxnf9\"" Jul 01 18:27:58.595623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.595516 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 18:27:58.595623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.595575 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 18:27:58.596506 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.596487 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 18:27:58.599581 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.599233 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmpvf"] Jul 01 18:27:58.607420 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.607399 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cdvf2"] Jul 01 18:27:58.704486 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5zjl\" (UniqueName: \"kubernetes.io/projected/1cdae818-292a-432c-95b2-429d0f2d54ed-kube-api-access-v5zjl\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.704486 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbjv\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704694 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704694 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cdae818-292a-432c-95b2-429d0f2d54ed-cert\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.704694 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704694 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn5pr\" (UniqueName: \"kubernetes.io/projected/1130b76b-a750-407f-8bd5-823ef4464179-kube-api-access-dn5pr\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1130b76b-a750-407f-8bd5-823ef4464179-config-volume\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.704899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.705128 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.705128 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.704920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1130b76b-a750-407f-8bd5-823ef4464179-tmp-dir\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.749014 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.748939 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8df6_3c25280f-7541-49f2-868c-f016beda8087/konnectivity-agent/0.log" limit=1024 Jul 01 18:27:58.806066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5zjl\" (UniqueName: \"kubernetes.io/projected/1cdae818-292a-432c-95b2-429d0f2d54ed-kube-api-access-v5zjl\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.806066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbjv\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cdae818-292a-432c-95b2-429d0f2d54ed-cert\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5pr\" (UniqueName: \"kubernetes.io/projected/1130b76b-a750-407f-8bd5-823ef4464179-kube-api-access-dn5pr\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806283 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1130b76b-a750-407f-8bd5-823ef4464179-config-volume\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1130b76b-a750-407f-8bd5-823ef4464179-tmp-dir\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:58.806553 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:27:58.806623 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:58.806569 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:27:58.806929 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:58.806632 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:59.306614084 +0000 UTC m=+36.556497193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:27:58.806929 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.806839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1130b76b-a750-407f-8bd5-823ef4464179-tmp-dir\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.807403 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1130b76b-a750-407f-8bd5-823ef4464179-config-volume\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.807415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.807459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:58.807499 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.807537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.807592 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:58.807558 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:59.307542442 +0000 UTC m=+36.557425532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:27:58.811263 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.811238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.811400 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.811240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.811400 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.811278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cdae818-292a-432c-95b2-429d0f2d54ed-cert\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.819738 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.819715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.819862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.819834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn5pr\" (UniqueName: \"kubernetes.io/projected/1130b76b-a750-407f-8bd5-823ef4464179-kube-api-access-dn5pr\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:58.820620 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.820596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbjv\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:58.820765 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.820749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5zjl\" (UniqueName: \"kubernetes.io/projected/1cdae818-292a-432c-95b2-429d0f2d54ed-kube-api-access-v5zjl\") pod \"ingress-canary-cdvf2\" (UID: \"1cdae818-292a-432c-95b2-429d0f2d54ed\") " pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:58.839438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.839419 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8df6_3c25280f-7541-49f2-868c-f016beda8087/konnectivity-agent/0.log" limit=1024 Jul 01 18:27:58.906193 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:58.906168 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cdvf2" Jul 01 18:27:59.203469 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.203393 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:27:59.203469 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.203423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:27:59.203676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.203565 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:27:59.206488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206468 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:27:59.206624 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:27:59.206710 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:27:59.206766 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206707 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:27:59.206844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:27:59.206949 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.206933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:27:59.309945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.309921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:27:59.310101 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.309954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:27:59.310101 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:59.310052 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:27:59.310101 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:59.310073 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:27:59.310101 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:59.310075 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:27:59.310257 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:59.310131 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:00.310117612 +0000 UTC m=+37.560000703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:27:59.310257 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:27:59.310147 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:00.310140089 +0000 UTC m=+37.560023182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:27:59.670095 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:27:59.669987 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cdvf2"] Jul 01 18:27:59.673908 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:27:59.673886 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdae818_292a_432c_95b2_429d0f2d54ed.slice/crio-16d0cdd5447daf68f2dee21752330d66d47ffbb45e67dc04ce1dd8433bd6c415 WatchSource:0}: Error finding container 16d0cdd5447daf68f2dee21752330d66d47ffbb45e67dc04ce1dd8433bd6c415: Status 404 returned error can't find the container with id 16d0cdd5447daf68f2dee21752330d66d47ffbb45e67dc04ce1dd8433bd6c415 Jul 01 18:28:00.318150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:00.318112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:28:00.318150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:00.318155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:28:00.318368 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:00.318279 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:28:00.318368 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:00.318296 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:28:00.318368 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:00.318300 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:00.318368 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:00.318361 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:02.31834209 +0000 UTC m=+39.568225200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:28:00.318582 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:00.318379 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:02.318369935 +0000 UTC m=+39.568253025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:28:00.478753 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:00.478714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cdvf2" event={"ID":"1cdae818-292a-432c-95b2-429d0f2d54ed","Type":"ContainerStarted","Data":"16d0cdd5447daf68f2dee21752330d66d47ffbb45e67dc04ce1dd8433bd6c415"} Jul 01 18:28:00.481836 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:00.481801 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="98a676836723ae8718926e3ca13f739108852baedb0422bc04fd73aa3551c01f" exitCode=0 Jul 01 18:28:00.481988 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:00.481844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"98a676836723ae8718926e3ca13f739108852baedb0422bc04fd73aa3551c01f"} Jul 01 18:28:01.488267 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:01.488229 2566 generic.go:356] "Generic (PLEG): container finished" podID="540758a6-32b9-47b3-8967-f57fd6dfad7d" containerID="9e2196469e0a792fdd43ee95b01f2af8c0bdf7f8beb93eeb8667fe6f3a1243f4" exitCode=0 Jul 01 18:28:01.488669 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:01.488286 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerDied","Data":"9e2196469e0a792fdd43ee95b01f2af8c0bdf7f8beb93eeb8667fe6f3a1243f4"} Jul 01 18:28:02.334387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.334332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:28:02.334387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.334366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:28:02.334520 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:02.334456 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:02.334520 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:02.334498 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:06.334486319 +0000 UTC m=+43.584369414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:28:02.334520 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:02.334499 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:28:02.334520 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:02.334513 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:28:02.334656 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:02.334552 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:06.334540356 +0000 UTC m=+43.584423452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:28:02.494396 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.494366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" event={"ID":"540758a6-32b9-47b3-8967-f57fd6dfad7d","Type":"ContainerStarted","Data":"417151a53106fa28be6235773a2c666197fe8f9b733a9a2101c9181b7cf79718"} Jul 01 18:28:02.496432 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.496409 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cdvf2" event={"ID":"1cdae818-292a-432c-95b2-429d0f2d54ed","Type":"ContainerStarted","Data":"1437c0a45e0d69ffbe6396d9793c44bba448e1a02fa188b5f4f28cabe69f9407"} Jul 01 18:28:02.524260 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.522152 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dlz2z" podStartSLOduration=8.114662635 podStartE2EDuration="38.522133126s" totalImagesPullingTime="30.407470491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.519532811 +0000 UTC m=+39.769415925" watchObservedRunningTime="2026-07-01 18:28:02.522133126 +0000 UTC m=+39.772016239" Jul 01 18:28:02.538825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:02.538746 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cdvf2" podStartSLOduration=1.869162245 podStartE2EDuration="4.538727869s" totalImagesPullingTime="2.669565624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:02.538480228 +0000 UTC m=+39.788363347" watchObservedRunningTime="2026-07-01 18:28:02.538727869 +0000 UTC m=+39.788610982" Jul 01 18:28:06.364837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:06.364623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:28:06.364837 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:06.364832 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:28:06.365294 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:06.364848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:28:06.365294 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:06.364857 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:28:06.365294 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:06.364936 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.364918338 +0000 UTC m=+51.614801434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:28:06.365294 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:06.364978 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:06.365294 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:06.365027 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.365014169 +0000 UTC m=+51.614897265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:28:08.386517 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.386485 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-7j6kn"] Jul 01 18:28:08.420332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.420306 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-7j6kn"] Jul 01 18:28:08.420461 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.420396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.423716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.423693 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 18:28:08.423868 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.423812 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 18:28:08.423942 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.423870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 18:28:08.424071 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.424057 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k9p9p\"" Jul 01 18:28:08.425128 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.425111 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 18:28:08.429130 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.429111 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 18:28:08.490696 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.490675 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm"] Jul 01 18:28:08.506353 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.506330 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc"] Jul 01 18:28:08.506469 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.506456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.509308 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.509281 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pz95b\"" Jul 01 18:28:08.509402 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.509326 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 18:28:08.509402 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.509356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 18:28:08.509608 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.509592 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:08.516846 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.516828 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7847669bd5-k84r8"] Jul 01 18:28:08.516987 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.516954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.522110 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.522087 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 18:28:08.522299 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.522270 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 18:28:08.522389 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.522271 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 18:28:08.528418 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.528402 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4255d\"" Jul 01 18:28:08.528492 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.528474 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 18:28:08.531120 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.531103 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm"] Jul 01 18:28:08.531201 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.531143 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7847669bd5-k84r8"] Jul 01 18:28:08.531201 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.531165 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc"] Jul 01 18:28:08.531266 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.531205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.534828 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.534808 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 18:28:08.534828 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.534825 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 18:28:08.534941 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.534835 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 18:28:08.534941 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.534859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 18:28:08.535436 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.535421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hd2dd\"" Jul 01 18:28:08.535682 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.535665 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 18:28:08.540523 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.540509 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 18:28:08.578160 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-serving-cert\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.578246 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-snapshots\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.578246 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-tmp\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.578246 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-service-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.578341 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ccrm\" (UniqueName: \"kubernetes.io/projected/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-kube-api-access-7ccrm\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.578341 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.578315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679123 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-service-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ccrm\" (UniqueName: \"kubernetes.io/projected/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-kube-api-access-7ccrm\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-tmp\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-stats-auth\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.679230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-default-certificate\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.679456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-serving-cert\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.679550 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-snapshots\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679550 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr6gs\" (UniqueName: \"kubernetes.io/projected/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-kube-api-access-sr6gs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.679550 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbw2\" (UniqueName: \"kubernetes.io/projected/5ea99ca6-951a-488f-aab7-ac069b3189ae-kube-api-access-8gbw2\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.679695 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6735daa-1c29-4191-a937-0759b7ec87ff-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.679695 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.679695 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jvr\" (UniqueName: \"kubernetes.io/projected/e6735daa-1c29-4191-a937-0759b7ec87ff-kube-api-access-74jvr\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.679695 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.679893 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.679893 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679733 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-tmp\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.679893 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.679829 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-service-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.680050 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.680033 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-snapshots\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.680133 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.680115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.690016 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.689991 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-serving-cert\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.690285 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.690264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ccrm\" (UniqueName: \"kubernetes.io/projected/b2b476ee-36a3-4b0e-93d5-aef49d9d82ef-kube-api-access-7ccrm\") pod \"insights-operator-5f67b55555-7j6kn\" (UID: \"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef\") " pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.730116 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.730079 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" Jul 01 18:28:08.780986 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.780959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbw2\" (UniqueName: \"kubernetes.io/projected/5ea99ca6-951a-488f-aab7-ac069b3189ae-kube-api-access-8gbw2\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.781101 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6735daa-1c29-4191-a937-0759b7ec87ff-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.781101 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.781206 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jvr\" (UniqueName: \"kubernetes.io/projected/e6735daa-1c29-4191-a937-0759b7ec87ff-kube-api-access-74jvr\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.781206 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.781206 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.781352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-stats-auth\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.781352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-default-certificate\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.781352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.781352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr6gs\" (UniqueName: \"kubernetes.io/projected/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-kube-api-access-sr6gs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.781882 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.781855 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:08.782002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.781907 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6735daa-1c29-4191-a937-0759b7ec87ff-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.782002 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.781988 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.281966202 +0000 UTC m=+46.531849308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:08.782267 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.782188 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.282172912 +0000 UTC m=+46.532056003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:08.782267 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.782257 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:08.782267 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.782264 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:08.782267 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.782305 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.282293959 +0000 UTC m=+46.532177051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:08.782267 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:08.782324 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.282315758 +0000 UTC m=+46.532198849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:08.785301 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.785254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-stats-auth\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.785301 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.785277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-default-certificate\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.793178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.793148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr6gs\" (UniqueName: \"kubernetes.io/projected/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-kube-api-access-sr6gs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:08.793775 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.793731 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jvr\" (UniqueName: \"kubernetes.io/projected/e6735daa-1c29-4191-a937-0759b7ec87ff-kube-api-access-74jvr\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:08.795058 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.795031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbw2\" (UniqueName: \"kubernetes.io/projected/5ea99ca6-951a-488f-aab7-ac069b3189ae-kube-api-access-8gbw2\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:08.855276 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:08.855249 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-7j6kn"] Jul 01 18:28:08.858509 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:08.858484 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b476ee_36a3_4b0e_93d5_aef49d9d82ef.slice/crio-fc772f68f1b13fecf2866d4516bd8344133e75db0e2c177203f2033b3c19d67a WatchSource:0}: Error finding container fc772f68f1b13fecf2866d4516bd8344133e75db0e2c177203f2033b3c19d67a: Status 404 returned error can't find the container with id fc772f68f1b13fecf2866d4516bd8344133e75db0e2c177203f2033b3c19d67a Jul 01 18:28:09.285191 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.285161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.285239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.285272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.285293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285315 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285371 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:10.285357021 +0000 UTC m=+47.535240117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285393 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:09.285410 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285396 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:09.285689 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285443 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:10.285427896 +0000 UTC m=+47.535311004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:09.285689 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285461 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:10.285451703 +0000 UTC m=+47.535334811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:09.285689 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:09.285470 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:10.285465521 +0000 UTC m=+47.535348612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:09.370189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.370160 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d"] Jul 01 18:28:09.408639 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.408616 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d"] Jul 01 18:28:09.409022 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.408697 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" Jul 01 18:28:09.411868 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.411849 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 18:28:09.411997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.411868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:09.411997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.411918 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pdjpk\"" Jul 01 18:28:09.516087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.515329 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" event={"ID":"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef","Type":"ContainerStarted","Data":"fc772f68f1b13fecf2866d4516bd8344133e75db0e2c177203f2033b3c19d67a"} Jul 01 18:28:09.588353 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.588321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb68n\" (UniqueName: \"kubernetes.io/projected/9af05f9b-b163-4457-a9a2-d9b2bb6aa67a-kube-api-access-vb68n\") pod \"volume-data-source-validator-69d9f679db-k7x6d\" (UID: \"9af05f9b-b163-4457-a9a2-d9b2bb6aa67a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" Jul 01 18:28:09.689593 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.689554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb68n\" (UniqueName: \"kubernetes.io/projected/9af05f9b-b163-4457-a9a2-d9b2bb6aa67a-kube-api-access-vb68n\") pod \"volume-data-source-validator-69d9f679db-k7x6d\" (UID: \"9af05f9b-b163-4457-a9a2-d9b2bb6aa67a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" Jul 01 18:28:09.700556 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.700526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb68n\" (UniqueName: \"kubernetes.io/projected/9af05f9b-b163-4457-a9a2-d9b2bb6aa67a-kube-api-access-vb68n\") pod \"volume-data-source-validator-69d9f679db-k7x6d\" (UID: \"9af05f9b-b163-4457-a9a2-d9b2bb6aa67a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" Jul 01 18:28:09.717556 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.717532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" Jul 01 18:28:09.861856 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:09.861830 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d"] Jul 01 18:28:09.864125 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:09.864097 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af05f9b_b163_4457_a9a2_d9b2bb6aa67a.slice/crio-6cbddc50d5d64e1c61e899aef0fc021b02d508ba260709bcef0923daa6ab0942 WatchSource:0}: Error finding container 6cbddc50d5d64e1c61e899aef0fc021b02d508ba260709bcef0923daa6ab0942: Status 404 returned error can't find the container with id 6cbddc50d5d64e1c61e899aef0fc021b02d508ba260709bcef0923daa6ab0942 Jul 01 18:28:10.295600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.295560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:10.295771 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.295621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:10.295771 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295741 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:10.295889 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295745 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:12.2957322 +0000 UTC m=+49.545615291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:10.295889 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.295829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:10.295967 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.295899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:10.295967 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295926 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:10.295967 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295964 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:12.295944778 +0000 UTC m=+49.545827871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:10.296119 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295981 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:12.295974815 +0000 UTC m=+49.545857906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:10.296119 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.295999 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:10.296119 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:10.296032 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:12.296021184 +0000 UTC m=+49.545904275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:10.370293 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.370260 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-45vts"] Jul 01 18:28:10.413079 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.413049 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-45vts"] Jul 01 18:28:10.413455 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.413134 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.416602 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.416572 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 18:28:10.416602 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.416587 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cph6m\"" Jul 01 18:28:10.416754 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.416575 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 18:28:10.416754 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.416637 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:10.416754 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.416615 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 18:28:10.422108 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.422092 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 18:28:10.497265 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.497226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g59z\" (UniqueName: \"kubernetes.io/projected/9fe4ec4f-5a55-42fd-ae71-799f2025247e-kube-api-access-6g59z\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.497444 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.497370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-config\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.497444 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.497421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-trusted-ca\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.497551 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.497442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fe4ec4f-5a55-42fd-ae71-799f2025247e-serving-cert\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.518723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.518694 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" event={"ID":"9af05f9b-b163-4457-a9a2-d9b2bb6aa67a","Type":"ContainerStarted","Data":"6cbddc50d5d64e1c61e899aef0fc021b02d508ba260709bcef0923daa6ab0942"} Jul 01 18:28:10.598369 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.598304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g59z\" (UniqueName: \"kubernetes.io/projected/9fe4ec4f-5a55-42fd-ae71-799f2025247e-kube-api-access-6g59z\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.598485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.598426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-config\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.598485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.598461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-trusted-ca\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.598485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.598476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fe4ec4f-5a55-42fd-ae71-799f2025247e-serving-cert\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.599624 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.599596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-trusted-ca\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.601474 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.601455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fe4ec4f-5a55-42fd-ae71-799f2025247e-serving-cert\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.607413 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.607390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g59z\" (UniqueName: \"kubernetes.io/projected/9fe4ec4f-5a55-42fd-ae71-799f2025247e-kube-api-access-6g59z\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.608752 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.608726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fe4ec4f-5a55-42fd-ae71-799f2025247e-config\") pod \"console-operator-7fdbdf9c99-45vts\" (UID: \"9fe4ec4f-5a55-42fd-ae71-799f2025247e\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.722542 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.722507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:10.876194 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:10.876109 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-45vts"] Jul 01 18:28:10.880146 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:10.880121 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe4ec4f_5a55_42fd_ae71_799f2025247e.slice/crio-57fc472cfcead316706bad77d563402e3ea95a7429da9fb4253cfd76e631af23 WatchSource:0}: Error finding container 57fc472cfcead316706bad77d563402e3ea95a7429da9fb4253cfd76e631af23: Status 404 returned error can't find the container with id 57fc472cfcead316706bad77d563402e3ea95a7429da9fb4253cfd76e631af23 Jul 01 18:28:11.522450 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:11.522410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" event={"ID":"9fe4ec4f-5a55-42fd-ae71-799f2025247e","Type":"ContainerStarted","Data":"57fc472cfcead316706bad77d563402e3ea95a7429da9fb4253cfd76e631af23"} Jul 01 18:28:12.316605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.316574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:12.316758 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.316690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:12.316758 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.316743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:12.316910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.316775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:12.316966 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.316949 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:12.317020 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317002 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.316983652 +0000 UTC m=+53.566866761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:12.317371 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317351 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:12.317448 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317406 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.317390871 +0000 UTC m=+53.567273974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:12.317515 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317457 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:12.317515 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317488 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.317477301 +0000 UTC m=+53.567360395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:12.317688 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:12.317552 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:16.317541158 +0000 UTC m=+53.567424263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:12.526276 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.526245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" event={"ID":"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef","Type":"ContainerStarted","Data":"b8c9333f7290cbd172d6b1c0f3a706903fc05ced4e45ea0a163ddd90712f693c"} Jul 01 18:28:12.527847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.527822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" event={"ID":"9af05f9b-b163-4457-a9a2-d9b2bb6aa67a","Type":"ContainerStarted","Data":"874edd8348c20eb3416014da82eb6a8f5ee23712e42c3d6fccd98434eafdcd52"} Jul 01 18:28:12.547137 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.547095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" podStartSLOduration=1.230338564 podStartE2EDuration="4.54708195s" totalImagesPullingTime="3.316743386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:12.546549291 +0000 UTC m=+49.796432406" watchObservedRunningTime="2026-07-01 18:28:12.54708195 +0000 UTC m=+49.796965064" Jul 01 18:28:12.564681 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:12.564641 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k7x6d" podStartSLOduration=1.252067354 podStartE2EDuration="3.564629294s" totalImagesPullingTime="2.31256194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:12.5633619 +0000 UTC m=+49.813245012" watchObservedRunningTime="2026-07-01 18:28:12.564629294 +0000 UTC m=+49.814512406" Jul 01 18:28:14.101277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.101253 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n92v5"] Jul 01 18:28:14.123013 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.122986 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n92v5"] Jul 01 18:28:14.123144 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.123105 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.125917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.125894 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 18:28:14.126038 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.125993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:14.126097 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.125900 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 18:28:14.232197 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.232167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d4b77-430e-4741-af57-6d0fad415845-data-volume\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.232332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.232232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp4cj\" (UniqueName: \"kubernetes.io/projected/1e5d4b77-430e-4741-af57-6d0fad415845-kube-api-access-bp4cj\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.232332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.232274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.232405 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.232381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.232439 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.232417 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d4b77-430e-4741-af57-6d0fad415845-crio-socket\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.332760 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.332731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.332864 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.332839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.332864 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.332854 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:28:14.332951 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.332865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d4b77-430e-4741-af57-6d0fad415845-crio-socket\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.332951 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.332909 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.832889522 +0000 UTC m=+52.082772614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : configmap "kube-rbac-proxy" not found Jul 01 18:28:14.332951 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.332927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d4b77-430e-4741-af57-6d0fad415845-data-volume\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.333086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.332974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp4cj\" (UniqueName: \"kubernetes.io/projected/1e5d4b77-430e-4741-af57-6d0fad415845-kube-api-access-bp4cj\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.333086 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.332988 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.333086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.333024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d4b77-430e-4741-af57-6d0fad415845-crio-socket\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.333086 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.333058 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.833041531 +0000 UTC m=+52.082924628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.333259 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.333244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d4b77-430e-4741-af57-6d0fad415845-data-volume\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.342918 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.342887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp4cj\" (UniqueName: \"kubernetes.io/projected/1e5d4b77-430e-4741-af57-6d0fad415845-kube-api-access-bp4cj\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.434020 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.433992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:28:14.434107 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.434027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:28:14.434159 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.434138 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:28:14.434159 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.434153 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:28:14.434222 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.434200 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:30.434184674 +0000 UTC m=+67.684067767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:28:14.434222 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.434198 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:14.434292 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.434247 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:30.434231816 +0000 UTC m=+67.684114911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:28:14.534106 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.534082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/0.log" Jul 01 18:28:14.534226 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.534122 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" containerID="ede1408a6bf1a10cd5dab93825ed723fd2bca190469d937aaf979a3b02296fcb" exitCode=255 Jul 01 18:28:14.534226 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.534160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" event={"ID":"9fe4ec4f-5a55-42fd-ae71-799f2025247e","Type":"ContainerDied","Data":"ede1408a6bf1a10cd5dab93825ed723fd2bca190469d937aaf979a3b02296fcb"} Jul 01 18:28:14.534423 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.534408 2566 scope.go:117] "RemoveContainer" containerID="ede1408a6bf1a10cd5dab93825ed723fd2bca190469d937aaf979a3b02296fcb" Jul 01 18:28:14.836727 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.836697 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.836872 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.836837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:14.836872 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.836856 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.836988 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:14.836918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.836898733 +0000 UTC m=+53.086781827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.837316 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:14.837293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d4b77-430e-4741-af57-6d0fad415845-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:15.537855 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.537827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:28:15.538277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.538211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/0.log" Jul 01 18:28:15.538277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.538245 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" containerID="1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85" exitCode=255 Jul 01 18:28:15.538361 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.538276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" event={"ID":"9fe4ec4f-5a55-42fd-ae71-799f2025247e","Type":"ContainerDied","Data":"1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85"} Jul 01 18:28:15.538361 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.538335 2566 scope.go:117] "RemoveContainer" containerID="ede1408a6bf1a10cd5dab93825ed723fd2bca190469d937aaf979a3b02296fcb" Jul 01 18:28:15.538537 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.538518 2566 scope.go:117] "RemoveContainer" containerID="1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85" Jul 01 18:28:15.538725 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:15.538703 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-45vts_openshift-console-operator(9fe4ec4f-5a55-42fd-ae71-799f2025247e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" podUID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" Jul 01 18:28:15.845570 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.845497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:15.845706 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:15.845638 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.845750 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:15.845706 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:17.845689522 +0000 UTC m=+55.095572624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.882523 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:15.882495 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xvvtc_7f58e5e2-fbdb-46ca-8588-4da4d639ff3c/dns-node-resolver/0.log" Jul 01 18:28:16.350561 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.350533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:16.350703 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.350603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:16.350703 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.350640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:16.350703 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.350660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:16.350703 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350681 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350746 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350748 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350757 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:24.350737558 +0000 UTC m=+61.600620657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350823 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:24.350808209 +0000 UTC m=+61.600691301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350838 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:24.350831303 +0000 UTC m=+61.600714394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:16.350858 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.350854 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:24.350848367 +0000 UTC m=+61.600731458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:16.541935 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.541912 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:28:16.542301 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.542196 2566 scope.go:117] "RemoveContainer" containerID="1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85" Jul 01 18:28:16.542364 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:16.542330 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-45vts_openshift-console-operator(9fe4ec4f-5a55-42fd-ae71-799f2025247e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" podUID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" Jul 01 18:28:16.682950 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:16.682926 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wjqw8_b355b77e-da6d-49db-bd9e-bffef89d7165/node-ca/0.log" Jul 01 18:28:17.082698 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:17.082586 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cdvf2_1cdae818-292a-432c-95b2-429d0f2d54ed/serve-healthcheck-canary/0.log" Jul 01 18:28:17.862564 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:17.862527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:17.862967 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:17.862667 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:17.862967 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:17.862728 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:21.862713911 +0000 UTC m=+59.112597001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:20.722882 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:20.722848 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:20.723467 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:20.723014 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:20.723467 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:20.723429 2566 scope.go:117] "RemoveContainer" containerID="1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85" Jul 01 18:28:20.723647 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:20.723616 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-45vts_openshift-console-operator(9fe4ec4f-5a55-42fd-ae71-799f2025247e)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" podUID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" Jul 01 18:28:21.896903 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:21.896851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:21.897444 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:21.897048 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:21.897444 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:21.897150 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:29.89712515 +0000 UTC m=+67.147008252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:24.418202 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:24.418156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:24.418238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:24.418265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418282 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:24.418318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418349 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls podName:e6735daa-1c29-4191-a937-0759b7ec87ff nodeName:}" failed. No retries permitted until 2026-07-01 18:28:40.418328086 +0000 UTC m=+77.668211180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-grlgc" (UID: "e6735daa-1c29-4191-a937-0759b7ec87ff") : secret "cluster-monitoring-operator-tls" not found Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418396 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418394 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418414 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:40.418397457 +0000 UTC m=+77.668280565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : configmap references non-existent config key: service-ca.crt Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418444 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls podName:5ea99ca6-951a-488f-aab7-ac069b3189ae nodeName:}" failed. No retries permitted until 2026-07-01 18:28:40.418432542 +0000 UTC m=+77.668315633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-brhdm" (UID: "5ea99ca6-951a-488f-aab7-ac069b3189ae") : secret "samples-operator-tls" not found Jul 01 18:28:24.418577 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:24.418464 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs podName:45ad114e-5a80-40e7-9f0b-b6b16a094f1a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:40.418451162 +0000 UTC m=+77.668334257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs") pod "router-default-7847669bd5-k84r8" (UID: "45ad114e-5a80-40e7-9f0b-b6b16a094f1a") : secret "router-metrics-certs-default" not found Jul 01 18:28:24.476736 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:24.476715 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxmfj" Jul 01 18:28:28.954834 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:28.954777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:28:28.958241 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:28.958217 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:28:28.968699 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:28.968680 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:28:28.978153 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:28.978123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfrx\" (UniqueName: \"kubernetes.io/projected/bd5753af-bd79-4d06-bcd6-db4ccbe3e896-kube-api-access-pjfrx\") pod \"network-check-target-sz29l\" (UID: \"bd5753af-bd79-4d06-bcd6-db4ccbe3e896\") " pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:28:29.055767 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.055741 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:28:29.055875 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.055859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:28:29.059149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.059131 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:28:29.059149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.059139 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:28:29.066334 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:29.066317 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 18:28:29.066386 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:29.066369 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs podName:5b67e645-9631-4417-874d-4be91078ecbd nodeName:}" failed. No retries permitted until 2026-07-01 18:29:33.066355839 +0000 UTC m=+130.316238934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs") pod "network-metrics-daemon-kvf8h" (UID: "5b67e645-9631-4417-874d-4be91078ecbd") : secret "metrics-daemon-secret" not found Jul 01 18:28:29.068381 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.068365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09ccbf9c-12aa-4a97-a41a-398bfeaef7a3-original-pull-secret\") pod \"global-pull-secret-syncer-lkhbg\" (UID: \"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3\") " pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:28:29.221829 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.221742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkhbg" Jul 01 18:28:29.230331 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.230312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:28:29.238051 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.238030 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:28:29.352235 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.352202 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkhbg"] Jul 01 18:28:29.355060 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:29.355035 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ccbf9c_12aa_4a97_a41a_398bfeaef7a3.slice/crio-7d68c29fff0acccf2fd0a10a04d1f9d1dbb0614764ae50ba2d01bd82e803a3cf WatchSource:0}: Error finding container 7d68c29fff0acccf2fd0a10a04d1f9d1dbb0614764ae50ba2d01bd82e803a3cf: Status 404 returned error can't find the container with id 7d68c29fff0acccf2fd0a10a04d1f9d1dbb0614764ae50ba2d01bd82e803a3cf Jul 01 18:28:29.370363 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.370334 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz29l"] Jul 01 18:28:29.373164 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:29.373145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5753af_bd79_4d06_bcd6_db4ccbe3e896.slice/crio-8d122eb5e7fcde2ca08287c2d1838b7b4f5361f369c67b7c027f5b5871621241 WatchSource:0}: Error finding container 8d122eb5e7fcde2ca08287c2d1838b7b4f5361f369c67b7c027f5b5871621241: Status 404 returned error can't find the container with id 8d122eb5e7fcde2ca08287c2d1838b7b4f5361f369c67b7c027f5b5871621241 Jul 01 18:28:29.575949 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.575879 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkhbg" event={"ID":"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3","Type":"ContainerStarted","Data":"7d68c29fff0acccf2fd0a10a04d1f9d1dbb0614764ae50ba2d01bd82e803a3cf"} Jul 01 18:28:29.576982 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.576962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz29l" event={"ID":"bd5753af-bd79-4d06-bcd6-db4ccbe3e896","Type":"ContainerStarted","Data":"8d122eb5e7fcde2ca08287c2d1838b7b4f5361f369c67b7c027f5b5871621241"} Jul 01 18:28:29.963347 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:29.963310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:29.963832 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:29.963480 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:29.963832 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:29.963561 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls podName:1e5d4b77-430e-4741-af57-6d0fad415845 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:45.96353881 +0000 UTC m=+83.213421909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n92v5" (UID: "1e5d4b77-430e-4741-af57-6d0fad415845") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:30.468052 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:30.468016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:28:30.468214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:30.468060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:28:30.468214 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:30.468155 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:28:30.468214 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:30.468176 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f47bc4c74-2t42d: secret "image-registry-tls" not found Jul 01 18:28:30.468350 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:30.468220 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:30.468350 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:30.468236 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls podName:123a3b09-ccae-4f17-9c86-d20be2c5f6e1 nodeName:}" failed. No retries permitted until 2026-07-01 18:29:02.468217662 +0000 UTC m=+99.718100756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls") pod "image-registry-5f47bc4c74-2t42d" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1") : secret "image-registry-tls" not found Jul 01 18:28:30.468350 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:30.468272 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls podName:1130b76b-a750-407f-8bd5-823ef4464179 nodeName:}" failed. No retries permitted until 2026-07-01 18:29:02.468259428 +0000 UTC m=+99.718142520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls") pod "dns-default-zmpvf" (UID: "1130b76b-a750-407f-8bd5-823ef4464179") : secret "dns-default-metrics-tls" not found Jul 01 18:28:33.589760 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:33.589718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz29l" event={"ID":"bd5753af-bd79-4d06-bcd6-db4ccbe3e896","Type":"ContainerStarted","Data":"505bc1dd65023023c36d125861061fe44863a90ca10efc1cd0630477bd234b85"} Jul 01 18:28:33.590192 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:33.589850 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:28:33.607390 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:33.607340 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sz29l" podStartSLOduration=66.183401588 podStartE2EDuration="1m9.607322611s" totalImagesPullingTime="3.423921023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:33.606120313 +0000 UTC m=+70.856003427" watchObservedRunningTime="2026-07-01 18:28:33.607322611 +0000 UTC m=+70.857205717" Jul 01 18:28:34.200684 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.200653 2566 scope.go:117] "RemoveContainer" containerID="1affdd69bc2953099e95a7d588d7668aecfa1e8d88d66bce77824d7efffb9d85" Jul 01 18:28:34.595385 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.595359 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:28:34.595742 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.595712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" event={"ID":"9fe4ec4f-5a55-42fd-ae71-799f2025247e","Type":"ContainerStarted","Data":"cf76933f00a349e096e6cf99f568dd8d59927b3793ee45b0cd042370f51bdfaf"} Jul 01 18:28:34.596260 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.596235 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:34.597505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.597476 2566 patch_prober.go:28] interesting pod/console-operator-7fdbdf9c99-45vts container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body= Jul 01 18:28:34.597622 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.597528 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" podUID="9fe4ec4f-5a55-42fd-ae71-799f2025247e" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" Jul 01 18:28:34.615718 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:34.615578 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" podStartSLOduration=21.398083202 podStartE2EDuration="24.615559114s" totalImagesPullingTime="3.217475912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:34.614946798 +0000 UTC m=+71.864829913" watchObservedRunningTime="2026-07-01 18:28:34.615559114 +0000 UTC m=+71.865442229" Jul 01 18:28:35.600289 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:35.600247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkhbg" event={"ID":"09ccbf9c-12aa-4a97-a41a-398bfeaef7a3","Type":"ContainerStarted","Data":"932dec0ce874b8f1cceed57c8178376f4e96db8eb3702a829df433e22d191a44"} Jul 01 18:28:35.604377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:35.604352 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-45vts" Jul 01 18:28:35.639147 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:35.639104 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkhbg" podStartSLOduration=66.440385015 podStartE2EDuration="1m11.639087623s" totalImagesPullingTime="5.198702608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:35.619856286 +0000 UTC m=+72.869739401" watchObservedRunningTime="2026-07-01 18:28:35.639087623 +0000 UTC m=+72.888970739" Jul 01 18:28:40.454456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.454400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:40.454456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.454467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:40.455001 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.454488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:40.455001 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.454525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:40.455456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.455432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-service-ca-bundle\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:40.457236 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.457211 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6735daa-1c29-4191-a937-0759b7ec87ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-grlgc\" (UID: \"e6735daa-1c29-4191-a937-0759b7ec87ff\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:40.457329 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.457234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45ad114e-5a80-40e7-9f0b-b6b16a094f1a-metrics-certs\") pod \"router-default-7847669bd5-k84r8\" (UID: \"45ad114e-5a80-40e7-9f0b-b6b16a094f1a\") " pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:40.457329 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.457234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ea99ca6-951a-488f-aab7-ac069b3189ae-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-brhdm\" (UID: \"5ea99ca6-951a-488f-aab7-ac069b3189ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:40.617645 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.617619 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pz95b\"" Jul 01 18:28:40.625002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.624987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" Jul 01 18:28:40.629675 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.629657 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4255d\"" Jul 01 18:28:40.637917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.637894 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" Jul 01 18:28:40.641467 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.641449 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hd2dd\"" Jul 01 18:28:40.649920 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.649818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:40.798619 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.798585 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm"] Jul 01 18:28:40.813124 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.813095 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc"] Jul 01 18:28:40.816370 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:40.816343 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6735daa_1c29_4191_a937_0759b7ec87ff.slice/crio-58ed17ca80887b6d38621c7e76068cde47559d8abfb2cddd56e8e70271705e69 WatchSource:0}: Error finding container 58ed17ca80887b6d38621c7e76068cde47559d8abfb2cddd56e8e70271705e69: Status 404 returned error can't find the container with id 58ed17ca80887b6d38621c7e76068cde47559d8abfb2cddd56e8e70271705e69 Jul 01 18:28:40.827296 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:40.827211 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7847669bd5-k84r8"] Jul 01 18:28:40.830304 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:40.830278 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ad114e_5a80_40e7_9f0b_b6b16a094f1a.slice/crio-99514dc1bcb9251248ef00a67a5f460645cffa3c20b1db05b6ef67f8e9a9a760 WatchSource:0}: Error finding container 99514dc1bcb9251248ef00a67a5f460645cffa3c20b1db05b6ef67f8e9a9a760: Status 404 returned error can't find the container with id 99514dc1bcb9251248ef00a67a5f460645cffa3c20b1db05b6ef67f8e9a9a760 Jul 01 18:28:41.621359 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.621325 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" event={"ID":"e6735daa-1c29-4191-a937-0759b7ec87ff","Type":"ContainerStarted","Data":"58ed17ca80887b6d38621c7e76068cde47559d8abfb2cddd56e8e70271705e69"} Jul 01 18:28:41.623931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.623896 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7847669bd5-k84r8" event={"ID":"45ad114e-5a80-40e7-9f0b-b6b16a094f1a","Type":"ContainerStarted","Data":"76b2608d6b65bc1fc2da9ee3abd33d4f124a30b75d47ab1eda5035325facdf2e"} Jul 01 18:28:41.624063 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.623948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7847669bd5-k84r8" event={"ID":"45ad114e-5a80-40e7-9f0b-b6b16a094f1a","Type":"ContainerStarted","Data":"99514dc1bcb9251248ef00a67a5f460645cffa3c20b1db05b6ef67f8e9a9a760"} Jul 01 18:28:41.625904 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.625872 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" event={"ID":"5ea99ca6-951a-488f-aab7-ac069b3189ae","Type":"ContainerStarted","Data":"f5aa7655b3ff0bbd11eabd2229510a96e5c20e8553ae35f1db24f256cf7a2ade"} Jul 01 18:28:41.646314 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.646269 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7847669bd5-k84r8" podStartSLOduration=33.646255334 podStartE2EDuration="33.646255334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:41.645087327 +0000 UTC m=+78.894970440" watchObservedRunningTime="2026-07-01 18:28:41.646255334 +0000 UTC m=+78.896138447" Jul 01 18:28:41.650509 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.650484 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:41.654643 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:41.654621 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:42.630082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:42.630048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:42.631425 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:42.631396 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7847669bd5-k84r8" Jul 01 18:28:43.635941 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:43.635762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" event={"ID":"e6735daa-1c29-4191-a937-0759b7ec87ff","Type":"ContainerStarted","Data":"10aedaa20f9a68ae62b28a7738be3c25689eca88a74631529e098c06532f2c21"} Jul 01 18:28:43.637836 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:43.637799 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" event={"ID":"5ea99ca6-951a-488f-aab7-ac069b3189ae","Type":"ContainerStarted","Data":"404114763b632be36e088ce156dc63c586ac43dc66f81ec3a608ec942f53fc47"} Jul 01 18:28:43.637969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:43.637858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" event={"ID":"5ea99ca6-951a-488f-aab7-ac069b3189ae","Type":"ContainerStarted","Data":"c0040f6986d26aace2d36ede2034fe7afc40eef21d9165c5f52d518d51070944"} Jul 01 18:28:43.654582 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:43.654537 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-grlgc" podStartSLOduration=33.258174906 podStartE2EDuration="35.654518182s" totalImagesPullingTime="2.396343276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:43.653135316 +0000 UTC m=+80.903018429" watchObservedRunningTime="2026-07-01 18:28:43.654518182 +0000 UTC m=+80.904401322" Jul 01 18:28:44.845796 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.845715 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-brhdm" podStartSLOduration=34.469652801 podStartE2EDuration="36.845699161s" totalImagesPullingTime="2.37604636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:43.682819721 +0000 UTC m=+80.932702835" watchObservedRunningTime="2026-07-01 18:28:44.845699161 +0000 UTC m=+82.095582313" Jul 01 18:28:44.846254 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.846092 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:28:44.877989 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.877965 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:28:44.878119 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.878070 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.884545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.884141 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 18:28:44.884545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.884173 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 18:28:44.884545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.884164 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 18:28:44.884545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.884369 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 18:28:44.885332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.885313 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2pxf8\"" Jul 01 18:28:44.885444 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.885357 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 18:28:44.885444 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.885418 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 18:28:44.885574 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.885357 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 18:28:44.996045 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.996168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996047 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.996168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.996168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.996267 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22q2s\" (UniqueName: \"kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:44.996267 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:44.996227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097262 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097262 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097262 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22q2s\" (UniqueName: \"kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097397 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.097889 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097857 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.098168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.098168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.097894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.099724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.099704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.099865 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.099850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.108203 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.108184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22q2s\" (UniqueName: \"kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s\") pod \"console-5f6ddb469b-4gf8l\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.187435 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.187403 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:45.340448 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.340419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:28:45.344022 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:45.343994 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9959b3ac_e22b_44c8_995f_b84ed29c438e.slice/crio-81ee8b0132d84d941df1d81576bec8d0e87dabba5ae6d08fd7400a292a40a2e0 WatchSource:0}: Error finding container 81ee8b0132d84d941df1d81576bec8d0e87dabba5ae6d08fd7400a292a40a2e0: Status 404 returned error can't find the container with id 81ee8b0132d84d941df1d81576bec8d0e87dabba5ae6d08fd7400a292a40a2e0 Jul 01 18:28:45.645708 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:45.645635 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6ddb469b-4gf8l" event={"ID":"9959b3ac-e22b-44c8-995f-b84ed29c438e","Type":"ContainerStarted","Data":"81ee8b0132d84d941df1d81576bec8d0e87dabba5ae6d08fd7400a292a40a2e0"} Jul 01 18:28:46.004030 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.003995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:46.006596 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.006570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d4b77-430e-4741-af57-6d0fad415845-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n92v5\" (UID: \"1e5d4b77-430e-4741-af57-6d0fad415845\") " pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:46.235053 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.235027 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:46.242500 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.242474 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n92v5" Jul 01 18:28:46.387430 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.387340 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n92v5"] Jul 01 18:28:46.390194 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:46.390172 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5d4b77_430e_4741_af57_6d0fad415845.slice/crio-17eea3de7ec218c312a27f2828390b3d174f84ee0791b7a1df659d433a7e1320 WatchSource:0}: Error finding container 17eea3de7ec218c312a27f2828390b3d174f84ee0791b7a1df659d433a7e1320: Status 404 returned error can't find the container with id 17eea3de7ec218c312a27f2828390b3d174f84ee0791b7a1df659d433a7e1320 Jul 01 18:28:46.650418 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:46.650324 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n92v5" event={"ID":"1e5d4b77-430e-4741-af57-6d0fad415845","Type":"ContainerStarted","Data":"17eea3de7ec218c312a27f2828390b3d174f84ee0791b7a1df659d433a7e1320"} Jul 01 18:28:49.536891 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.536851 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:28:49.557825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.557779 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:28:49.557980 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.557884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.566511 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.566491 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 18:28:49.636612 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh9xx\" (UniqueName: \"kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.636993 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.636821 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737323 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh9xx\" (UniqueName: \"kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.737516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.737497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.738196 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.738173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.738593 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.738572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.738717 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.738694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.738969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.738945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.740093 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.740073 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.740215 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.740164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.747317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.747293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh9xx\" (UniqueName: \"kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx\") pod \"console-554bf87564-mlljl\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:49.869377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:49.869347 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:50.855157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:50.855103 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:28:50.858149 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:50.858122 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6567fa3c_23ee_4514_a64e_7dbd9ba034f2.slice/crio-e49215a1c35c69401426ea825ebbcbb3531980a3698171e2c593c82d53e931d9 WatchSource:0}: Error finding container e49215a1c35c69401426ea825ebbcbb3531980a3698171e2c593c82d53e931d9: Status 404 returned error can't find the container with id e49215a1c35c69401426ea825ebbcbb3531980a3698171e2c593c82d53e931d9 Jul 01 18:28:51.673521 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.673489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bf87564-mlljl" event={"ID":"6567fa3c-23ee-4514-a64e-7dbd9ba034f2","Type":"ContainerStarted","Data":"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62"} Jul 01 18:28:51.673633 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.673546 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bf87564-mlljl" event={"ID":"6567fa3c-23ee-4514-a64e-7dbd9ba034f2","Type":"ContainerStarted","Data":"e49215a1c35c69401426ea825ebbcbb3531980a3698171e2c593c82d53e931d9"} Jul 01 18:28:51.675192 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.675154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6ddb469b-4gf8l" event={"ID":"9959b3ac-e22b-44c8-995f-b84ed29c438e","Type":"ContainerStarted","Data":"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c"} Jul 01 18:28:51.677065 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.677040 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n92v5" event={"ID":"1e5d4b77-430e-4741-af57-6d0fad415845","Type":"ContainerStarted","Data":"695ffd3afb6fc890c3da80111a551971881fa99c03f75d3f0f9ea3223ad269d3"} Jul 01 18:28:51.677155 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.677109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n92v5" event={"ID":"1e5d4b77-430e-4741-af57-6d0fad415845","Type":"ContainerStarted","Data":"86d5745acff49e48065750596c5b0536ed641b4095808dd42000050fc18a1a34"} Jul 01 18:28:51.693321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.693277 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554bf87564-mlljl" podStartSLOduration=2.693264631 podStartE2EDuration="2.693264631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.691564678 +0000 UTC m=+88.941447792" watchObservedRunningTime="2026-07-01 18:28:51.693264631 +0000 UTC m=+88.943147744" Jul 01 18:28:51.712566 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:51.712525 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6ddb469b-4gf8l" podStartSLOduration=2.330994027 podStartE2EDuration="7.712513539s" totalImagesPullingTime="5.381519512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:51.71112127 +0000 UTC m=+88.961004384" watchObservedRunningTime="2026-07-01 18:28:51.712513539 +0000 UTC m=+88.962396629" Jul 01 18:28:52.921837 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.921796 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-545d9"] Jul 01 18:28:52.926285 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.926265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:52.930586 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.930556 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 18:28:52.930586 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.930577 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dmrj4\"" Jul 01 18:28:52.930586 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.930564 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 18:28:52.930844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.930579 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 18:28:52.935179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:52.935159 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-545d9"] Jul 01 18:28:53.072793 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.072743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.072950 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.072862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.072950 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.072906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjsvb\" (UniqueName: \"kubernetes.io/projected/3935ec08-a5ac-4032-b92e-ced1680d5e53-kube-api-access-vjsvb\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.072950 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.072942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3935ec08-a5ac-4032-b92e-ced1680d5e53-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.173672 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.173586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjsvb\" (UniqueName: \"kubernetes.io/projected/3935ec08-a5ac-4032-b92e-ced1680d5e53-kube-api-access-vjsvb\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.173672 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.173638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3935ec08-a5ac-4032-b92e-ced1680d5e53-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.173933 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.173698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.173933 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.173804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.173933 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:53.173832 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 18:28:53.173933 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:28:53.173901 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls podName:3935ec08-a5ac-4032-b92e-ced1680d5e53 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:53.673879217 +0000 UTC m=+90.923762308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-545d9" (UID: "3935ec08-a5ac-4032-b92e-ced1680d5e53") : secret "prometheus-operator-tls" not found Jul 01 18:28:53.174459 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.174417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3935ec08-a5ac-4032-b92e-ced1680d5e53-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.176504 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.176482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.182656 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.182634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjsvb\" (UniqueName: \"kubernetes.io/projected/3935ec08-a5ac-4032-b92e-ced1680d5e53-kube-api-access-vjsvb\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.677203 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.677170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.679801 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.679759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3935ec08-a5ac-4032-b92e-ced1680d5e53-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-545d9\" (UID: \"3935ec08-a5ac-4032-b92e-ced1680d5e53\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:53.837407 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:53.837375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" Jul 01 18:28:54.022671 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:54.022649 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-545d9"] Jul 01 18:28:54.024894 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:54.024867 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3935ec08_a5ac_4032_b92e_ced1680d5e53.slice/crio-eedada1f6260bbb44ad7ddbdfb37a8b2e549fd688b8824c884723b839bd7afe5 WatchSource:0}: Error finding container eedada1f6260bbb44ad7ddbdfb37a8b2e549fd688b8824c884723b839bd7afe5: Status 404 returned error can't find the container with id eedada1f6260bbb44ad7ddbdfb37a8b2e549fd688b8824c884723b839bd7afe5 Jul 01 18:28:54.689997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:54.689954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n92v5" event={"ID":"1e5d4b77-430e-4741-af57-6d0fad415845","Type":"ContainerStarted","Data":"03e27b3892eb3c4fb211bb558a5bf3b702414d793ae497602b806a6407b0ac28"} Jul 01 18:28:54.691059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:54.691036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" event={"ID":"3935ec08-a5ac-4032-b92e-ced1680d5e53","Type":"ContainerStarted","Data":"eedada1f6260bbb44ad7ddbdfb37a8b2e549fd688b8824c884723b839bd7afe5"} Jul 01 18:28:54.709160 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:54.709106 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n92v5" podStartSLOduration=33.278256036 podStartE2EDuration="40.709092413s" totalImagesPullingTime="7.430836377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:54.707908937 +0000 UTC m=+91.957792060" watchObservedRunningTime="2026-07-01 18:28:54.709092413 +0000 UTC m=+91.958975525" Jul 01 18:28:55.188152 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:55.188118 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:55.188587 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:55.188185 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:28:55.189740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:55.189712 2566 patch_prober.go:28] interesting pod/console-5f6ddb469b-4gf8l container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 01 18:28:55.189894 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:55.189770 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f6ddb469b-4gf8l" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 01 18:28:56.699199 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:56.699154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" event={"ID":"3935ec08-a5ac-4032-b92e-ced1680d5e53","Type":"ContainerStarted","Data":"8dca6d160ad53bd891bce8070d043de1f223409bcdd960b54ddfc850886b275a"} Jul 01 18:28:56.699609 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:56.699212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" event={"ID":"3935ec08-a5ac-4032-b92e-ced1680d5e53","Type":"ContainerStarted","Data":"b47427f576562b0b429fae69af4da5109c41a434b1a04ff2dc93885db8f5af3c"} Jul 01 18:28:56.717014 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:56.716974 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-545d9" podStartSLOduration=3.05164551 podStartE2EDuration="4.716961798s" totalImagesPullingTime="1.665316288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:56.716818788 +0000 UTC m=+93.966701901" watchObservedRunningTime="2026-07-01 18:28:56.716961798 +0000 UTC m=+93.966844910" Jul 01 18:28:58.356910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.356875 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8c55k"] Jul 01 18:28:58.360351 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.360331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.363505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.363484 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 18:28:58.363772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.363755 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7jwb\"" Jul 01 18:28:58.363903 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.363818 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 18:28:58.364003 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.363921 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 18:28:58.513425 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-wtmp\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-root\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-sys\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-metrics-client-ca\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513671 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t54bc\" (UniqueName: \"kubernetes.io/projected/f83be1d9-329e-4a13-acf0-b29852e980bd-kube-api-access-t54bc\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513671 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-tls\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513816 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-textfile\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.513816 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.513772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615039 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.614982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-tls\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615039 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615039 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-textfile\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-wtmp\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-root\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-sys\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-metrics-client-ca\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t54bc\" (UniqueName: \"kubernetes.io/projected/f83be1d9-329e-4a13-acf0-b29852e980bd-kube-api-access-t54bc\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-root\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-wtmp\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83be1d9-329e-4a13-acf0-b29852e980bd-sys\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-textfile\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.615926 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-metrics-client-ca\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.616030 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.615981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.617632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.617607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-tls\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.617748 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.617728 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83be1d9-329e-4a13-acf0-b29852e980bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.624001 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.623981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t54bc\" (UniqueName: \"kubernetes.io/projected/f83be1d9-329e-4a13-acf0-b29852e980bd-kube-api-access-t54bc\") pod \"node-exporter-8c55k\" (UID: \"f83be1d9-329e-4a13-acf0-b29852e980bd\") " pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.669698 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.669671 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8c55k" Jul 01 18:28:58.681642 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:28:58.681619 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83be1d9_329e_4a13_acf0_b29852e980bd.slice/crio-bd4e9caa5d83417d980fe326ed60f098a2d9b725b83525285a0fbbc1d8241b00 WatchSource:0}: Error finding container bd4e9caa5d83417d980fe326ed60f098a2d9b725b83525285a0fbbc1d8241b00: Status 404 returned error can't find the container with id bd4e9caa5d83417d980fe326ed60f098a2d9b725b83525285a0fbbc1d8241b00 Jul 01 18:28:58.706680 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:58.706658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8c55k" event={"ID":"f83be1d9-329e-4a13-acf0-b29852e980bd","Type":"ContainerStarted","Data":"bd4e9caa5d83417d980fe326ed60f098a2d9b725b83525285a0fbbc1d8241b00"} Jul 01 18:28:59.870829 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:59.870804 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:59.871147 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:59.870883 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:28:59.872437 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:59.872408 2566 patch_prober.go:28] interesting pod/console-554bf87564-mlljl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jul 01 18:28:59.872542 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:28:59.872455 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554bf87564-mlljl" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jul 01 18:29:00.262747 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.262718 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b978d8b78-nfh8g"] Jul 01 18:29:00.266327 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.266305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.269632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.269569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2jqnv\"" Jul 01 18:29:00.269804 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.269701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 18:29:00.269804 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.269730 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 18:29:00.269944 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.269855 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-da94n4m35u47m\"" Jul 01 18:29:00.270057 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.270040 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 18:29:00.270992 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.270975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 18:29:00.271072 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.271038 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 18:29:00.278560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.278541 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b978d8b78-nfh8g"] Jul 01 18:29:00.334255 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-grpc-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334386 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334386 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334386 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgp7c\" (UniqueName: \"kubernetes.io/projected/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-kube-api-access-mgp7c\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-metrics-client-ca\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.334571 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.334502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435110 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435114 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgp7c\" (UniqueName: \"kubernetes.io/projected/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-kube-api-access-mgp7c\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-metrics-client-ca\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435433 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-grpc-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435433 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435536 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.435971 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.435949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-metrics-client-ca\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.437971 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.437949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.438296 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.438271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.438451 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.438435 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.438578 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.438556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.438639 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.438623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.438720 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.438698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-secret-grpc-tls\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.446259 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.446233 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgp7c\" (UniqueName: \"kubernetes.io/projected/3e2b74ba-5614-4b52-afa5-06b8870f5ce6-kube-api-access-mgp7c\") pod \"thanos-querier-5b978d8b78-nfh8g\" (UID: \"3e2b74ba-5614-4b52-afa5-06b8870f5ce6\") " pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.575803 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.575729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:00.711825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.711770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b978d8b78-nfh8g"] Jul 01 18:29:00.715141 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:29:00.715111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2b74ba_5614_4b52_afa5_06b8870f5ce6.slice/crio-c509f60fbce00fd8c566db23c3517519c2d70234edba6c3bc69344392fc6c1f1 WatchSource:0}: Error finding container c509f60fbce00fd8c566db23c3517519c2d70234edba6c3bc69344392fc6c1f1: Status 404 returned error can't find the container with id c509f60fbce00fd8c566db23c3517519c2d70234edba6c3bc69344392fc6c1f1 Jul 01 18:29:00.716158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.716135 2566 generic.go:356] "Generic (PLEG): container finished" podID="f83be1d9-329e-4a13-acf0-b29852e980bd" containerID="48d28103a1472c55218ca571fd46b3569d9aff9c993d23bdef2b3c345e1326e2" exitCode=0 Jul 01 18:29:00.716240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:00.716174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8c55k" event={"ID":"f83be1d9-329e-4a13-acf0-b29852e980bd","Type":"ContainerDied","Data":"48d28103a1472c55218ca571fd46b3569d9aff9c993d23bdef2b3c345e1326e2"} Jul 01 18:29:01.720435 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:01.720401 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"c509f60fbce00fd8c566db23c3517519c2d70234edba6c3bc69344392fc6c1f1"} Jul 01 18:29:01.722440 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:01.722416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8c55k" event={"ID":"f83be1d9-329e-4a13-acf0-b29852e980bd","Type":"ContainerStarted","Data":"e7949e58e33533aa6872d6796014479c983f23536d18ec816e57383878102c73"} Jul 01 18:29:01.722562 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:01.722458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8c55k" event={"ID":"f83be1d9-329e-4a13-acf0-b29852e980bd","Type":"ContainerStarted","Data":"844ecc255c8d1093701b33d8d25ccbecc72db9c1b70597829f1ed6d19799c8ce"} Jul 01 18:29:01.743647 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:01.743601 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8c55k" podStartSLOduration=2.551019719 podStartE2EDuration="3.743587863s" totalImagesPullingTime="1.122391565s" totalInitContainerRuntime="70.176579ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:01.741903064 +0000 UTC m=+98.991786169" watchObservedRunningTime="2026-07-01 18:29:01.743587863 +0000 UTC m=+98.993470976" Jul 01 18:29:02.553510 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.553467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:02.553510 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.553510 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:29:02.556087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.556049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"image-registry-5f47bc4c74-2t42d\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:02.556087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.556080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1130b76b-a750-407f-8bd5-823ef4464179-metrics-tls\") pod \"dns-default-zmpvf\" (UID: \"1130b76b-a750-407f-8bd5-823ef4464179\") " pod="openshift-dns/dns-default-zmpvf" Jul 01 18:29:02.781277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.781249 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8xwh\"" Jul 01 18:29:02.788940 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.788914 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:02.803400 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.803375 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:29:02.811082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:02.811033 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmpvf" Jul 01 18:29:03.086675 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.086598 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:29:03.164460 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.164423 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:29:03.168068 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.168042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.180144 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.180115 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:29:03.260958 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.260923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261120 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.260984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261120 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.261058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.261137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5mnj\" (UniqueName: \"kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261298 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.261280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261338 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.261309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.261338 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.261326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362163 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362234 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362253 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.362427 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.362283 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5mnj\" (UniqueName: \"kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.363404 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.363235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.363404 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.363355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.363660 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.363637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.364135 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.364107 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.366458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.366433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.366601 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.366548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.371537 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.371516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5mnj\" (UniqueName: \"kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj\") pod \"console-6c875657bb-kfffs\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.382368 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.382243 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmpvf"] Jul 01 18:29:03.385628 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:29:03.385603 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1130b76b_a750_407f_8bd5_823ef4464179.slice/crio-004c32c49649343c45d0976cedc8ac163973d2f3ebd7a5d2b66e97a4d14a5b13 WatchSource:0}: Error finding container 004c32c49649343c45d0976cedc8ac163973d2f3ebd7a5d2b66e97a4d14a5b13: Status 404 returned error can't find the container with id 004c32c49649343c45d0976cedc8ac163973d2f3ebd7a5d2b66e97a4d14a5b13 Jul 01 18:29:03.405196 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.405173 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:29:03.409650 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:29:03.409621 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123a3b09_ccae_4f17_9c86_d20be2c5f6e1.slice/crio-4138b2982c61fe27752926c56557f73784078097910b48c823831b3b49503633 WatchSource:0}: Error finding container 4138b2982c61fe27752926c56557f73784078097910b48c823831b3b49503633: Status 404 returned error can't find the container with id 4138b2982c61fe27752926c56557f73784078097910b48c823831b3b49503633 Jul 01 18:29:03.481703 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.481677 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:03.647187 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.647155 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:29:03.651091 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:29:03.651056 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47c4dd3_f29b_4e17_9a2f_0d1e5ce38f91.slice/crio-611cf7bbfc9857fd4675c24157b624e23688f733fe6d7909780181f2e2023814 WatchSource:0}: Error finding container 611cf7bbfc9857fd4675c24157b624e23688f733fe6d7909780181f2e2023814: Status 404 returned error can't find the container with id 611cf7bbfc9857fd4675c24157b624e23688f733fe6d7909780181f2e2023814 Jul 01 18:29:03.732581 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.732537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c875657bb-kfffs" event={"ID":"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91","Type":"ContainerStarted","Data":"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782"} Jul 01 18:29:03.732708 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.732609 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c875657bb-kfffs" event={"ID":"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91","Type":"ContainerStarted","Data":"611cf7bbfc9857fd4675c24157b624e23688f733fe6d7909780181f2e2023814"} Jul 01 18:29:03.734310 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.734281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" event={"ID":"123a3b09-ccae-4f17-9c86-d20be2c5f6e1","Type":"ContainerStarted","Data":"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879"} Jul 01 18:29:03.734447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.734341 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" event={"ID":"123a3b09-ccae-4f17-9c86-d20be2c5f6e1","Type":"ContainerStarted","Data":"4138b2982c61fe27752926c56557f73784078097910b48c823831b3b49503633"} Jul 01 18:29:03.734447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.734370 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:03.735506 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.735482 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmpvf" event={"ID":"1130b76b-a750-407f-8bd5-823ef4464179","Type":"ContainerStarted","Data":"004c32c49649343c45d0976cedc8ac163973d2f3ebd7a5d2b66e97a4d14a5b13"} Jul 01 18:29:03.738766 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.738747 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"c0e4e5fb60a6cd68c63c93b3b379b7b653ce49b2d6e8269b776a9dd408ea8412"} Jul 01 18:29:03.738869 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.738822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"85dfb53678a9297a12ca17b4f4f9b196b089adc6d72a0c5f85767e73b9c1f1ed"} Jul 01 18:29:03.738869 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.738851 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"836cc241ebd0c3a4ffdedf21ade39a67e391eba5d354e20cc123ab71e57f1dd9"} Jul 01 18:29:03.758245 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:03.758200 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c875657bb-kfffs" podStartSLOduration=0.75818454 podStartE2EDuration="758.18454ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:03.755977545 +0000 UTC m=+101.005860657" watchObservedRunningTime="2026-07-01 18:29:03.75818454 +0000 UTC m=+101.008067656" Jul 01 18:29:04.599063 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:04.599022 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sz29l" Jul 01 18:29:04.625824 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:04.625740 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" podStartSLOduration=100.625719242 podStartE2EDuration="1m40.625719242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:03.783770894 +0000 UTC m=+101.033654007" watchObservedRunningTime="2026-07-01 18:29:04.625719242 +0000 UTC m=+101.875602356" Jul 01 18:29:05.750502 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.750461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmpvf" event={"ID":"1130b76b-a750-407f-8bd5-823ef4464179","Type":"ContainerStarted","Data":"7d64961e1acef07efad7afd2e6324dd503d7b1e8e07a3dd2626b661528c85281"} Jul 01 18:29:05.750935 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.750521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmpvf" event={"ID":"1130b76b-a750-407f-8bd5-823ef4464179","Type":"ContainerStarted","Data":"aa83917cc96070c77deaa9d62b551929399fdb12b1dd134ab09ec3d690638a96"} Jul 01 18:29:05.750935 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.750549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zmpvf" Jul 01 18:29:05.753565 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.753536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"66fd27f90809c5644c21f20f5290655ed471350b439a027d33edd5bdd4654e8f"} Jul 01 18:29:05.753677 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.753614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"6aa8d8ae1b25bcfd7fbc55f77469d0b2501b75c293ac3a49979485910a3584fd"} Jul 01 18:29:05.753677 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.753666 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:05.753772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.753708 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" event={"ID":"3e2b74ba-5614-4b52-afa5-06b8870f5ce6","Type":"ContainerStarted","Data":"395737204e038eeab6112d079676d33cf758a10908ee13d43890a4957d4f93c6"} Jul 01 18:29:05.769847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.769804 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zmpvf" podStartSLOduration=65.788072933 podStartE2EDuration="1m7.769776114s" totalImagesPullingTime="1.981703181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:05.76855952 +0000 UTC m=+103.018442672" watchObservedRunningTime="2026-07-01 18:29:05.769776114 +0000 UTC m=+103.019659205" Jul 01 18:29:05.797060 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:05.797021 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" podStartSLOduration=1.948941138 podStartE2EDuration="5.797008366s" totalImagesPullingTime="3.848067228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:05.795443237 +0000 UTC m=+103.045326362" watchObservedRunningTime="2026-07-01 18:29:05.797008366 +0000 UTC m=+103.046891479" Jul 01 18:29:09.065366 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:09.065334 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:29:09.873824 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:09.873778 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:29:09.877809 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:09.877755 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:29:11.764479 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:11.764447 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b978d8b78-nfh8g" Jul 01 18:29:13.482777 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:13.482748 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:13.483150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:13.482832 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:13.487583 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:13.487561 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:13.788068 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:13.787989 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:29:13.851737 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:13.851706 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:29:15.759516 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:15.759485 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zmpvf" Jul 01 18:29:19.071083 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:19.071060 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:23.823537 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:23.823498 2566 generic.go:356] "Generic (PLEG): container finished" podID="b2b476ee-36a3-4b0e-93d5-aef49d9d82ef" containerID="b8c9333f7290cbd172d6b1c0f3a706903fc05ced4e45ea0a163ddd90712f693c" exitCode=0 Jul 01 18:29:23.824031 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:23.823543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" event={"ID":"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef","Type":"ContainerDied","Data":"b8c9333f7290cbd172d6b1c0f3a706903fc05ced4e45ea0a163ddd90712f693c"} Jul 01 18:29:23.824031 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:23.823987 2566 scope.go:117] "RemoveContainer" containerID="b8c9333f7290cbd172d6b1c0f3a706903fc05ced4e45ea0a163ddd90712f693c" Jul 01 18:29:24.553614 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:24.553588 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7847669bd5-k84r8_45ad114e-5a80-40e7-9f0b-b6b16a094f1a/router/0.log" Jul 01 18:29:24.559478 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:24.559459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cdvf2_1cdae818-292a-432c-95b2-429d0f2d54ed/serve-healthcheck-canary/0.log" Jul 01 18:29:24.829395 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:24.829323 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-7j6kn" event={"ID":"b2b476ee-36a3-4b0e-93d5-aef49d9d82ef","Type":"ContainerStarted","Data":"529c461e4dfb9113e1da4364e53bc0a7608eda1d96dc1df17f43456b7507fa18"} Jul 01 18:29:28.111918 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.111852 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6ddb469b-4gf8l" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerName="console" containerID="cri-o://d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c" gracePeriod=15 Jul 01 18:29:28.359659 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.359637 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:29:28.471256 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471227 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471262 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471289 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22q2s\" (UniqueName: \"kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471322 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471358 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471380 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471376 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config\") pod \"9959b3ac-e22b-44c8-995f-b84ed29c438e\" (UID: \"9959b3ac-e22b-44c8-995f-b84ed29c438e\") " Jul 01 18:29:28.471735 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471692 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:28.471879 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471819 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca" (OuterVolumeSpecName: "service-ca") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:28.471879 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.471834 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config" (OuterVolumeSpecName: "console-config") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:28.473660 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.473640 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:28.473754 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.473673 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:28.473754 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.473721 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s" (OuterVolumeSpecName: "kube-api-access-22q2s") pod "9959b3ac-e22b-44c8-995f-b84ed29c438e" (UID: "9959b3ac-e22b-44c8-995f-b84ed29c438e"). InnerVolumeSpecName "kube-api-access-22q2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:29:28.571895 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571869 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22q2s\" (UniqueName: \"kubernetes.io/projected/9959b3ac-e22b-44c8-995f-b84ed29c438e-kube-api-access-22q2s\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.571895 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571892 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.572034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571901 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.572034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571910 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.572034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571918 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9959b3ac-e22b-44c8-995f-b84ed29c438e-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.572034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.571925 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9959b3ac-e22b-44c8-995f-b84ed29c438e-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:28.846240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.846148 2566 generic.go:356] "Generic (PLEG): container finished" podID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerID="d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c" exitCode=0 Jul 01 18:29:28.846240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.846194 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6ddb469b-4gf8l" Jul 01 18:29:28.846240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.846212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6ddb469b-4gf8l" event={"ID":"9959b3ac-e22b-44c8-995f-b84ed29c438e","Type":"ContainerDied","Data":"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c"} Jul 01 18:29:28.846485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.846254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6ddb469b-4gf8l" event={"ID":"9959b3ac-e22b-44c8-995f-b84ed29c438e","Type":"ContainerDied","Data":"81ee8b0132d84d941df1d81576bec8d0e87dabba5ae6d08fd7400a292a40a2e0"} Jul 01 18:29:28.846485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.846275 2566 scope.go:117] "RemoveContainer" containerID="d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c" Jul 01 18:29:28.859899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.859880 2566 scope.go:117] "RemoveContainer" containerID="d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c" Jul 01 18:29:28.860185 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:29:28.860164 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c\": container with ID starting with d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c not found: ID does not exist" containerID="d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c" Jul 01 18:29:28.860255 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.860196 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c"} err="failed to get container status \"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c\": rpc error: code = NotFound desc = could not find container \"d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c\": container with ID starting with d1c0c76469b1af37864418486b8634c13afa19a1214a7eedeeba8295acbf5a1c not found: ID does not exist" Jul 01 18:29:28.871718 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.871698 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:29:28.878185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:28.878169 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6ddb469b-4gf8l"] Jul 01 18:29:29.204372 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:29.204345 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" path="/var/lib/kubelet/pods/9959b3ac-e22b-44c8-995f-b84ed29c438e/volumes" Jul 01 18:29:33.107258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.107217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:29:33.110081 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.110048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b67e645-9631-4417-874d-4be91078ecbd-metrics-certs\") pod \"network-metrics-daemon-kvf8h\" (UID: \"5b67e645-9631-4417-874d-4be91078ecbd\") " pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:29:33.118677 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.118641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:29:33.126109 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.126086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kvf8h" Jul 01 18:29:33.268428 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.266538 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kvf8h"] Jul 01 18:29:33.868201 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:33.868160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvf8h" event={"ID":"5b67e645-9631-4417-874d-4be91078ecbd","Type":"ContainerStarted","Data":"602a50fd7ac86560d2e0163788268c13fcd0c68dc338d5364af0786c10f2f1d4"} Jul 01 18:29:34.085900 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.085855 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" podUID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" containerName="registry" containerID="cri-o://b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879" gracePeriod=30 Jul 01 18:29:34.409706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.409684 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:34.519226 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519204 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519344 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519251 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519344 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519315 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519449 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519345 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519449 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519377 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519449 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519414 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519595 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519454 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519595 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519512 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stbjv\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv\") pod \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\" (UID: \"123a3b09-ccae-4f17-9c86-d20be2c5f6e1\") " Jul 01 18:29:34.519962 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519906 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:34.519962 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.519910 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:34.522193 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.522163 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:29:34.522399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.522374 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:34.522487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.522457 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:34.522665 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.522643 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:29:34.522719 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.522701 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv" (OuterVolumeSpecName: "kube-api-access-stbjv") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "kube-api-access-stbjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:29:34.528053 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.528030 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "123a3b09-ccae-4f17-9c86-d20be2c5f6e1" (UID: "123a3b09-ccae-4f17-9c86-d20be2c5f6e1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:29:34.620657 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620633 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stbjv\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-kube-api-access-stbjv\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620657 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620655 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-trusted-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620665 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-ca-trust-extracted\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620674 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-image-registry-private-configuration\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620686 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-bound-sa-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620697 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-certificates\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620707 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-registry-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.620814 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.620717 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123a3b09-ccae-4f17-9c86-d20be2c5f6e1-installation-pull-secrets\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:34.874262 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.874178 2566 generic.go:356] "Generic (PLEG): container finished" podID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" containerID="b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879" exitCode=0 Jul 01 18:29:34.874262 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.874225 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" Jul 01 18:29:34.874481 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.874261 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" event={"ID":"123a3b09-ccae-4f17-9c86-d20be2c5f6e1","Type":"ContainerDied","Data":"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879"} Jul 01 18:29:34.874481 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.874313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f47bc4c74-2t42d" event={"ID":"123a3b09-ccae-4f17-9c86-d20be2c5f6e1","Type":"ContainerDied","Data":"4138b2982c61fe27752926c56557f73784078097910b48c823831b3b49503633"} Jul 01 18:29:34.874481 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.874326 2566 scope.go:117] "RemoveContainer" containerID="b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879" Jul 01 18:29:34.876573 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.876548 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvf8h" event={"ID":"5b67e645-9631-4417-874d-4be91078ecbd","Type":"ContainerStarted","Data":"61407e7d409d0898d2f5392280b07b04dbadebd2a32c1be2c52ed639defa884b"} Jul 01 18:29:34.876697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.876601 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kvf8h" event={"ID":"5b67e645-9631-4417-874d-4be91078ecbd","Type":"ContainerStarted","Data":"97a083fce421d2f00399468794af98b9091015e3f021bf6b7e7f733d09ce2fbc"} Jul 01 18:29:34.884234 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.884215 2566 scope.go:117] "RemoveContainer" containerID="b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879" Jul 01 18:29:34.884575 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:29:34.884552 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879\": container with ID starting with b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879 not found: ID does not exist" containerID="b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879" Jul 01 18:29:34.884653 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.884587 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879"} err="failed to get container status \"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879\": rpc error: code = NotFound desc = could not find container \"b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879\": container with ID starting with b7be35a6a22a34947fdcd1efd9f5f9dcf6f170c52d4930c608fddcc6acfe4879 not found: ID does not exist" Jul 01 18:29:34.897738 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.897687 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kvf8h" podStartSLOduration=129.877534449 podStartE2EDuration="2m10.897669155s" totalImagesPullingTime="1.020134706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:34.895572606 +0000 UTC m=+132.145455720" watchObservedRunningTime="2026-07-01 18:29:34.897669155 +0000 UTC m=+132.147552269" Jul 01 18:29:34.910542 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.910520 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:29:34.915224 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:34.915204 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f47bc4c74-2t42d"] Jul 01 18:29:35.205578 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:35.205535 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" path="/var/lib/kubelet/pods/123a3b09-ccae-4f17-9c86-d20be2c5f6e1/volumes" Jul 01 18:29:38.873738 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:38.873673 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-554bf87564-mlljl" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerName="console" containerID="cri-o://99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62" gracePeriod=15 Jul 01 18:29:39.110017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.109996 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:29:39.261825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261772 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.261825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261826 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261857 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261873 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261901 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.261917 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh9xx\" (UniqueName: \"kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262219 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.262096 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert\") pod \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\" (UID: \"6567fa3c-23ee-4514-a64e-7dbd9ba034f2\") " Jul 01 18:29:39.262418 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.262385 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config" (OuterVolumeSpecName: "console-config") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:39.262676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.262432 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:39.262676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.262444 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:39.262676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.262481 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:29:39.264033 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.264009 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:39.264193 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.264170 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx" (OuterVolumeSpecName: "kube-api-access-wh9xx") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "kube-api-access-wh9xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:29:39.264193 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.264181 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6567fa3c-23ee-4514-a64e-7dbd9ba034f2" (UID: "6567fa3c-23ee-4514-a64e-7dbd9ba034f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:29:39.363615 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363595 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363615 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363614 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363623 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363633 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh9xx\" (UniqueName: \"kubernetes.io/projected/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-kube-api-access-wh9xx\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363642 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363650 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.363724 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.363658 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567fa3c-23ee-4514-a64e-7dbd9ba034f2-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:29:39.900052 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.900017 2566 generic.go:356] "Generic (PLEG): container finished" podID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerID="99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62" exitCode=0 Jul 01 18:29:39.900524 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.900074 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bf87564-mlljl" Jul 01 18:29:39.900524 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.900113 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bf87564-mlljl" event={"ID":"6567fa3c-23ee-4514-a64e-7dbd9ba034f2","Type":"ContainerDied","Data":"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62"} Jul 01 18:29:39.900524 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.900177 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bf87564-mlljl" event={"ID":"6567fa3c-23ee-4514-a64e-7dbd9ba034f2","Type":"ContainerDied","Data":"e49215a1c35c69401426ea825ebbcbb3531980a3698171e2c593c82d53e931d9"} Jul 01 18:29:39.900524 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.900212 2566 scope.go:117] "RemoveContainer" containerID="99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62" Jul 01 18:29:39.909867 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.909847 2566 scope.go:117] "RemoveContainer" containerID="99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62" Jul 01 18:29:39.910172 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:29:39.910153 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62\": container with ID starting with 99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62 not found: ID does not exist" containerID="99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62" Jul 01 18:29:39.910257 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.910184 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62"} err="failed to get container status \"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62\": rpc error: code = NotFound desc = could not find container \"99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62\": container with ID starting with 99e349643b92ef71a54c37b403647241b7b14ec6ae7e8ccd25b6d4e7dce83e62 not found: ID does not exist" Jul 01 18:29:39.921555 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.921531 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:29:39.926503 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:39.926482 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554bf87564-mlljl"] Jul 01 18:29:41.204845 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:29:41.204813 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" path="/var/lib/kubelet/pods/6567fa3c-23ee-4514-a64e-7dbd9ba034f2/volumes" Jul 01 18:30:22.569425 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569338 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f"] Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569758 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerName="console" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569774 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerName="console" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569803 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerName="console" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569812 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerName="console" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569824 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" containerName="registry" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569832 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" containerName="registry" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569896 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="123a3b09-ccae-4f17-9c86-d20be2c5f6e1" containerName="registry" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569905 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9959b3ac-e22b-44c8-995f-b84ed29c438e" containerName="console" Jul 01 18:30:22.569979 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.569915 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6567fa3c-23ee-4514-a64e-7dbd9ba034f2" containerName="console" Jul 01 18:30:22.573299 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.573278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.576618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.576416 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 18:30:22.576618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.576450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nkbdl\"" Jul 01 18:30:22.576820 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.576745 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 18:30:22.576988 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.576962 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 18:30:22.577175 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.577158 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 18:30:22.577901 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.577884 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 18:30:22.581434 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.581413 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 18:30:22.587889 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.587810 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f"] Jul 01 18:30:22.670752 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.670752 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-metrics-client-ca\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.670975 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.670975 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-serving-certs-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.670975 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.670975 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.670925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.671143 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.671009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knp2g\" (UniqueName: \"kubernetes.io/projected/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-kube-api-access-knp2g\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.671143 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.671041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-federate-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-serving-certs-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knp2g\" (UniqueName: \"kubernetes.io/projected/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-kube-api-access-knp2g\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-federate-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772416 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.772416 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.772329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-metrics-client-ca\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.773178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.773100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.773178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.773123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-serving-certs-ca-bundle\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.773359 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.773253 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-metrics-client-ca\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.775045 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.775022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-federate-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.775196 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.775171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.775332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.775315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-telemeter-client-tls\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.775368 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.775338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.782071 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.782051 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knp2g\" (UniqueName: \"kubernetes.io/projected/9e4841b2-ed9e-4c83-a468-e9b6c4d29990-kube-api-access-knp2g\") pod \"telemeter-client-6fbc6c74cd-x6x9f\" (UID: \"9e4841b2-ed9e-4c83-a468-e9b6c4d29990\") " pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:22.886213 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:22.886156 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" Jul 01 18:30:23.021631 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:23.021595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f"] Jul 01 18:30:23.025855 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:30:23.025822 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4841b2_ed9e_4c83_a468_e9b6c4d29990.slice/crio-31250aa6feae295d3257be07d0622c7eff2cbe7b3ecaec78d080411e1db6d156 WatchSource:0}: Error finding container 31250aa6feae295d3257be07d0622c7eff2cbe7b3ecaec78d080411e1db6d156: Status 404 returned error can't find the container with id 31250aa6feae295d3257be07d0622c7eff2cbe7b3ecaec78d080411e1db6d156 Jul 01 18:30:23.070706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:23.070677 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" event={"ID":"9e4841b2-ed9e-4c83-a468-e9b6c4d29990","Type":"ContainerStarted","Data":"31250aa6feae295d3257be07d0622c7eff2cbe7b3ecaec78d080411e1db6d156"} Jul 01 18:30:26.084289 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:26.084244 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" event={"ID":"9e4841b2-ed9e-4c83-a468-e9b6c4d29990","Type":"ContainerStarted","Data":"a1005f2123f14bd3297fa3fe2b4d6855cae9a059e5cbbda3d8578b31741dde36"} Jul 01 18:30:28.093084 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.093043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" event={"ID":"9e4841b2-ed9e-4c83-a468-e9b6c4d29990","Type":"ContainerStarted","Data":"0fb04810e9bfe21d394e302c39cea317d120a899f12e72bf59dae4dbd6a6ee9c"} Jul 01 18:30:28.093436 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.093105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" event={"ID":"9e4841b2-ed9e-4c83-a468-e9b6c4d29990","Type":"ContainerStarted","Data":"6828c86f861eeefaec893e17e7df9286040f93a001ab8af28df254c81e8060f7"} Jul 01 18:30:28.120006 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.119955 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fbc6c74cd-x6x9f" podStartSLOduration=1.6020094390000001 podStartE2EDuration="6.119940503s" totalImagesPullingTime="4.517931064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:30:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:30:28.119146214 +0000 UTC m=+185.369029338" watchObservedRunningTime="2026-07-01 18:30:28.119940503 +0000 UTC m=+185.369823616" Jul 01 18:30:28.942350 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.942312 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:30:28.945938 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.945906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:28.957572 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:28.957511 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:30:29.021772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgrdp\" (UniqueName: \"kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.021969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.021969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.021969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.021969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.021969 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.022240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.021999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123077 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgrdp\" (UniqueName: \"kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.123932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.124005 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.123931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.124052 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.124030 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.124769 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.124746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.125841 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.125815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.126093 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.126076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.132139 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.132118 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgrdp\" (UniqueName: \"kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp\") pod \"console-64c6988b6-f28tg\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.259041 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.258965 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:29.398069 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:29.398041 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:30:29.400507 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:30:29.400478 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1370e7_e0d2_4ae8_bcef_ddfa824573d1.slice/crio-277dcb65b46a55a72bd8697e54d34a1e34e314e9ca82ad0af459c0aa6cf7bfd1 WatchSource:0}: Error finding container 277dcb65b46a55a72bd8697e54d34a1e34e314e9ca82ad0af459c0aa6cf7bfd1: Status 404 returned error can't find the container with id 277dcb65b46a55a72bd8697e54d34a1e34e314e9ca82ad0af459c0aa6cf7bfd1 Jul 01 18:30:30.102007 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:30.101966 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c6988b6-f28tg" event={"ID":"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1","Type":"ContainerStarted","Data":"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863"} Jul 01 18:30:30.102182 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:30.102020 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c6988b6-f28tg" event={"ID":"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1","Type":"ContainerStarted","Data":"277dcb65b46a55a72bd8697e54d34a1e34e314e9ca82ad0af459c0aa6cf7bfd1"} Jul 01 18:30:30.120562 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:30.120517 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c6988b6-f28tg" podStartSLOduration=2.120502457 podStartE2EDuration="2.120502457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:30:30.120190442 +0000 UTC m=+187.370073565" watchObservedRunningTime="2026-07-01 18:30:30.120502457 +0000 UTC m=+187.370385569" Jul 01 18:30:35.446983 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.446947 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:30:35.482344 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.482314 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d7d58575-2cq6p"] Jul 01 18:30:35.485629 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.485605 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.498868 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.498848 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d7d58575-2cq6p"] Jul 01 18:30:35.574244 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-service-ca\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574357 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-trusted-ca-bundle\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574357 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574443 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z969p\" (UniqueName: \"kubernetes.io/projected/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-kube-api-access-z969p\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574443 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-oauth-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.574538 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.574502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-oauth-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675049 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-service-ca\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-trusted-ca-bundle\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z969p\" (UniqueName: \"kubernetes.io/projected/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-kube-api-access-z969p\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-oauth-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675428 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-oauth-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675843 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-service-ca\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.675936 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.675880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.676226 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.676204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-trusted-ca-bundle\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.676271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.676249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-oauth-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.677704 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.677683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-oauth-config\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.677877 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.677861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-console-serving-cert\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.683857 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.683838 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z969p\" (UniqueName: \"kubernetes.io/projected/1d6a46a4-83fb-4fc0-b1e8-300d97fcb655-kube-api-access-z969p\") pod \"console-59d7d58575-2cq6p\" (UID: \"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655\") " pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.794615 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.794533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:35.935292 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:35.935257 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d7d58575-2cq6p"] Jul 01 18:30:35.938303 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:30:35.938272 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6a46a4_83fb_4fc0_b1e8_300d97fcb655.slice/crio-a0bebb5edc62eb987f6e5908a39963db904100d61e3ce707e691eea0695f9afb WatchSource:0}: Error finding container a0bebb5edc62eb987f6e5908a39963db904100d61e3ce707e691eea0695f9afb: Status 404 returned error can't find the container with id a0bebb5edc62eb987f6e5908a39963db904100d61e3ce707e691eea0695f9afb Jul 01 18:30:36.127857 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:36.127726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d7d58575-2cq6p" event={"ID":"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655","Type":"ContainerStarted","Data":"e5d3863d3cfc89495bb9c5cc358bb76a43ae11dad2f2b4b25fc0bf3a5fb0f4a9"} Jul 01 18:30:36.127857 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:36.127814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d7d58575-2cq6p" event={"ID":"1d6a46a4-83fb-4fc0-b1e8-300d97fcb655","Type":"ContainerStarted","Data":"a0bebb5edc62eb987f6e5908a39963db904100d61e3ce707e691eea0695f9afb"} Jul 01 18:30:36.147584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:36.147521 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d7d58575-2cq6p" podStartSLOduration=1.147504369 podStartE2EDuration="1.147504369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:30:36.147470788 +0000 UTC m=+193.397353921" watchObservedRunningTime="2026-07-01 18:30:36.147504369 +0000 UTC m=+193.397387482" Jul 01 18:30:39.259136 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:39.259097 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:30:45.795000 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:45.794962 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:45.795457 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:45.795029 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:45.800298 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:45.800274 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:46.174321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:46.174295 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d7d58575-2cq6p" Jul 01 18:30:46.223393 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:30:46.223352 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:31:00.467477 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.467411 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64c6988b6-f28tg" podUID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" containerName="console" containerID="cri-o://7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863" gracePeriod=15 Jul 01 18:31:00.721175 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.721122 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:31:00.877890 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.877862 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgrdp\" (UniqueName: \"kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.877904 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.877927 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.877966 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.877984 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878042 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878320 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878078 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert\") pod \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\" (UID: \"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1\") " Jul 01 18:31:00.878399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878372 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:00.878567 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878530 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:00.878660 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878614 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config" (OuterVolumeSpecName: "console-config") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:00.878660 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.878620 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:00.880310 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.880289 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:31:00.880422 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.880330 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp" (OuterVolumeSpecName: "kube-api-access-xgrdp") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "kube-api-access-xgrdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:31:00.880478 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.880416 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" (UID: "2e1370e7-e0d2-4ae8-bcef-ddfa824573d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:31:00.978917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978850 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.978917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978876 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.978917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978890 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgrdp\" (UniqueName: \"kubernetes.io/projected/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-kube-api-access-xgrdp\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.978917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978904 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.978917 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978917 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.979177 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978929 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:00.979177 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:00.978941 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:01.229017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.228945 2566 generic.go:356] "Generic (PLEG): container finished" podID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" containerID="7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863" exitCode=0 Jul 01 18:31:01.229017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.229002 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c6988b6-f28tg" Jul 01 18:31:01.229173 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.229039 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c6988b6-f28tg" event={"ID":"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1","Type":"ContainerDied","Data":"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863"} Jul 01 18:31:01.229173 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.229090 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c6988b6-f28tg" event={"ID":"2e1370e7-e0d2-4ae8-bcef-ddfa824573d1","Type":"ContainerDied","Data":"277dcb65b46a55a72bd8697e54d34a1e34e314e9ca82ad0af459c0aa6cf7bfd1"} Jul 01 18:31:01.229173 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.229113 2566 scope.go:117] "RemoveContainer" containerID="7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863" Jul 01 18:31:01.237583 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.237532 2566 scope.go:117] "RemoveContainer" containerID="7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863" Jul 01 18:31:01.237996 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:31:01.237977 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863\": container with ID starting with 7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863 not found: ID does not exist" containerID="7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863" Jul 01 18:31:01.238075 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.238003 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863"} err="failed to get container status \"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863\": rpc error: code = NotFound desc = could not find container \"7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863\": container with ID starting with 7e873724926c9af329510fc958f4258c440924f0c63b80a760f2827bc6875863 not found: ID does not exist" Jul 01 18:31:01.247847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.247824 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:31:01.251915 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:01.251894 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c6988b6-f28tg"] Jul 01 18:31:03.205488 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:03.205452 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" path="/var/lib/kubelet/pods/2e1370e7-e0d2-4ae8-bcef-ddfa824573d1/volumes" Jul 01 18:31:11.245974 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.245913 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c875657bb-kfffs" podUID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" containerName="console" containerID="cri-o://f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782" gracePeriod=15 Jul 01 18:31:11.484771 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.484746 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:31:11.656073 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.655993 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656073 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656035 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656073 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656058 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656085 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656226 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656275 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5mnj\" (UniqueName: \"kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656321 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656314 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config\") pod \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\" (UID: \"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91\") " Jul 01 18:31:11.656577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656554 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca" (OuterVolumeSpecName: "service-ca") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:11.656647 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656575 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:11.656711 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656653 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config" (OuterVolumeSpecName: "console-config") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:11.656763 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.656716 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:31:11.658623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.658588 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj" (OuterVolumeSpecName: "kube-api-access-d5mnj") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "kube-api-access-d5mnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:31:11.658623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.658609 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:31:11.658762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.658673 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" (UID: "a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:31:11.757538 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757516 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757540 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757557 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757567 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757575 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757584 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5mnj\" (UniqueName: \"kubernetes.io/projected/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-kube-api-access-d5mnj\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:11.757638 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:11.757592 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:12.277575 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.277524 2566 generic.go:356] "Generic (PLEG): container finished" podID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" containerID="f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782" exitCode=0 Jul 01 18:31:12.278086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.277582 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c875657bb-kfffs" Jul 01 18:31:12.278086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.277628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c875657bb-kfffs" event={"ID":"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91","Type":"ContainerDied","Data":"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782"} Jul 01 18:31:12.278086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.277701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c875657bb-kfffs" event={"ID":"a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91","Type":"ContainerDied","Data":"611cf7bbfc9857fd4675c24157b624e23688f733fe6d7909780181f2e2023814"} Jul 01 18:31:12.278086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.277736 2566 scope.go:117] "RemoveContainer" containerID="f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782" Jul 01 18:31:12.288223 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.288204 2566 scope.go:117] "RemoveContainer" containerID="f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782" Jul 01 18:31:12.288513 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:31:12.288490 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782\": container with ID starting with f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782 not found: ID does not exist" containerID="f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782" Jul 01 18:31:12.288575 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.288523 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782"} err="failed to get container status \"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782\": rpc error: code = NotFound desc = could not find container \"f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782\": container with ID starting with f86df18422438150efb3c8bd7be7656297f709f85f89e5c3f76666324aac2782 not found: ID does not exist" Jul 01 18:31:12.301133 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.301099 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:31:12.304873 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:12.304849 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c875657bb-kfffs"] Jul 01 18:31:13.205109 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:13.205077 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" path="/var/lib/kubelet/pods/a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91/volumes" Jul 01 18:31:29.217583 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217551 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs"] Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217842 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" containerName="console" Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217853 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" containerName="console" Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217863 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" containerName="console" Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217868 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" containerName="console" Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217911 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47c4dd3-f29b-4e17-9a2f-0d1e5ce38f91" containerName="console" Jul 01 18:31:29.217953 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.217920 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1370e7-e0d2-4ae8-bcef-ddfa824573d1" containerName="console" Jul 01 18:31:29.222021 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.222005 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.225682 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.225661 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 18:31:29.226035 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.226020 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 18:31:29.226985 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.226970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngzlz\"" Jul 01 18:31:29.234385 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.234361 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs"] Jul 01 18:31:29.381014 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.380990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.381149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.381029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxx4\" (UniqueName: \"kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.381149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.381057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.482041 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.481980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.482041 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.482019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxx4\" (UniqueName: \"kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.482179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.482062 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.482419 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.482398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.482454 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.482419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.491174 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.491155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxx4\" (UniqueName: \"kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.531019 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.530984 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:29.658007 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:29.657978 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs"] Jul 01 18:31:29.660999 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:31:29.660975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c92443_9eaf_4743_ba09_a6d38cd1b239.slice/crio-d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c WatchSource:0}: Error finding container d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c: Status 404 returned error can't find the container with id d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c Jul 01 18:31:30.346543 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:30.346503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" event={"ID":"03c92443-9eaf-4743-ba09-a6d38cd1b239","Type":"ContainerStarted","Data":"d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c"} Jul 01 18:31:40.390206 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:40.390171 2566 generic.go:356] "Generic (PLEG): container finished" podID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerID="e05d2fdb04dc6e75836e92ec7bea168b8b5a2d688847877d0c9c42be4b866a63" exitCode=0 Jul 01 18:31:40.390606 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:40.390214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" event={"ID":"03c92443-9eaf-4743-ba09-a6d38cd1b239","Type":"ContainerDied","Data":"e05d2fdb04dc6e75836e92ec7bea168b8b5a2d688847877d0c9c42be4b866a63"} Jul 01 18:31:44.410452 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:44.410416 2566 generic.go:356] "Generic (PLEG): container finished" podID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerID="1621557437fab7822f9d3600b995058e5cf747f1101ef5d1940ffecaa57a7b50" exitCode=0 Jul 01 18:31:44.410882 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:44.410470 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" event={"ID":"03c92443-9eaf-4743-ba09-a6d38cd1b239","Type":"ContainerDied","Data":"1621557437fab7822f9d3600b995058e5cf747f1101ef5d1940ffecaa57a7b50"} Jul 01 18:31:53.449990 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:53.449955 2566 generic.go:356] "Generic (PLEG): container finished" podID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerID="09d32552b25cf1516fdb2d9dd04e6b198329025a95a57ff0269f91f9dea71b34" exitCode=0 Jul 01 18:31:53.450355 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:53.450002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" event={"ID":"03c92443-9eaf-4743-ba09-a6d38cd1b239","Type":"ContainerDied","Data":"09d32552b25cf1516fdb2d9dd04e6b198329025a95a57ff0269f91f9dea71b34"} Jul 01 18:31:54.596997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.596969 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:54.697852 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.697808 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle\") pod \"03c92443-9eaf-4743-ba09-a6d38cd1b239\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " Jul 01 18:31:54.698002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.697863 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdxx4\" (UniqueName: \"kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4\") pod \"03c92443-9eaf-4743-ba09-a6d38cd1b239\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " Jul 01 18:31:54.698002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.697910 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util\") pod \"03c92443-9eaf-4743-ba09-a6d38cd1b239\" (UID: \"03c92443-9eaf-4743-ba09-a6d38cd1b239\") " Jul 01 18:31:54.698466 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.698433 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle" (OuterVolumeSpecName: "bundle") pod "03c92443-9eaf-4743-ba09-a6d38cd1b239" (UID: "03c92443-9eaf-4743-ba09-a6d38cd1b239"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:31:54.700243 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.700208 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4" (OuterVolumeSpecName: "kube-api-access-rdxx4") pod "03c92443-9eaf-4743-ba09-a6d38cd1b239" (UID: "03c92443-9eaf-4743-ba09-a6d38cd1b239"). InnerVolumeSpecName "kube-api-access-rdxx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:31:54.702817 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.702776 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util" (OuterVolumeSpecName: "util") pod "03c92443-9eaf-4743-ba09-a6d38cd1b239" (UID: "03c92443-9eaf-4743-ba09-a6d38cd1b239"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:31:54.798600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.798528 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:54.798600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.798552 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c92443-9eaf-4743-ba09-a6d38cd1b239-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:54.798600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:54.798563 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdxx4\" (UniqueName: \"kubernetes.io/projected/03c92443-9eaf-4743-ba09-a6d38cd1b239-kube-api-access-rdxx4\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:31:55.459995 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:55.459964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" event={"ID":"03c92443-9eaf-4743-ba09-a6d38cd1b239","Type":"ContainerDied","Data":"d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c"} Jul 01 18:31:55.460214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:55.460004 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkdqhs" Jul 01 18:31:55.460214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:31:55.460013 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5c0a77ce794ded333fa3ccd188bd062836965d1142dd8aa41fc714e261dd51c" Jul 01 18:32:02.346209 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346173 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv"] Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346462 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="util" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346473 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="util" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346487 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="extract" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346494 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="extract" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346506 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="pull" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346511 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="pull" Jul 01 18:32:02.346584 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.346557 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c92443-9eaf-4743-ba09-a6d38cd1b239" containerName="extract" Jul 01 18:32:02.349577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.349559 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.352823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.352780 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 18:32:02.353008 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.352989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4hzvt\"" Jul 01 18:32:02.353098 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.353025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:32:02.367413 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.367392 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv"] Jul 01 18:32:02.456554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.456530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpbf\" (UniqueName: \"kubernetes.io/projected/2a07f791-9f48-4559-a70e-2484b1764833-kube-api-access-2kpbf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.456554 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.456563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a07f791-9f48-4559-a70e-2484b1764833-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.557059 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.557032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpbf\" (UniqueName: \"kubernetes.io/projected/2a07f791-9f48-4559-a70e-2484b1764833-kube-api-access-2kpbf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.557204 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.557065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a07f791-9f48-4559-a70e-2484b1764833-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.557383 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.557364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a07f791-9f48-4559-a70e-2484b1764833-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.568870 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.568851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpbf\" (UniqueName: \"kubernetes.io/projected/2a07f791-9f48-4559-a70e-2484b1764833-kube-api-access-2kpbf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-m8cdv\" (UID: \"2a07f791-9f48-4559-a70e-2484b1764833\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.658158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.658141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" Jul 01 18:32:02.791082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:02.791056 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv"] Jul 01 18:32:02.793967 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:02.793945 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a07f791_9f48_4559_a70e_2484b1764833.slice/crio-484198aec4f7b7cf4f073cd612037d0a354fa6857ae5e67c59782bee55935f3a WatchSource:0}: Error finding container 484198aec4f7b7cf4f073cd612037d0a354fa6857ae5e67c59782bee55935f3a: Status 404 returned error can't find the container with id 484198aec4f7b7cf4f073cd612037d0a354fa6857ae5e67c59782bee55935f3a Jul 01 18:32:03.490325 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:03.490290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" event={"ID":"2a07f791-9f48-4559-a70e-2484b1764833","Type":"ContainerStarted","Data":"484198aec4f7b7cf4f073cd612037d0a354fa6857ae5e67c59782bee55935f3a"} Jul 01 18:32:05.501318 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:05.501283 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" event={"ID":"2a07f791-9f48-4559-a70e-2484b1764833","Type":"ContainerStarted","Data":"f2c3ab2bbb18f2f11f89a4e5806a0d8db56d7d29209b8a17d0baa3d4f5e9ccd2"} Jul 01 18:32:05.523074 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:05.522990 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-m8cdv" podStartSLOduration=1.066647531 podStartE2EDuration="3.522976541s" totalImagesPullingTime="2.45632901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:05.52263009 +0000 UTC m=+282.772513203" watchObservedRunningTime="2026-07-01 18:32:05.522976541 +0000 UTC m=+282.772859654" Jul 01 18:32:06.264569 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.264535 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8"] Jul 01 18:32:06.268505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.268482 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.273466 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.273445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngzlz\"" Jul 01 18:32:06.274506 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.274485 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 18:32:06.275243 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.275222 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 18:32:06.307461 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.307438 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8"] Jul 01 18:32:06.384736 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.384710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.384897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.384822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.384897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.384855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6nwz\" (UniqueName: \"kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.485556 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.485533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.485683 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.485564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6nwz\" (UniqueName: \"kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.485683 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.485597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.485943 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.485922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.486018 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.485973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.506873 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.506851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6nwz\" (UniqueName: \"kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.578394 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.578342 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:06.717940 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:06.717911 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8"] Jul 01 18:32:06.720987 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:06.720963 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11e5ade_077b_4071_9bb0_17df3f44ee5f.slice/crio-5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c WatchSource:0}: Error finding container 5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c: Status 404 returned error can't find the container with id 5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c Jul 01 18:32:07.510373 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.510340 2566 generic.go:356] "Generic (PLEG): container finished" podID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerID="44353d725997277f9a1ffa886340a62a2da460cc4285136d104ab9b1940d801d" exitCode=0 Jul 01 18:32:07.510869 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.510423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" event={"ID":"d11e5ade-077b-4071-9bb0-17df3f44ee5f","Type":"ContainerDied","Data":"44353d725997277f9a1ffa886340a62a2da460cc4285136d104ab9b1940d801d"} Jul 01 18:32:07.510869 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.510463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" event={"ID":"d11e5ade-077b-4071-9bb0-17df3f44ee5f","Type":"ContainerStarted","Data":"5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c"} Jul 01 18:32:07.776335 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.776240 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zwlht"] Jul 01 18:32:07.779370 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.779354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:07.782232 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.782211 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-94jn9\"" Jul 01 18:32:07.782563 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.782550 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 18:32:07.782710 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.782697 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 18:32:07.791910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.791890 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zwlht"] Jul 01 18:32:07.898343 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.898321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:07.898445 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.898350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnjd\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-kube-api-access-qqnjd\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:07.999606 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.999580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:07.999713 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:07.999608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnjd\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-kube-api-access-qqnjd\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:08.008936 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:08.008914 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:08.009124 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:08.009102 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnjd\" (UniqueName: \"kubernetes.io/projected/f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6-kube-api-access-qqnjd\") pod \"cert-manager-webhook-7dc76cbb94-zwlht\" (UID: \"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:08.105401 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:08.105345 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:08.230563 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:08.230541 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zwlht"] Jul 01 18:32:08.232883 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:08.232848 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf771d5fa_d225_45e2_a6d4_f5ecdcbf75e6.slice/crio-12dcbcb7210b64cdfa8aac3c65c542e8a8f76383fecc7842353972c4fdfaef1a WatchSource:0}: Error finding container 12dcbcb7210b64cdfa8aac3c65c542e8a8f76383fecc7842353972c4fdfaef1a: Status 404 returned error can't find the container with id 12dcbcb7210b64cdfa8aac3c65c542e8a8f76383fecc7842353972c4fdfaef1a Jul 01 18:32:08.516491 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:08.516458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" event={"ID":"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6","Type":"ContainerStarted","Data":"12dcbcb7210b64cdfa8aac3c65c542e8a8f76383fecc7842353972c4fdfaef1a"} Jul 01 18:32:12.536573 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:12.536540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" event={"ID":"f771d5fa-d225-45e2-a6d4-f5ecdcbf75e6","Type":"ContainerStarted","Data":"06f859aba061d263bc5b0621f07efef613956fae3af985588fe7926fcdb9c953"} Jul 01 18:32:12.536975 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:12.536603 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:12.559509 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:12.559463 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" podStartSLOduration=1.415705669 podStartE2EDuration="5.559450565s" totalImagesPullingTime="4.143744896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:12.55893733 +0000 UTC m=+289.808820445" watchObservedRunningTime="2026-07-01 18:32:12.559450565 +0000 UTC m=+289.809333678" Jul 01 18:32:14.011449 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.011412 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zf45b"] Jul 01 18:32:14.014762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.014742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.017609 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.017591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gcpfg\"" Jul 01 18:32:14.023942 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.023924 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zf45b"] Jul 01 18:32:14.153381 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.153347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg29g\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-kube-api-access-mg29g\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.153555 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.153401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.253802 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.253753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.253945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.253858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg29g\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-kube-api-access-mg29g\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.263676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.263613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.263816 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.263751 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg29g\" (UniqueName: \"kubernetes.io/projected/c30f0b7c-83c9-4e44-afc2-78ccd348b965-kube-api-access-mg29g\") pod \"cert-manager-cainjector-5d99449ffd-zf45b\" (UID: \"c30f0b7c-83c9-4e44-afc2-78ccd348b965\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.324138 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.324114 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" Jul 01 18:32:14.447982 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.447951 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zf45b"] Jul 01 18:32:14.450701 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:14.450667 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc30f0b7c_83c9_4e44_afc2_78ccd348b965.slice/crio-3992e0329b133843926ba4ce0a3172d5993e7539fade413a5315e00170479036 WatchSource:0}: Error finding container 3992e0329b133843926ba4ce0a3172d5993e7539fade413a5315e00170479036: Status 404 returned error can't find the container with id 3992e0329b133843926ba4ce0a3172d5993e7539fade413a5315e00170479036 Jul 01 18:32:14.547913 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.547837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" event={"ID":"c30f0b7c-83c9-4e44-afc2-78ccd348b965","Type":"ContainerStarted","Data":"a153bfd5389e55dccaca3276a5e54375b9b3360d23fdc6f03432e9c3ddaa876e"} Jul 01 18:32:14.547913 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.547904 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" event={"ID":"c30f0b7c-83c9-4e44-afc2-78ccd348b965","Type":"ContainerStarted","Data":"3992e0329b133843926ba4ce0a3172d5993e7539fade413a5315e00170479036"} Jul 01 18:32:14.565024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:14.564973 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zf45b" podStartSLOduration=1.564954834 podStartE2EDuration="1.564954834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:14.563776375 +0000 UTC m=+291.813659502" watchObservedRunningTime="2026-07-01 18:32:14.564954834 +0000 UTC m=+291.814837945" Jul 01 18:32:16.558297 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:16.558262 2566 generic.go:356] "Generic (PLEG): container finished" podID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerID="7214dc7a618e75df34e0b6857906ee52a92c7ccf32796274356d849986154933" exitCode=0 Jul 01 18:32:16.558779 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:16.558345 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" event={"ID":"d11e5ade-077b-4071-9bb0-17df3f44ee5f","Type":"ContainerDied","Data":"7214dc7a618e75df34e0b6857906ee52a92c7ccf32796274356d849986154933"} Jul 01 18:32:17.564972 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:17.564939 2566 generic.go:356] "Generic (PLEG): container finished" podID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerID="247f3050f8bb6d5e09f49a43134a12a9b5e61fd0632d3a5202185f80c4a95948" exitCode=0 Jul 01 18:32:17.565334 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:17.565011 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" event={"ID":"d11e5ade-077b-4071-9bb0-17df3f44ee5f","Type":"ContainerDied","Data":"247f3050f8bb6d5e09f49a43134a12a9b5e61fd0632d3a5202185f80c4a95948"} Jul 01 18:32:18.543550 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.543518 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zwlht" Jul 01 18:32:18.696574 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.696548 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:18.792797 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.792766 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util\") pod \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " Jul 01 18:32:18.792938 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.792820 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6nwz\" (UniqueName: \"kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz\") pod \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " Jul 01 18:32:18.792938 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.792845 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle\") pod \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\" (UID: \"d11e5ade-077b-4071-9bb0-17df3f44ee5f\") " Jul 01 18:32:18.793263 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.793241 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle" (OuterVolumeSpecName: "bundle") pod "d11e5ade-077b-4071-9bb0-17df3f44ee5f" (UID: "d11e5ade-077b-4071-9bb0-17df3f44ee5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:32:18.795061 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.795004 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz" (OuterVolumeSpecName: "kube-api-access-p6nwz") pod "d11e5ade-077b-4071-9bb0-17df3f44ee5f" (UID: "d11e5ade-077b-4071-9bb0-17df3f44ee5f"). InnerVolumeSpecName "kube-api-access-p6nwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:32:18.797177 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.797141 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util" (OuterVolumeSpecName: "util") pod "d11e5ade-077b-4071-9bb0-17df3f44ee5f" (UID: "d11e5ade-077b-4071-9bb0-17df3f44ee5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:32:18.894149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.894124 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:18.894149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.894147 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6nwz\" (UniqueName: \"kubernetes.io/projected/d11e5ade-077b-4071-9bb0-17df3f44ee5f-kube-api-access-p6nwz\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:18.894295 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:18.894157 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d11e5ade-077b-4071-9bb0-17df3f44ee5f-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:19.576185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:19.576103 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" event={"ID":"d11e5ade-077b-4071-9bb0-17df3f44ee5f","Type":"ContainerDied","Data":"5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c"} Jul 01 18:32:19.576185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:19.576135 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft56l8" Jul 01 18:32:19.576185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:19.576154 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cfd3477725c61240fbf1d87277ec252d69941ee82e95d8e2545a1ba8664c41c" Jul 01 18:32:23.149587 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:23.149554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:32:23.150032 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:23.149864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:32:23.166082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:23.166059 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 18:32:31.795492 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795462 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g"] Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795762 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="util" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795775 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="util" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795808 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="extract" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795814 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="extract" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795829 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="pull" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795835 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="pull" Jul 01 18:32:31.796744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.795882 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11e5ade-077b-4071-9bb0-17df3f44ee5f" containerName="extract" Jul 01 18:32:31.797483 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.797468 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.804025 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.803916 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 18:32:31.804105 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.803919 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 18:32:31.805135 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.805119 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngzlz\"" Jul 01 18:32:31.854293 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.854263 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g"] Jul 01 18:32:31.895972 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.895948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.896087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.895980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmh7c\" (UniqueName: \"kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.896087 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.896008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.996606 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.996577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.996704 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.996610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmh7c\" (UniqueName: \"kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.996704 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.996636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.996981 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.996962 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:31.997024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:31.997010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:32.005819 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.005800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmh7c\" (UniqueName: \"kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:32.107081 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.107024 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:32.237350 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.237320 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g"] Jul 01 18:32:32.240207 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:32.240181 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1d208d_0f24_4a4b_aa8b_091354c8a90b.slice/crio-86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775 WatchSource:0}: Error finding container 86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775: Status 404 returned error can't find the container with id 86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775 Jul 01 18:32:32.633132 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.633103 2566 generic.go:356] "Generic (PLEG): container finished" podID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerID="de9268496e3c022c66ae220bcba86691bc61ac2fce1638e62f269933dcd056c6" exitCode=0 Jul 01 18:32:32.633316 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.633187 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" event={"ID":"bb1d208d-0f24-4a4b-aa8b-091354c8a90b","Type":"ContainerDied","Data":"de9268496e3c022c66ae220bcba86691bc61ac2fce1638e62f269933dcd056c6"} Jul 01 18:32:32.633316 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.633238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" event={"ID":"bb1d208d-0f24-4a4b-aa8b-091354c8a90b","Type":"ContainerStarted","Data":"86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775"} Jul 01 18:32:32.633591 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:32.633575 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:32:33.640566 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:33.640535 2566 generic.go:356] "Generic (PLEG): container finished" podID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerID="5d48b5f0fba4006a5b1933e0e99ea190aa47bb0ee87a90c89f45e8a9158933a8" exitCode=0 Jul 01 18:32:33.640861 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:33.640614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" event={"ID":"bb1d208d-0f24-4a4b-aa8b-091354c8a90b","Type":"ContainerDied","Data":"5d48b5f0fba4006a5b1933e0e99ea190aa47bb0ee87a90c89f45e8a9158933a8"} Jul 01 18:32:34.646567 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:34.646536 2566 generic.go:356] "Generic (PLEG): container finished" podID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerID="654f6ca6bfcb635650aaa0ca4b4ebf691cf19920593cb95f7b137b138fa92f1b" exitCode=0 Jul 01 18:32:34.647027 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:34.646626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" event={"ID":"bb1d208d-0f24-4a4b-aa8b-091354c8a90b","Type":"ContainerDied","Data":"654f6ca6bfcb635650aaa0ca4b4ebf691cf19920593cb95f7b137b138fa92f1b"} Jul 01 18:32:35.773450 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.773419 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:35.826026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.826000 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle\") pod \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " Jul 01 18:32:35.826150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.826054 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmh7c\" (UniqueName: \"kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c\") pod \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " Jul 01 18:32:35.826150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.826073 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util\") pod \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\" (UID: \"bb1d208d-0f24-4a4b-aa8b-091354c8a90b\") " Jul 01 18:32:35.826721 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.826653 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle" (OuterVolumeSpecName: "bundle") pod "bb1d208d-0f24-4a4b-aa8b-091354c8a90b" (UID: "bb1d208d-0f24-4a4b-aa8b-091354c8a90b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:32:35.828126 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.828100 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c" (OuterVolumeSpecName: "kube-api-access-hmh7c") pod "bb1d208d-0f24-4a4b-aa8b-091354c8a90b" (UID: "bb1d208d-0f24-4a4b-aa8b-091354c8a90b"). InnerVolumeSpecName "kube-api-access-hmh7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:32:35.831371 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.831339 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util" (OuterVolumeSpecName: "util") pod "bb1d208d-0f24-4a4b-aa8b-091354c8a90b" (UID: "bb1d208d-0f24-4a4b-aa8b-091354c8a90b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:32:35.926661 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.926643 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmh7c\" (UniqueName: \"kubernetes.io/projected/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-kube-api-access-hmh7c\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:35.926738 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.926662 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:35.926738 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:35.926671 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1d208d-0f24-4a4b-aa8b-091354c8a90b-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:32:36.657851 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:36.657806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" event={"ID":"bb1d208d-0f24-4a4b-aa8b-091354c8a90b","Type":"ContainerDied","Data":"86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775"} Jul 01 18:32:36.658088 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:36.657858 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxsr9g" Jul 01 18:32:36.658088 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:36.657866 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86ee4584b9d161a963614b348f12650d7abdab8c267d0aa0657e93b9f3e23775" Jul 01 18:32:43.954540 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.954505 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-nbb62"] Jul 01 18:32:43.955002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.954952 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="pull" Jul 01 18:32:43.955002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.954970 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="pull" Jul 01 18:32:43.955002 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.955000 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="util" Jul 01 18:32:43.955157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.955009 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="util" Jul 01 18:32:43.955157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.955019 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="extract" Jul 01 18:32:43.955157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.955028 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="extract" Jul 01 18:32:43.955157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.955135 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1d208d-0f24-4a4b-aa8b-091354c8a90b" containerName="extract" Jul 01 18:32:43.957983 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.957959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:43.963421 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.963390 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 18:32:43.963549 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.963488 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 18:32:43.964805 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.964771 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s57l5\"" Jul 01 18:32:43.964919 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.964807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 18:32:43.964919 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.964855 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:32:43.967497 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.967482 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 18:32:43.973047 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.973025 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-nbb62"] Jul 01 18:32:43.988397 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.988379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-metrics-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:43.988494 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.988411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42cr\" (UniqueName: \"kubernetes.io/projected/a6417479-f3a4-4c78-8d01-ea332a427bf5-kube-api-access-v42cr\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:43.988494 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.988433 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6417479-f3a4-4c78-8d01-ea332a427bf5-manager-config\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:43.988494 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:43.988458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.089494 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.089471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42cr\" (UniqueName: \"kubernetes.io/projected/a6417479-f3a4-4c78-8d01-ea332a427bf5-kube-api-access-v42cr\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.089608 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.089501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6417479-f3a4-4c78-8d01-ea332a427bf5-manager-config\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.089608 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.089523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.089608 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.089573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-metrics-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.090180 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.090161 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a6417479-f3a4-4c78-8d01-ea332a427bf5-manager-config\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.092074 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.092054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.092149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.092103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6417479-f3a4-4c78-8d01-ea332a427bf5-metrics-cert\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.112191 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.112164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42cr\" (UniqueName: \"kubernetes.io/projected/a6417479-f3a4-4c78-8d01-ea332a427bf5-kube-api-access-v42cr\") pod \"lws-controller-manager-56879d7496-nbb62\" (UID: \"a6417479-f3a4-4c78-8d01-ea332a427bf5\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.267261 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.267192 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:44.411605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.411560 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb"] Jul 01 18:32:44.415060 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.415031 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.420923 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.420892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 18:32:44.421050 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.420952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzsjd\"" Jul 01 18:32:44.421148 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.421131 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 18:32:44.421199 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.421145 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 18:32:44.421244 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.421212 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 18:32:44.431964 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.431940 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-nbb62"] Jul 01 18:32:44.433549 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:44.433528 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6417479_f3a4_4c78_8d01_ea332a427bf5.slice/crio-8d85a3bb4cee0960476bdcaf03b571a5d29ba0e02622b7d5893d36bf358047e7 WatchSource:0}: Error finding container 8d85a3bb4cee0960476bdcaf03b571a5d29ba0e02622b7d5893d36bf358047e7: Status 404 returned error can't find the container with id 8d85a3bb4cee0960476bdcaf03b571a5d29ba0e02622b7d5893d36bf358047e7 Jul 01 18:32:44.440898 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.440881 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb"] Jul 01 18:32:44.492932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.492908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.493055 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.492980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.493055 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.493017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.493055 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.493043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.493175 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.493104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n489z\" (UniqueName: \"kubernetes.io/projected/9892caa7-b44e-4752-8cc7-fa15432a47cc-kube-api-access-n489z\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594382 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594382 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594382 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594612 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n489z\" (UniqueName: \"kubernetes.io/projected/9892caa7-b44e-4752-8cc7-fa15432a47cc-kube-api-access-n489z\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594612 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.594845 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.594821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.596679 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.596617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9892caa7-b44e-4752-8cc7-fa15432a47cc-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.596930 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.596913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.596930 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.596922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9892caa7-b44e-4752-8cc7-fa15432a47cc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.604222 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.604197 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n489z\" (UniqueName: \"kubernetes.io/projected/9892caa7-b44e-4752-8cc7-fa15432a47cc-kube-api-access-n489z\") pod \"opendatahub-operator-controller-manager-7bfc969986-7mjfb\" (UID: \"9892caa7-b44e-4752-8cc7-fa15432a47cc\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.694835 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.694778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" event={"ID":"a6417479-f3a4-4c78-8d01-ea332a427bf5","Type":"ContainerStarted","Data":"8d85a3bb4cee0960476bdcaf03b571a5d29ba0e02622b7d5893d36bf358047e7"} Jul 01 18:32:44.725505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.725478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:44.870884 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:44.870858 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb"] Jul 01 18:32:44.872380 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:32:44.872349 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9892caa7_b44e_4752_8cc7_fa15432a47cc.slice/crio-ea79d331fcb902782b5a650efdc25c29f924237370132555b1c51e0381cee1ca WatchSource:0}: Error finding container ea79d331fcb902782b5a650efdc25c29f924237370132555b1c51e0381cee1ca: Status 404 returned error can't find the container with id ea79d331fcb902782b5a650efdc25c29f924237370132555b1c51e0381cee1ca Jul 01 18:32:45.702511 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:45.702476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" event={"ID":"9892caa7-b44e-4752-8cc7-fa15432a47cc","Type":"ContainerStarted","Data":"ea79d331fcb902782b5a650efdc25c29f924237370132555b1c51e0381cee1ca"} Jul 01 18:32:48.718035 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:48.718000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" event={"ID":"9892caa7-b44e-4752-8cc7-fa15432a47cc","Type":"ContainerStarted","Data":"cfc8d45ff36b2c9f8e8ce19b61f730de5d30cbc62d84e792bc959cb44fed25bd"} Jul 01 18:32:48.719429 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:48.719397 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" event={"ID":"a6417479-f3a4-4c78-8d01-ea332a427bf5","Type":"ContainerStarted","Data":"cf1d628973c5072fbb76140b0b6d8787fdd2c3868aa486225ac2039826024a59"} Jul 01 18:32:48.719564 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:48.719531 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:32:48.760335 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:48.760283 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" podStartSLOduration=1.8590485719999998 podStartE2EDuration="5.760267147s" totalImagesPullingTime="3.901218575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:48.758880635 +0000 UTC m=+326.008763749" watchObservedRunningTime="2026-07-01 18:32:48.760267147 +0000 UTC m=+326.010150259" Jul 01 18:32:49.726302 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:49.726268 2566 generic.go:356] "Generic (PLEG): container finished" podID="9892caa7-b44e-4752-8cc7-fa15432a47cc" containerID="cfc8d45ff36b2c9f8e8ce19b61f730de5d30cbc62d84e792bc959cb44fed25bd" exitCode=0 Jul 01 18:32:49.726678 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:49.726339 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" event={"ID":"9892caa7-b44e-4752-8cc7-fa15432a47cc","Type":"ContainerDied","Data":"cfc8d45ff36b2c9f8e8ce19b61f730de5d30cbc62d84e792bc959cb44fed25bd"} Jul 01 18:32:50.741039 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:50.740996 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" event={"ID":"9892caa7-b44e-4752-8cc7-fa15432a47cc","Type":"ContainerStarted","Data":"bac1e7475508c314434e21b4c9e701b921aff35cbcb00d077238c1163f220861"} Jul 01 18:32:50.741437 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:50.741102 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:32:50.767101 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:50.767056 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" podStartSLOduration=1.636684948 podStartE2EDuration="6.767041813s" totalImagesPullingTime="4.174519984s" totalInitContainerRuntime="955.836881ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:50.764311659 +0000 UTC m=+328.014194772" watchObservedRunningTime="2026-07-01 18:32:50.767041813 +0000 UTC m=+328.016924997" Jul 01 18:32:59.729293 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:32:59.729263 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56879d7496-nbb62" Jul 01 18:33:01.748018 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:01.747990 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-7mjfb" Jul 01 18:33:11.493403 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.493371 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw"] Jul 01 18:33:11.502197 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.502171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.505120 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.505098 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cmln9\"" Jul 01 18:33:11.505258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.505118 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 18:33:11.505258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.505249 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 18:33:11.510560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.510537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw"] Jul 01 18:33:11.605234 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.605203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tmp\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.605234 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.605233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2hxv\" (UniqueName: \"kubernetes.io/projected/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-kube-api-access-l2hxv\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.605446 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.605289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tls-certs\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.706023 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.705997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tmp\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.706023 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.706027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2hxv\" (UniqueName: \"kubernetes.io/projected/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-kube-api-access-l2hxv\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.706228 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.706082 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tls-certs\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.708498 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.708461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tmp\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.708876 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.708855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-tls-certs\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.720275 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.720254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2hxv\" (UniqueName: \"kubernetes.io/projected/fc5bb339-9f04-443b-87e2-87abfbf8ad0a-kube-api-access-l2hxv\") pod \"kube-auth-proxy-cdf5845d-zx2mw\" (UID: \"fc5bb339-9f04-443b-87e2-87abfbf8ad0a\") " pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.813570 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.813478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" Jul 01 18:33:11.952130 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:11.952103 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw"] Jul 01 18:33:11.955280 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:33:11.955238 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5bb339_9f04_443b_87e2_87abfbf8ad0a.slice/crio-6833067dee1ea919bf8a8884ba6688a5a201ab6872b5553066c000eacc11ffd0 WatchSource:0}: Error finding container 6833067dee1ea919bf8a8884ba6688a5a201ab6872b5553066c000eacc11ffd0: Status 404 returned error can't find the container with id 6833067dee1ea919bf8a8884ba6688a5a201ab6872b5553066c000eacc11ffd0 Jul 01 18:33:12.852277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:12.852236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" event={"ID":"fc5bb339-9f04-443b-87e2-87abfbf8ad0a","Type":"ContainerStarted","Data":"6833067dee1ea919bf8a8884ba6688a5a201ab6872b5553066c000eacc11ffd0"} Jul 01 18:33:15.868475 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:15.868435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" event={"ID":"fc5bb339-9f04-443b-87e2-87abfbf8ad0a","Type":"ContainerStarted","Data":"75f3d4d1190574af3de6121861b1be7eb61240c92041417ab3077870d622a872"} Jul 01 18:33:15.905342 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:33:15.905291 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cdf5845d-zx2mw" podStartSLOduration=1.629323067 podStartE2EDuration="4.905272498s" totalImagesPullingTime="3.275949431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:15.90437216 +0000 UTC m=+353.154255275" watchObservedRunningTime="2026-07-01 18:33:15.905272498 +0000 UTC m=+353.155155614" Jul 01 18:34:22.844374 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.844337 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx"] Jul 01 18:34:22.848024 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.848003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:22.850698 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.850680 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 18:34:22.851898 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.851869 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 18:34:22.851987 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.851869 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fxcgl\"" Jul 01 18:34:22.855873 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.855436 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx"] Jul 01 18:34:22.964978 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.964945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:22.965147 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.965000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:22.965147 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:22.965029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dx8j\" (UniqueName: \"kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.065985 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.065956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.065985 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.065988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dx8j\" (UniqueName: \"kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.066173 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.066045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.066399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.066384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.066435 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.066384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.075192 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.075164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dx8j\" (UniqueName: \"kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.161665 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.161608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fxcgl\"" Jul 01 18:34:23.169218 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.169203 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:23.306396 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.306373 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx"] Jul 01 18:34:23.308550 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:34:23.308525 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8174cbe_d436_4af0_8147_3a889d02896d.slice/crio-0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820 WatchSource:0}: Error finding container 0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820: Status 404 returned error can't find the container with id 0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820 Jul 01 18:34:23.451118 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.451086 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp"] Jul 01 18:34:23.454508 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.454490 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.463851 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.463826 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp"] Jul 01 18:34:23.569662 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.569631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54bl\" (UniqueName: \"kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.569838 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.569675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.569838 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.569709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.670937 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.670910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.671035 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.670994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54bl\" (UniqueName: \"kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.671035 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.671027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.671345 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.671323 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.671381 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.671335 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.680646 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.680619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54bl\" (UniqueName: \"kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.772528 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.772480 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:23.902997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:23.902930 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp"] Jul 01 18:34:23.905606 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:34:23.905583 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d07612_dd15_4f2f_ab87_b1ebbece457a.slice/crio-d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94 WatchSource:0}: Error finding container d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94: Status 404 returned error can't find the container with id d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94 Jul 01 18:34:24.060416 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.060350 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b"] Jul 01 18:34:24.063741 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.063723 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.071159 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.071135 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b"] Jul 01 18:34:24.174219 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.174185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.174356 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.174286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxnrg\" (UniqueName: \"kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.174397 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.174381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.189017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.188992 2566 generic.go:356] "Generic (PLEG): container finished" podID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerID="255493bd5fe5dfb46da8d92fef4615eb6f89c03c0020058327358973c50e74f6" exitCode=0 Jul 01 18:34:24.189125 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.189059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" event={"ID":"d5d07612-dd15-4f2f-ab87-b1ebbece457a","Type":"ContainerDied","Data":"255493bd5fe5dfb46da8d92fef4615eb6f89c03c0020058327358973c50e74f6"} Jul 01 18:34:24.189125 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.189092 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" event={"ID":"d5d07612-dd15-4f2f-ab87-b1ebbece457a","Type":"ContainerStarted","Data":"d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94"} Jul 01 18:34:24.190622 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.190604 2566 generic.go:356] "Generic (PLEG): container finished" podID="b8174cbe-d436-4af0-8147-3a889d02896d" containerID="72988277c033f9601b4d385f3d7958413d3a4806044e26e7f755487723098651" exitCode=0 Jul 01 18:34:24.190714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.190647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" event={"ID":"b8174cbe-d436-4af0-8147-3a889d02896d","Type":"ContainerDied","Data":"72988277c033f9601b4d385f3d7958413d3a4806044e26e7f755487723098651"} Jul 01 18:34:24.190714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.190676 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" event={"ID":"b8174cbe-d436-4af0-8147-3a889d02896d","Type":"ContainerStarted","Data":"0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820"} Jul 01 18:34:24.275707 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.275681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.275862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.275736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxnrg\" (UniqueName: \"kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.275862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.275829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.276205 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.276176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.276317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.276220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.284591 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.284560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxnrg\" (UniqueName: \"kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.390237 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.390171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:24.455933 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.455908 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v"] Jul 01 18:34:24.459582 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.459564 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.469464 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.469439 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v"] Jul 01 18:34:24.527972 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.527949 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b"] Jul 01 18:34:24.529813 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:34:24.529769 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5592e4d7_4cf1_488e_94e0_ed557a853275.slice/crio-6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182 WatchSource:0}: Error finding container 6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182: Status 404 returned error can't find the container with id 6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182 Jul 01 18:34:24.577916 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.577884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pckmp\" (UniqueName: \"kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.578017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.577948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.578090 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.578024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.678962 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.678929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pckmp\" (UniqueName: \"kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.679113 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.678981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.679113 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.679007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.679366 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.679348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.679436 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.679368 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.688169 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.688149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pckmp\" (UniqueName: \"kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:24.770966 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:24.770937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:25.085777 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.085752 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v"] Jul 01 18:34:25.153529 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:34:25.153495 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68272c7d_b9a9_4da1_bcbc_ea64a416e177.slice/crio-35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08 WatchSource:0}: Error finding container 35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08: Status 404 returned error can't find the container with id 35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08 Jul 01 18:34:25.201890 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.201855 2566 generic.go:356] "Generic (PLEG): container finished" podID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerID="87ea295d7607eea51490de6f43bf819215f048dd92cfb6432fb2c3ce19ef1f38" exitCode=0 Jul 01 18:34:25.203910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.203887 2566 generic.go:356] "Generic (PLEG): container finished" podID="b8174cbe-d436-4af0-8147-3a889d02896d" containerID="81ba2f61c05d095d5a9d003a7e2a418e15d0c2da6754e95bb60d40cb5f88939a" exitCode=0 Jul 01 18:34:25.207259 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.207239 2566 generic.go:356] "Generic (PLEG): container finished" podID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerID="d892c096f761f13fb3926de1b17e079fce92b6d9f5b12d436beedfdaf0361c3f" exitCode=0 Jul 01 18:34:25.207914 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.207885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" event={"ID":"d5d07612-dd15-4f2f-ab87-b1ebbece457a","Type":"ContainerDied","Data":"87ea295d7607eea51490de6f43bf819215f048dd92cfb6432fb2c3ce19ef1f38"} Jul 01 18:34:25.208026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.207939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" event={"ID":"b8174cbe-d436-4af0-8147-3a889d02896d","Type":"ContainerDied","Data":"81ba2f61c05d095d5a9d003a7e2a418e15d0c2da6754e95bb60d40cb5f88939a"} Jul 01 18:34:25.208026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.207962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" event={"ID":"68272c7d-b9a9-4da1-bcbc-ea64a416e177","Type":"ContainerStarted","Data":"35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08"} Jul 01 18:34:25.208026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.207981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" event={"ID":"5592e4d7-4cf1-488e-94e0-ed557a853275","Type":"ContainerDied","Data":"d892c096f761f13fb3926de1b17e079fce92b6d9f5b12d436beedfdaf0361c3f"} Jul 01 18:34:25.208026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:25.208002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" event={"ID":"5592e4d7-4cf1-488e-94e0-ed557a853275","Type":"ContainerStarted","Data":"6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182"} Jul 01 18:34:26.214148 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.214114 2566 generic.go:356] "Generic (PLEG): container finished" podID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerID="d2887561fda26194e13adb7c1fc43610007f9d182855b75e101724b7206fbb80" exitCode=0 Jul 01 18:34:26.214533 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.214158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" event={"ID":"68272c7d-b9a9-4da1-bcbc-ea64a416e177","Type":"ContainerDied","Data":"d2887561fda26194e13adb7c1fc43610007f9d182855b75e101724b7206fbb80"} Jul 01 18:34:26.216610 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.216540 2566 generic.go:356] "Generic (PLEG): container finished" podID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerID="7d52b4eeec1c444e3ff457cedaf6e6e7eada3652a5be9cf144a8c794f5c767ab" exitCode=0 Jul 01 18:34:26.216694 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.216598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" event={"ID":"d5d07612-dd15-4f2f-ab87-b1ebbece457a","Type":"ContainerDied","Data":"7d52b4eeec1c444e3ff457cedaf6e6e7eada3652a5be9cf144a8c794f5c767ab"} Jul 01 18:34:26.219135 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.219103 2566 generic.go:356] "Generic (PLEG): container finished" podID="b8174cbe-d436-4af0-8147-3a889d02896d" containerID="869b4bbef8dc9d29257f3936c3ab310f6cc8851b260b6945598741cd92882cec" exitCode=0 Jul 01 18:34:26.219242 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:26.219144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" event={"ID":"b8174cbe-d436-4af0-8147-3a889d02896d","Type":"ContainerDied","Data":"869b4bbef8dc9d29257f3936c3ab310f6cc8851b260b6945598741cd92882cec"} Jul 01 18:34:27.225215 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.225181 2566 generic.go:356] "Generic (PLEG): container finished" podID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerID="7e6262c226e2910ea545a2c66cec44610d802401c8c4d6fc2fc4e7b586dfac2c" exitCode=0 Jul 01 18:34:27.225545 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.225223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" event={"ID":"68272c7d-b9a9-4da1-bcbc-ea64a416e177","Type":"ContainerDied","Data":"7e6262c226e2910ea545a2c66cec44610d802401c8c4d6fc2fc4e7b586dfac2c"} Jul 01 18:34:27.227124 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.227101 2566 generic.go:356] "Generic (PLEG): container finished" podID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerID="33d0333db8aaac506662f49405e8b2852bf38e3fd25b9c39187358e395aae092" exitCode=0 Jul 01 18:34:27.227209 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.227134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" event={"ID":"5592e4d7-4cf1-488e-94e0-ed557a853275","Type":"ContainerDied","Data":"33d0333db8aaac506662f49405e8b2852bf38e3fd25b9c39187358e395aae092"} Jul 01 18:34:27.371674 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.371651 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:27.469553 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.469533 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:27.503737 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.503705 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle\") pod \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " Jul 01 18:34:27.503887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.503750 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util\") pod \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " Jul 01 18:34:27.503887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.503812 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c54bl\" (UniqueName: \"kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl\") pod \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\" (UID: \"d5d07612-dd15-4f2f-ab87-b1ebbece457a\") " Jul 01 18:34:27.504183 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.504158 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle" (OuterVolumeSpecName: "bundle") pod "d5d07612-dd15-4f2f-ab87-b1ebbece457a" (UID: "d5d07612-dd15-4f2f-ab87-b1ebbece457a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:27.506001 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.505980 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl" (OuterVolumeSpecName: "kube-api-access-c54bl") pod "d5d07612-dd15-4f2f-ab87-b1ebbece457a" (UID: "d5d07612-dd15-4f2f-ab87-b1ebbece457a"). InnerVolumeSpecName "kube-api-access-c54bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:34:27.509153 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.509134 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util" (OuterVolumeSpecName: "util") pod "d5d07612-dd15-4f2f-ab87-b1ebbece457a" (UID: "d5d07612-dd15-4f2f-ab87-b1ebbece457a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:27.604716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.604662 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dx8j\" (UniqueName: \"kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j\") pod \"b8174cbe-d436-4af0-8147-3a889d02896d\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " Jul 01 18:34:27.604716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.604700 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle\") pod \"b8174cbe-d436-4af0-8147-3a889d02896d\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " Jul 01 18:34:27.604895 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.604813 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util\") pod \"b8174cbe-d436-4af0-8147-3a889d02896d\" (UID: \"b8174cbe-d436-4af0-8147-3a889d02896d\") " Jul 01 18:34:27.605019 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.605005 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:27.605078 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.605024 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d07612-dd15-4f2f-ab87-b1ebbece457a-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:27.605078 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.605037 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c54bl\" (UniqueName: \"kubernetes.io/projected/d5d07612-dd15-4f2f-ab87-b1ebbece457a-kube-api-access-c54bl\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:27.605259 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.605199 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle" (OuterVolumeSpecName: "bundle") pod "b8174cbe-d436-4af0-8147-3a889d02896d" (UID: "b8174cbe-d436-4af0-8147-3a889d02896d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:27.606672 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.606649 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j" (OuterVolumeSpecName: "kube-api-access-2dx8j") pod "b8174cbe-d436-4af0-8147-3a889d02896d" (UID: "b8174cbe-d436-4af0-8147-3a889d02896d"). InnerVolumeSpecName "kube-api-access-2dx8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:34:27.609861 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.609841 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util" (OuterVolumeSpecName: "util") pod "b8174cbe-d436-4af0-8147-3a889d02896d" (UID: "b8174cbe-d436-4af0-8147-3a889d02896d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:27.705911 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.705890 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:27.705911 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.705910 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dx8j\" (UniqueName: \"kubernetes.io/projected/b8174cbe-d436-4af0-8147-3a889d02896d-kube-api-access-2dx8j\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:27.706064 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:27.705919 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8174cbe-d436-4af0-8147-3a889d02896d-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:28.239084 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.239047 2566 generic.go:356] "Generic (PLEG): container finished" podID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerID="76319d5425a9438853a6de7686991ea56458ba22bb9c10e52a5ae7d9d5f1f319" exitCode=0 Jul 01 18:34:28.239487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.239130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" event={"ID":"68272c7d-b9a9-4da1-bcbc-ea64a416e177","Type":"ContainerDied","Data":"76319d5425a9438853a6de7686991ea56458ba22bb9c10e52a5ae7d9d5f1f319"} Jul 01 18:34:28.241042 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.241014 2566 generic.go:356] "Generic (PLEG): container finished" podID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerID="2009e911752c5d0e98557be19ea642a691351530524b4103dd372291bb2a7e7a" exitCode=0 Jul 01 18:34:28.241150 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.241091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" event={"ID":"5592e4d7-4cf1-488e-94e0-ed557a853275","Type":"ContainerDied","Data":"2009e911752c5d0e98557be19ea642a691351530524b4103dd372291bb2a7e7a"} Jul 01 18:34:28.242673 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.242646 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" event={"ID":"d5d07612-dd15-4f2f-ab87-b1ebbece457a","Type":"ContainerDied","Data":"d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94"} Jul 01 18:34:28.242755 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.242678 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp" Jul 01 18:34:28.242755 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.242694 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b54df10cb929995aa272e589e081dcc4bc01de92c58b1bd8ae7c09f8525a94" Jul 01 18:34:28.244360 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.244342 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" event={"ID":"b8174cbe-d436-4af0-8147-3a889d02896d","Type":"ContainerDied","Data":"0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820"} Jul 01 18:34:28.244448 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.244371 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecb1a7dce40e0491317d53f914b71b57f01eb1ac9e55e7a1021b2fe299b4820" Jul 01 18:34:28.244448 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:28.244375 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx" Jul 01 18:34:29.390704 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.390678 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:34:29.409347 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.409324 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:29.521242 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521170 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util\") pod \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " Jul 01 18:34:29.521377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521243 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pckmp\" (UniqueName: \"kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp\") pod \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " Jul 01 18:34:29.521377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521297 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle\") pod \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\" (UID: \"68272c7d-b9a9-4da1-bcbc-ea64a416e177\") " Jul 01 18:34:29.521377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521339 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxnrg\" (UniqueName: \"kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg\") pod \"5592e4d7-4cf1-488e-94e0-ed557a853275\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " Jul 01 18:34:29.521377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521361 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util\") pod \"5592e4d7-4cf1-488e-94e0-ed557a853275\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " Jul 01 18:34:29.521589 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521392 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle\") pod \"5592e4d7-4cf1-488e-94e0-ed557a853275\" (UID: \"5592e4d7-4cf1-488e-94e0-ed557a853275\") " Jul 01 18:34:29.522053 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.521924 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle" (OuterVolumeSpecName: "bundle") pod "5592e4d7-4cf1-488e-94e0-ed557a853275" (UID: "5592e4d7-4cf1-488e-94e0-ed557a853275"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:29.522237 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.522155 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle" (OuterVolumeSpecName: "bundle") pod "68272c7d-b9a9-4da1-bcbc-ea64a416e177" (UID: "68272c7d-b9a9-4da1-bcbc-ea64a416e177"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:29.523580 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.523551 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp" (OuterVolumeSpecName: "kube-api-access-pckmp") pod "68272c7d-b9a9-4da1-bcbc-ea64a416e177" (UID: "68272c7d-b9a9-4da1-bcbc-ea64a416e177"). InnerVolumeSpecName "kube-api-access-pckmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:34:29.523658 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.523600 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg" (OuterVolumeSpecName: "kube-api-access-xxnrg") pod "5592e4d7-4cf1-488e-94e0-ed557a853275" (UID: "5592e4d7-4cf1-488e-94e0-ed557a853275"). InnerVolumeSpecName "kube-api-access-xxnrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:34:29.529229 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.529201 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util" (OuterVolumeSpecName: "util") pod "5592e4d7-4cf1-488e-94e0-ed557a853275" (UID: "5592e4d7-4cf1-488e-94e0-ed557a853275"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:29.529551 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.529523 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util" (OuterVolumeSpecName: "util") pod "68272c7d-b9a9-4da1-bcbc-ea64a416e177" (UID: "68272c7d-b9a9-4da1-bcbc-ea64a416e177"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:34:29.622812 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622773 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:29.622897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622813 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxnrg\" (UniqueName: \"kubernetes.io/projected/5592e4d7-4cf1-488e-94e0-ed557a853275-kube-api-access-xxnrg\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:29.622897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622823 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:29.622897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622831 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5592e4d7-4cf1-488e-94e0-ed557a853275-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:29.622897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622838 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68272c7d-b9a9-4da1-bcbc-ea64a416e177-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:29.622897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:29.622846 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pckmp\" (UniqueName: \"kubernetes.io/projected/68272c7d-b9a9-4da1-bcbc-ea64a416e177-kube-api-access-pckmp\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:34:30.256577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.256539 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" event={"ID":"5592e4d7-4cf1-488e-94e0-ed557a853275","Type":"ContainerDied","Data":"6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182"} Jul 01 18:34:30.256577 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.256563 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b" Jul 01 18:34:30.256840 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.256595 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b2e184966b2e382e28d618546c20cd7dd670bd7fe2ba89d9ff56fb94a86d182" Jul 01 18:34:30.258576 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.258552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" event={"ID":"68272c7d-b9a9-4da1-bcbc-ea64a416e177","Type":"ContainerDied","Data":"35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08"} Jul 01 18:34:30.258717 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.258586 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35a777b265992426e276942c23027eba2d227f072aac3df23e543858a05c2c08" Jul 01 18:34:30.258717 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:34:30.258605 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v" Jul 01 18:35:00.908208 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908126 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng"] Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908603 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="util" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908622 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="util" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908636 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="pull" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908645 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="pull" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908654 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908663 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908682 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="util" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908691 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="util" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908702 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908710 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908727 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908735 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="extract" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908745 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="pull" Jul 01 18:35:00.908757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908751 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="pull" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908766 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="extract" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908775 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="extract" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908808 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="pull" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908816 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="pull" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908830 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="util" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908838 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="util" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908846 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="util" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908854 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="util" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908864 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="pull" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908872 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="pull" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908957 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="68272c7d-b9a9-4da1-bcbc-ea64a416e177" containerName="extract" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908970 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5592e4d7-4cf1-488e-94e0-ed557a853275" containerName="extract" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908982 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d07612-dd15-4f2f-ab87-b1ebbece457a" containerName="extract" Jul 01 18:35:00.909438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.908992 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8174cbe-d436-4af0-8147-3a889d02896d" containerName="extract" Jul 01 18:35:00.913841 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.913821 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:00.916765 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.916737 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 18:35:00.916904 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.916831 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 18:35:00.916904 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.916878 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fxcgl\"" Jul 01 18:35:00.918094 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.918078 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 18:35:00.918149 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.918082 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 18:35:00.922424 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.922403 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng"] Jul 01 18:35:00.963982 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.963958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:00.964094 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.964003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5ljw\" (UniqueName: \"kubernetes.io/projected/b80d0cbe-d888-410b-bb63-728e85924b0b-kube-api-access-t5ljw\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:00.964094 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:00.964041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b80d0cbe-d888-410b-bb63-728e85924b0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.064496 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.064474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.064619 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.064516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5ljw\" (UniqueName: \"kubernetes.io/projected/b80d0cbe-d888-410b-bb63-728e85924b0b-kube-api-access-t5ljw\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.064619 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.064542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b80d0cbe-d888-410b-bb63-728e85924b0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.064702 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:35:01.064619 2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 01 18:35:01.064702 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:35:01.064699 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert podName:b80d0cbe-d888-410b-bb63-728e85924b0b nodeName:}" failed. No retries permitted until 2026-07-01 18:35:01.564683575 +0000 UTC m=+458.814566670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-h8cng" (UID: "b80d0cbe-d888-410b-bb63-728e85924b0b") : secret "plugin-serving-cert" not found Jul 01 18:35:01.065187 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.065169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b80d0cbe-d888-410b-bb63-728e85924b0b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.073385 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.073367 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5ljw\" (UniqueName: \"kubernetes.io/projected/b80d0cbe-d888-410b-bb63-728e85924b0b-kube-api-access-t5ljw\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.567958 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.567918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.570926 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.570895 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b80d0cbe-d888-410b-bb63-728e85924b0b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h8cng\" (UID: \"b80d0cbe-d888-410b-bb63-728e85924b0b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.823933 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.823854 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" Jul 01 18:35:01.959560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:01.959538 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng"] Jul 01 18:35:01.961194 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:35:01.961168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb80d0cbe_d888_410b_bb63_728e85924b0b.slice/crio-f4ca66ee813b1b37fe16bed33cd411fd15b0b48fd1667c53932fa5097cc61d26 WatchSource:0}: Error finding container f4ca66ee813b1b37fe16bed33cd411fd15b0b48fd1667c53932fa5097cc61d26: Status 404 returned error can't find the container with id f4ca66ee813b1b37fe16bed33cd411fd15b0b48fd1667c53932fa5097cc61d26 Jul 01 18:35:02.411176 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:02.411138 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" event={"ID":"b80d0cbe-d888-410b-bb63-728e85924b0b","Type":"ContainerStarted","Data":"f4ca66ee813b1b37fe16bed33cd411fd15b0b48fd1667c53932fa5097cc61d26"} Jul 01 18:35:11.132504 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.132469 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:11.136106 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.136089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.139485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.139466 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rh66x\"" Jul 01 18:35:11.151092 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.151073 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:11.252273 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.252245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc4k\" (UniqueName: \"kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.252412 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.252304 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.353098 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.353061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.353264 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.353162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc4k\" (UniqueName: \"kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.353530 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.353497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.363927 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.363904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc4k\" (UniqueName: \"kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k\") pod \"kuadrant-operator-controller-manager-55467d9f7-njfb5\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.446522 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.446497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:11.607514 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:11.607490 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:11.609895 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:35:11.609868 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3421468e_4189_47f3_aa29_fdb7f48d068e.slice/crio-677f34066cfbef8437629921b0a98100a7a8b7c3fe3e954fe2b37932e0b9976b WatchSource:0}: Error finding container 677f34066cfbef8437629921b0a98100a7a8b7c3fe3e954fe2b37932e0b9976b: Status 404 returned error can't find the container with id 677f34066cfbef8437629921b0a98100a7a8b7c3fe3e954fe2b37932e0b9976b Jul 01 18:35:12.481717 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:12.481681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" event={"ID":"3421468e-4189-47f3-aa29-fdb7f48d068e","Type":"ContainerStarted","Data":"677f34066cfbef8437629921b0a98100a7a8b7c3fe3e954fe2b37932e0b9976b"} Jul 01 18:35:27.577325 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:27.577286 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" event={"ID":"b80d0cbe-d888-410b-bb63-728e85924b0b","Type":"ContainerStarted","Data":"39119e08643d61ddced95d47f60b66d602ecebc3ed48904e100e8c1980d20b6a"} Jul 01 18:35:27.594231 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:27.594176 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h8cng" podStartSLOduration=3.309262429 podStartE2EDuration="27.594159868s" totalImagesPullingTime="24.284897439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:35:27.593060278 +0000 UTC m=+484.842943391" watchObservedRunningTime="2026-07-01 18:35:27.594159868 +0000 UTC m=+484.844042981" Jul 01 18:35:32.608838 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:32.608803 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" event={"ID":"3421468e-4189-47f3-aa29-fdb7f48d068e","Type":"ContainerStarted","Data":"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5"} Jul 01 18:35:32.609288 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:32.608950 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:32.632716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:32.632670 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" podStartSLOduration=1.533400571 podStartE2EDuration="21.63265456s" totalImagesPullingTime="20.099253989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:35:32.629463041 +0000 UTC m=+489.879346155" watchObservedRunningTime="2026-07-01 18:35:32.63265456 +0000 UTC m=+489.882537673" Jul 01 18:35:43.616450 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:43.616419 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:55.646640 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.646611 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:55.647034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.646823 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" podUID="3421468e-4189-47f3-aa29-fdb7f48d068e" containerName="manager" containerID="cri-o://6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5" gracePeriod=10 Jul 01 18:35:55.904807 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.904773 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:55.919026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.919008 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgc4k\" (UniqueName: \"kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k\") pod \"3421468e-4189-47f3-aa29-fdb7f48d068e\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " Jul 01 18:35:55.919100 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.919042 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume\") pod \"3421468e-4189-47f3-aa29-fdb7f48d068e\" (UID: \"3421468e-4189-47f3-aa29-fdb7f48d068e\") " Jul 01 18:35:55.919547 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.919519 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3421468e-4189-47f3-aa29-fdb7f48d068e" (UID: "3421468e-4189-47f3-aa29-fdb7f48d068e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:35:55.921118 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:55.921096 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k" (OuterVolumeSpecName: "kube-api-access-wgc4k") pod "3421468e-4189-47f3-aa29-fdb7f48d068e" (UID: "3421468e-4189-47f3-aa29-fdb7f48d068e"). InnerVolumeSpecName "kube-api-access-wgc4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:56.020102 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.020077 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgc4k\" (UniqueName: \"kubernetes.io/projected/3421468e-4189-47f3-aa29-fdb7f48d068e-kube-api-access-wgc4k\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:35:56.020102 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.020100 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3421468e-4189-47f3-aa29-fdb7f48d068e-extensions-socket-volume\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:35:56.730815 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.730769 2566 generic.go:356] "Generic (PLEG): container finished" podID="3421468e-4189-47f3-aa29-fdb7f48d068e" containerID="6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5" exitCode=0 Jul 01 18:35:56.730815 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.730825 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" Jul 01 18:35:56.731250 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.730865 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" event={"ID":"3421468e-4189-47f3-aa29-fdb7f48d068e","Type":"ContainerDied","Data":"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5"} Jul 01 18:35:56.731250 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.730918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5" event={"ID":"3421468e-4189-47f3-aa29-fdb7f48d068e","Type":"ContainerDied","Data":"677f34066cfbef8437629921b0a98100a7a8b7c3fe3e954fe2b37932e0b9976b"} Jul 01 18:35:56.731250 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.730942 2566 scope.go:117] "RemoveContainer" containerID="6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5" Jul 01 18:35:56.739912 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.739893 2566 scope.go:117] "RemoveContainer" containerID="6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5" Jul 01 18:35:56.740190 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:35:56.740171 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5\": container with ID starting with 6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5 not found: ID does not exist" containerID="6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5" Jul 01 18:35:56.740257 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.740199 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5"} err="failed to get container status \"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5\": rpc error: code = NotFound desc = could not find container \"6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5\": container with ID starting with 6c072c4a653a56ae3d6fbc0a0599df9c2f8c14e4e4dea7a213955e281f4ac4d5 not found: ID does not exist" Jul 01 18:35:56.764230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.764208 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:56.769816 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:56.769796 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-njfb5"] Jul 01 18:35:57.205431 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:35:57.205402 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3421468e-4189-47f3-aa29-fdb7f48d068e" path="/var/lib/kubelet/pods/3421468e-4189-47f3-aa29-fdb7f48d068e/volumes" Jul 01 18:36:02.770592 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.770554 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:02.771013 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.770998 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3421468e-4189-47f3-aa29-fdb7f48d068e" containerName="manager" Jul 01 18:36:02.771072 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.771017 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3421468e-4189-47f3-aa29-fdb7f48d068e" containerName="manager" Jul 01 18:36:02.771113 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.771087 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3421468e-4189-47f3-aa29-fdb7f48d068e" containerName="manager" Jul 01 18:36:02.817470 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.817446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:02.817647 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.817531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.820207 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.820175 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 18:36:02.860377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.860344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:02.871655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.871634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5skw\" (UniqueName: \"kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.871747 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.871691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.972878 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.972851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.972999 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.972914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5skw\" (UniqueName: \"kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.973496 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.973476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:02.981416 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:02.981396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5skw\" (UniqueName: \"kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw\") pod \"limitador-limitador-64c94fd64f-drqng\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:03.128712 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.128688 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:03.262641 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.262615 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:03.264127 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:36:03.264095 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda725a7c_9d29_41ef_a0c6_cfc01ecfcaf2.slice/crio-0612a8d2c3f54ff6a8378eb6bd1e48d57621e6c058d7451557046b285c4602e0 WatchSource:0}: Error finding container 0612a8d2c3f54ff6a8378eb6bd1e48d57621e6c058d7451557046b285c4602e0: Status 404 returned error can't find the container with id 0612a8d2c3f54ff6a8378eb6bd1e48d57621e6c058d7451557046b285c4602e0 Jul 01 18:36:03.590964 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.590895 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:03.596991 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.596959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:03.600222 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.600195 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zst7\"" Jul 01 18:36:03.601116 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.601094 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:03.680151 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.680126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p29f5\" (UniqueName: \"kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5\") pod \"authorino-58cd955675-rb2pq\" (UID: \"44f84d67-c61b-405d-a969-28bb76562a79\") " pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:03.692304 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.692276 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:36:03.695324 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.695307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:36:03.702453 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.702434 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:36:03.767871 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.767842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" event={"ID":"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2","Type":"ContainerStarted","Data":"0612a8d2c3f54ff6a8378eb6bd1e48d57621e6c058d7451557046b285c4602e0"} Jul 01 18:36:03.781258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.781236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pzww\" (UniqueName: \"kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww\") pod \"authorino-75d556bd77-2dd8v\" (UID: \"0a81011d-8d8d-4e99-a08e-58701566dc55\") " pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:36:03.781557 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.781282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p29f5\" (UniqueName: \"kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5\") pod \"authorino-58cd955675-rb2pq\" (UID: \"44f84d67-c61b-405d-a969-28bb76562a79\") " pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:03.790449 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.790424 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p29f5\" (UniqueName: \"kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5\") pod \"authorino-58cd955675-rb2pq\" (UID: \"44f84d67-c61b-405d-a969-28bb76562a79\") " pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:03.882190 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.882131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pzww\" (UniqueName: \"kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww\") pod \"authorino-75d556bd77-2dd8v\" (UID: \"0a81011d-8d8d-4e99-a08e-58701566dc55\") " pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:36:03.890716 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.890697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pzww\" (UniqueName: \"kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww\") pod \"authorino-75d556bd77-2dd8v\" (UID: \"0a81011d-8d8d-4e99-a08e-58701566dc55\") " pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:36:03.907441 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:03.907422 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:04.005083 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:04.005051 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:36:04.037560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:04.037521 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:04.039261 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:36:04.039230 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44f84d67_c61b_405d_a969_28bb76562a79.slice/crio-3ec2bc1df41a5c852c0919e98eeb2b5d5670bf08095367b9f0d39c094b516890 WatchSource:0}: Error finding container 3ec2bc1df41a5c852c0919e98eeb2b5d5670bf08095367b9f0d39c094b516890: Status 404 returned error can't find the container with id 3ec2bc1df41a5c852c0919e98eeb2b5d5670bf08095367b9f0d39c094b516890 Jul 01 18:36:04.167556 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:04.167525 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:36:04.169580 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:36:04.169552 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a81011d_8d8d_4e99_a08e_58701566dc55.slice/crio-08ce1f57113d9d0ea551adf698e9b6a21b93783a008d965a824fafd04bf23446 WatchSource:0}: Error finding container 08ce1f57113d9d0ea551adf698e9b6a21b93783a008d965a824fafd04bf23446: Status 404 returned error can't find the container with id 08ce1f57113d9d0ea551adf698e9b6a21b93783a008d965a824fafd04bf23446 Jul 01 18:36:04.777927 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:04.777874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2dd8v" event={"ID":"0a81011d-8d8d-4e99-a08e-58701566dc55","Type":"ContainerStarted","Data":"08ce1f57113d9d0ea551adf698e9b6a21b93783a008d965a824fafd04bf23446"} Jul 01 18:36:04.781115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:04.781061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rb2pq" event={"ID":"44f84d67-c61b-405d-a969-28bb76562a79","Type":"ContainerStarted","Data":"3ec2bc1df41a5c852c0919e98eeb2b5d5670bf08095367b9f0d39c094b516890"} Jul 01 18:36:08.808356 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.808311 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rb2pq" event={"ID":"44f84d67-c61b-405d-a969-28bb76562a79","Type":"ContainerStarted","Data":"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7"} Jul 01 18:36:08.809906 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.809883 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" event={"ID":"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2","Type":"ContainerStarted","Data":"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469"} Jul 01 18:36:08.810017 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.809930 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:08.811293 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.811269 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2dd8v" event={"ID":"0a81011d-8d8d-4e99-a08e-58701566dc55","Type":"ContainerStarted","Data":"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba"} Jul 01 18:36:08.827046 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.827007 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rb2pq" podStartSLOduration=1.7129592 podStartE2EDuration="5.826994176s" totalImagesPullingTime="4.114034976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:08.825615114 +0000 UTC m=+526.075498228" watchObservedRunningTime="2026-07-01 18:36:08.826994176 +0000 UTC m=+526.076877288" Jul 01 18:36:08.846268 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.846224 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" podStartSLOduration=1.957337226 podStartE2EDuration="6.846210139s" totalImagesPullingTime="4.888872913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:08.844094792 +0000 UTC m=+526.093977916" watchObservedRunningTime="2026-07-01 18:36:08.846210139 +0000 UTC m=+526.096093252" Jul 01 18:36:08.861879 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.861833 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2dd8v" podStartSLOduration=1.8752640729999999 podStartE2EDuration="5.861818402s" totalImagesPullingTime="3.986554329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:08.860605481 +0000 UTC m=+526.110488595" watchObservedRunningTime="2026-07-01 18:36:08.861818402 +0000 UTC m=+526.111701515" Jul 01 18:36:08.887101 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:08.887067 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:10.824361 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:10.824312 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rb2pq" podUID="44f84d67-c61b-405d-a969-28bb76562a79" containerName="authorino" containerID="cri-o://693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7" gracePeriod=30 Jul 01 18:36:11.066056 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.066025 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:11.149576 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.149496 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p29f5\" (UniqueName: \"kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5\") pod \"44f84d67-c61b-405d-a969-28bb76562a79\" (UID: \"44f84d67-c61b-405d-a969-28bb76562a79\") " Jul 01 18:36:11.151676 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.151648 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5" (OuterVolumeSpecName: "kube-api-access-p29f5") pod "44f84d67-c61b-405d-a969-28bb76562a79" (UID: "44f84d67-c61b-405d-a969-28bb76562a79"). InnerVolumeSpecName "kube-api-access-p29f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:36:11.250528 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.250505 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p29f5\" (UniqueName: \"kubernetes.io/projected/44f84d67-c61b-405d-a969-28bb76562a79-kube-api-access-p29f5\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:11.830399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.830365 2566 generic.go:356] "Generic (PLEG): container finished" podID="44f84d67-c61b-405d-a969-28bb76562a79" containerID="693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7" exitCode=0 Jul 01 18:36:11.830849 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.830406 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rb2pq" Jul 01 18:36:11.830849 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.830454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rb2pq" event={"ID":"44f84d67-c61b-405d-a969-28bb76562a79","Type":"ContainerDied","Data":"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7"} Jul 01 18:36:11.830849 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.830491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rb2pq" event={"ID":"44f84d67-c61b-405d-a969-28bb76562a79","Type":"ContainerDied","Data":"3ec2bc1df41a5c852c0919e98eeb2b5d5670bf08095367b9f0d39c094b516890"} Jul 01 18:36:11.830849 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.830509 2566 scope.go:117] "RemoveContainer" containerID="693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7" Jul 01 18:36:11.839410 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.839396 2566 scope.go:117] "RemoveContainer" containerID="693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7" Jul 01 18:36:11.839688 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:36:11.839669 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7\": container with ID starting with 693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7 not found: ID does not exist" containerID="693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7" Jul 01 18:36:11.839757 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.839697 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7"} err="failed to get container status \"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7\": rpc error: code = NotFound desc = could not find container \"693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7\": container with ID starting with 693bcc500402f692fbd6bb9bd21d06166b71d9185ac2ee3badc8a45e694999c7 not found: ID does not exist" Jul 01 18:36:11.847490 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.847467 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:11.852946 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:11.852927 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rb2pq"] Jul 01 18:36:13.206629 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:13.206596 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44f84d67-c61b-405d-a969-28bb76562a79" path="/var/lib/kubelet/pods/44f84d67-c61b-405d-a969-28bb76562a79/volumes" Jul 01 18:36:17.978984 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:17.978947 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:17.979376 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:17.979122 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" podUID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" containerName="limitador" containerID="cri-o://cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469" gracePeriod=30 Jul 01 18:36:17.979910 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:17.979887 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:18.529593 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.529563 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:18.608755 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.606084 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file\") pod \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " Jul 01 18:36:18.608755 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.606174 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5skw\" (UniqueName: \"kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw\") pod \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\" (UID: \"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2\") " Jul 01 18:36:18.608755 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.606711 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file" (OuterVolumeSpecName: "config-file") pod "da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" (UID: "da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:36:18.611828 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.609311 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw" (OuterVolumeSpecName: "kube-api-access-p5skw") pod "da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" (UID: "da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2"). InnerVolumeSpecName "kube-api-access-p5skw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:36:18.707185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.707160 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-config-file\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:18.707185 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.707183 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5skw\" (UniqueName: \"kubernetes.io/projected/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2-kube-api-access-p5skw\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:18.870158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.870063 2566 generic.go:356] "Generic (PLEG): container finished" podID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" containerID="cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469" exitCode=0 Jul 01 18:36:18.870158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.870134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" event={"ID":"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2","Type":"ContainerDied","Data":"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469"} Jul 01 18:36:18.870158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.870140 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" Jul 01 18:36:18.870330 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.870202 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-drqng" event={"ID":"da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2","Type":"ContainerDied","Data":"0612a8d2c3f54ff6a8378eb6bd1e48d57621e6c058d7451557046b285c4602e0"} Jul 01 18:36:18.870330 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.870224 2566 scope.go:117] "RemoveContainer" containerID="cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469" Jul 01 18:36:18.878876 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.878861 2566 scope.go:117] "RemoveContainer" containerID="cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469" Jul 01 18:36:18.879111 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:36:18.879095 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469\": container with ID starting with cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469 not found: ID does not exist" containerID="cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469" Jul 01 18:36:18.879157 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.879119 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469"} err="failed to get container status \"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469\": rpc error: code = NotFound desc = could not find container \"cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469\": container with ID starting with cd3794ac4bfbcb6d9f571fff225072c6284254cc50454e3d497ba24e58f29469 not found: ID does not exist" Jul 01 18:36:18.899970 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.899946 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:18.908132 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:18.908111 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-drqng"] Jul 01 18:36:19.205153 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:19.205126 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" path="/var/lib/kubelet/pods/da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2/volumes" Jul 01 18:36:24.335366 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335332 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-897js"] Jul 01 18:36:24.335714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335640 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44f84d67-c61b-405d-a969-28bb76562a79" containerName="authorino" Jul 01 18:36:24.335714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335651 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="44f84d67-c61b-405d-a969-28bb76562a79" containerName="authorino" Jul 01 18:36:24.335714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335663 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" containerName="limitador" Jul 01 18:36:24.335714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335668 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" containerName="limitador" Jul 01 18:36:24.335862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335721 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="da725a7c-9d29-41ef-a0c6-cfc01ecfcaf2" containerName="limitador" Jul 01 18:36:24.335862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.335730 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="44f84d67-c61b-405d-a969-28bb76562a79" containerName="authorino" Jul 01 18:36:24.339934 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.339915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.343034 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.343011 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjrjx\"" Jul 01 18:36:24.343141 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.343048 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 18:36:24.348022 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.347988 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-897js"] Jul 01 18:36:24.450515 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.450484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8aee9d58-ffcc-4107-9a5c-2d219f69702e-data\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.450651 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.450529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tnx\" (UniqueName: \"kubernetes.io/projected/8aee9d58-ffcc-4107-9a5c-2d219f69702e-kube-api-access-k9tnx\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.551670 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.551634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8aee9d58-ffcc-4107-9a5c-2d219f69702e-data\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.551864 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.551684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tnx\" (UniqueName: \"kubernetes.io/projected/8aee9d58-ffcc-4107-9a5c-2d219f69702e-kube-api-access-k9tnx\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.552083 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.552058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8aee9d58-ffcc-4107-9a5c-2d219f69702e-data\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.560737 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.560715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tnx\" (UniqueName: \"kubernetes.io/projected/8aee9d58-ffcc-4107-9a5c-2d219f69702e-kube-api-access-k9tnx\") pod \"postgres-69fb4594cf-897js\" (UID: \"8aee9d58-ffcc-4107-9a5c-2d219f69702e\") " pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.659951 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.659882 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:24.791253 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.791146 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-897js"] Jul 01 18:36:24.793721 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:36:24.793694 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aee9d58_ffcc_4107_9a5c_2d219f69702e.slice/crio-7e4c1b922c67461c9c74bfce5c52aaa55dd4ccf609dc376f13313988eeef58af WatchSource:0}: Error finding container 7e4c1b922c67461c9c74bfce5c52aaa55dd4ccf609dc376f13313988eeef58af: Status 404 returned error can't find the container with id 7e4c1b922c67461c9c74bfce5c52aaa55dd4ccf609dc376f13313988eeef58af Jul 01 18:36:24.903364 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:24.903334 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-897js" event={"ID":"8aee9d58-ffcc-4107-9a5c-2d219f69702e","Type":"ContainerStarted","Data":"7e4c1b922c67461c9c74bfce5c52aaa55dd4ccf609dc376f13313988eeef58af"} Jul 01 18:36:30.942353 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:30.942319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-897js" event={"ID":"8aee9d58-ffcc-4107-9a5c-2d219f69702e","Type":"ContainerStarted","Data":"f8e49e8143b9ee34d6abd89b5738f50217c8ace5fd608bdfdde654001153ea20"} Jul 01 18:36:30.942762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:30.942386 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:30.960514 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:30.960471 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-897js" podStartSLOduration=1.771575246 podStartE2EDuration="6.960456134s" totalImagesPullingTime="5.188880888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:30.957935347 +0000 UTC m=+548.207818456" watchObservedRunningTime="2026-07-01 18:36:30.960456134 +0000 UTC m=+548.210339244" Jul 01 18:36:36.976926 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:36.976899 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-897js" Jul 01 18:36:38.650220 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.650182 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6"] Jul 01 18:36:38.696265 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.696240 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6"] Jul 01 18:36:38.696404 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.696346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.699865 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.699842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 18:36:38.700008 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.699870 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngzlz\"" Jul 01 18:36:38.700911 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.700892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 18:36:38.766740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.766707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.767080 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.766752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmnb\" (UniqueName: \"kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.767080 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.766817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.867626 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.867596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.867744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.867633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmnb\" (UniqueName: \"kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.867744 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.867661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.867968 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.867949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.868029 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.868010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:38.877673 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:38.877651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmnb\" (UniqueName: \"kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:39.011507 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:39.011483 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:39.205232 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:36:39.205207 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c6d9ac_33bf_4b20_a9b8_787958f58952.slice/crio-0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2 WatchSource:0}: Error finding container 0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2: Status 404 returned error can't find the container with id 0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2 Jul 01 18:36:39.209436 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:39.209414 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6"] Jul 01 18:36:39.990169 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:39.990134 2566 generic.go:356] "Generic (PLEG): container finished" podID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerID="088755b0d78c80e3b09e1c19d2876cde2bf008fac22875dbf201923f7493e54c" exitCode=0 Jul 01 18:36:39.990527 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:39.990223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" event={"ID":"72c6d9ac-33bf-4b20-a9b8-787958f58952","Type":"ContainerDied","Data":"088755b0d78c80e3b09e1c19d2876cde2bf008fac22875dbf201923f7493e54c"} Jul 01 18:36:39.990527 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:39.990282 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" event={"ID":"72c6d9ac-33bf-4b20-a9b8-787958f58952","Type":"ContainerStarted","Data":"0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2"} Jul 01 18:36:42.005171 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:42.005137 2566 generic.go:356] "Generic (PLEG): container finished" podID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerID="de8127431c8146664418c6fffa7ca5d219abbe8da66c2d8182cf831341647633" exitCode=0 Jul 01 18:36:42.005533 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:42.005222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" event={"ID":"72c6d9ac-33bf-4b20-a9b8-787958f58952","Type":"ContainerDied","Data":"de8127431c8146664418c6fffa7ca5d219abbe8da66c2d8182cf831341647633"} Jul 01 18:36:43.012672 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:43.012639 2566 generic.go:356] "Generic (PLEG): container finished" podID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerID="799528305c7c33f6d89eabed856e37668487cc69b1da9d9e359c7f70f7fbb19f" exitCode=0 Jul 01 18:36:43.013129 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:43.012759 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" event={"ID":"72c6d9ac-33bf-4b20-a9b8-787958f58952","Type":"ContainerDied","Data":"799528305c7c33f6d89eabed856e37668487cc69b1da9d9e359c7f70f7fbb19f"} Jul 01 18:36:44.145263 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.145237 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:44.313077 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.312998 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle\") pod \"72c6d9ac-33bf-4b20-a9b8-787958f58952\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " Jul 01 18:36:44.313077 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.313072 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmnb\" (UniqueName: \"kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb\") pod \"72c6d9ac-33bf-4b20-a9b8-787958f58952\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " Jul 01 18:36:44.313248 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.313098 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util\") pod \"72c6d9ac-33bf-4b20-a9b8-787958f58952\" (UID: \"72c6d9ac-33bf-4b20-a9b8-787958f58952\") " Jul 01 18:36:44.314025 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.313813 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle" (OuterVolumeSpecName: "bundle") pod "72c6d9ac-33bf-4b20-a9b8-787958f58952" (UID: "72c6d9ac-33bf-4b20-a9b8-787958f58952"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:36:44.315831 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.315552 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb" (OuterVolumeSpecName: "kube-api-access-vqmnb") pod "72c6d9ac-33bf-4b20-a9b8-787958f58952" (UID: "72c6d9ac-33bf-4b20-a9b8-787958f58952"). InnerVolumeSpecName "kube-api-access-vqmnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:36:44.321632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.321601 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util" (OuterVolumeSpecName: "util") pod "72c6d9ac-33bf-4b20-a9b8-787958f58952" (UID: "72c6d9ac-33bf-4b20-a9b8-787958f58952"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:36:44.414231 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.414207 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqmnb\" (UniqueName: \"kubernetes.io/projected/72c6d9ac-33bf-4b20-a9b8-787958f58952-kube-api-access-vqmnb\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:44.414231 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.414231 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:44.414381 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:44.414240 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72c6d9ac-33bf-4b20-a9b8-787958f58952-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:36:45.025086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:45.025060 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" Jul 01 18:36:45.025086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:45.025065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c87j5w6" event={"ID":"72c6d9ac-33bf-4b20-a9b8-787958f58952","Type":"ContainerDied","Data":"0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2"} Jul 01 18:36:45.025304 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:36:45.025140 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0116cb5d9eef4e658e15f5f0e6c60b26a9ca9a3ba596c3c215f3fced228f1de2" Jul 01 18:37:07.226388 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226352 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226659 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="extract" Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226670 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="extract" Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226683 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="pull" Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226688 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="pull" Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226699 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="util" Jul 01 18:37:07.226740 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226704 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="util" Jul 01 18:37:07.226965 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.226761 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c6d9ac-33bf-4b20-a9b8-787958f58952" containerName="extract" Jul 01 18:37:07.229836 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.229818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:07.232892 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.232872 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 18:37:07.232892 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.232880 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 18:37:07.233099 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.232964 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 18:37:07.234243 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.234224 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-q7tcb\"" Jul 01 18:37:07.240097 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.240077 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:37:07.282825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.282772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gbc\" (UniqueName: \"kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc\") pod \"maas-keycloak-0\" (UID: \"13f186f3-2d2e-4b3e-9dc6-63de28393be3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:07.383978 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.383949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gbc\" (UniqueName: \"kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc\") pod \"maas-keycloak-0\" (UID: \"13f186f3-2d2e-4b3e-9dc6-63de28393be3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:07.394119 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.394091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gbc\" (UniqueName: \"kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc\") pod \"maas-keycloak-0\" (UID: \"13f186f3-2d2e-4b3e-9dc6-63de28393be3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:07.540231 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.540166 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:07.682081 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:07.682054 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:37:07.684081 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:37:07.684053 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f186f3_2d2e_4b3e_9dc6_63de28393be3.slice/crio-8c9959e8e40e87a7a77810216c80059b327ac7d7a29a3a2dc370910c31a9c134 WatchSource:0}: Error finding container 8c9959e8e40e87a7a77810216c80059b327ac7d7a29a3a2dc370910c31a9c134: Status 404 returned error can't find the container with id 8c9959e8e40e87a7a77810216c80059b327ac7d7a29a3a2dc370910c31a9c134 Jul 01 18:37:08.144671 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:08.144629 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13f186f3-2d2e-4b3e-9dc6-63de28393be3","Type":"ContainerStarted","Data":"8c9959e8e40e87a7a77810216c80059b327ac7d7a29a3a2dc370910c31a9c134"} Jul 01 18:37:13.175847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:13.175820 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13f186f3-2d2e-4b3e-9dc6-63de28393be3","Type":"ContainerStarted","Data":"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b"} Jul 01 18:37:13.194841 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:13.194775 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.786120603 podStartE2EDuration="6.194733361s" totalImagesPullingTime="5.408612758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:13.194136666 +0000 UTC m=+590.444019780" watchObservedRunningTime="2026-07-01 18:37:13.194733361 +0000 UTC m=+590.444616473" Jul 01 18:37:13.540824 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:13.540769 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:13.542573 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:13.542529 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:14.541249 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:14.541201 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:15.541496 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:15.541446 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:16.541279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:16.541224 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:17.541184 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:17.541143 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:17.541684 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:17.541439 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:18.541136 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:18.541080 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:19.541398 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:19.541341 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:20.541243 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:20.541188 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:21.541057 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:21.541014 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:22.540918 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:22.540876 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:23.205350 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:23.205295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:37:23.205844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:23.205610 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:37:23.541142 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:23.541034 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:24.541111 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:24.541066 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:25.540618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:25.540569 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jul 01 18:37:26.666878 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:26.666840 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:26.687420 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:26.687372 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:37:36.674270 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:36.674236 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:37:37.578203 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.578175 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xjq2z"] Jul 01 18:37:37.580465 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.580445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:37.588640 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.588615 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xjq2z"] Jul 01 18:37:37.698199 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.698167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv48g\" (UniqueName: \"kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g\") pod \"authorino-5d4b67c446-xjq2z\" (UID: \"42f57996-48f6-4f99-badd-e2e106f04dfe\") " pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:37.798931 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.798900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv48g\" (UniqueName: \"kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g\") pod \"authorino-5d4b67c446-xjq2z\" (UID: \"42f57996-48f6-4f99-badd-e2e106f04dfe\") " pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:37.802603 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.802580 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xjq2z"] Jul 01 18:37:37.802843 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:37:37.802824 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hv48g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-xjq2z" podUID="42f57996-48f6-4f99-badd-e2e106f04dfe" Jul 01 18:37:37.810932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.810913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv48g\" (UniqueName: \"kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g\") pod \"authorino-5d4b67c446-xjq2z\" (UID: \"42f57996-48f6-4f99-badd-e2e106f04dfe\") " pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:37.834056 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.834000 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7548b99c88-hhlb2"] Jul 01 18:37:37.836061 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.836047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:37.845291 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.845269 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7548b99c88-hhlb2"] Jul 01 18:37:37.900053 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.900031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jpqm\" (UniqueName: \"kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm\") pod \"authorino-7548b99c88-hhlb2\" (UID: \"3f1876c4-5ff2-437a-9e58-b7a435974d44\") " pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:37.911456 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.911430 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7548b99c88-hhlb2"] Jul 01 18:37:37.911639 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:37:37.911623 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8jpqm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7548b99c88-hhlb2" podUID="3f1876c4-5ff2-437a-9e58-b7a435974d44" Jul 01 18:37:37.941023 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.940994 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:37:37.943253 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.943236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:37.946233 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.946207 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 18:37:37.953830 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:37.953811 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:37:38.000701 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.000678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jpqm\" (UniqueName: \"kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm\") pod \"authorino-7548b99c88-hhlb2\" (UID: \"3f1876c4-5ff2-437a-9e58-b7a435974d44\") " pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:38.000848 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.000709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.000848 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.000809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9fr4\" (UniqueName: \"kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.010547 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.010523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jpqm\" (UniqueName: \"kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm\") pod \"authorino-7548b99c88-hhlb2\" (UID: \"3f1876c4-5ff2-437a-9e58-b7a435974d44\") " pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:38.101510 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.101452 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9fr4\" (UniqueName: \"kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.101510 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.101498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.103919 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.103898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.113462 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.113436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9fr4\" (UniqueName: \"kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4\") pod \"authorino-8588845cbd-6z6dh\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.251649 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.251627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:37:38.337379 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.337343 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:38.337522 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.337386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:38.345669 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.345616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:38.350115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.350089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:38.394214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.394189 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:37:38.396247 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:37:38.396223 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6d9fff3_5046_450d_8ae8_5e804fb02462.slice/crio-8c470306814bb12725f75d1b9fb9f7b67f5e09e08303fced858037121b81ee7e WatchSource:0}: Error finding container 8c470306814bb12725f75d1b9fb9f7b67f5e09e08303fced858037121b81ee7e: Status 404 returned error can't find the container with id 8c470306814bb12725f75d1b9fb9f7b67f5e09e08303fced858037121b81ee7e Jul 01 18:37:38.397475 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.397455 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:37:38.404817 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.404779 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jpqm\" (UniqueName: \"kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm\") pod \"3f1876c4-5ff2-437a-9e58-b7a435974d44\" (UID: \"3f1876c4-5ff2-437a-9e58-b7a435974d44\") " Jul 01 18:37:38.404932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.404883 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv48g\" (UniqueName: \"kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g\") pod \"42f57996-48f6-4f99-badd-e2e106f04dfe\" (UID: \"42f57996-48f6-4f99-badd-e2e106f04dfe\") " Jul 01 18:37:38.406966 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.406945 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g" (OuterVolumeSpecName: "kube-api-access-hv48g") pod "42f57996-48f6-4f99-badd-e2e106f04dfe" (UID: "42f57996-48f6-4f99-badd-e2e106f04dfe"). InnerVolumeSpecName "kube-api-access-hv48g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:37:38.407064 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.407026 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm" (OuterVolumeSpecName: "kube-api-access-8jpqm") pod "3f1876c4-5ff2-437a-9e58-b7a435974d44" (UID: "3f1876c4-5ff2-437a-9e58-b7a435974d44"). InnerVolumeSpecName "kube-api-access-8jpqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:37:38.506298 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.506264 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jpqm\" (UniqueName: \"kubernetes.io/projected/3f1876c4-5ff2-437a-9e58-b7a435974d44-kube-api-access-8jpqm\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:37:38.506298 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:38.506296 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv48g\" (UniqueName: \"kubernetes.io/projected/42f57996-48f6-4f99-badd-e2e106f04dfe-kube-api-access-hv48g\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:37:39.343463 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.343420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8588845cbd-6z6dh" event={"ID":"f6d9fff3-5046-450d-8ae8-5e804fb02462","Type":"ContainerStarted","Data":"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9"} Jul 01 18:37:39.343463 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.343442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7548b99c88-hhlb2" Jul 01 18:37:39.343463 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.343464 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xjq2z" Jul 01 18:37:39.343916 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.343466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8588845cbd-6z6dh" event={"ID":"f6d9fff3-5046-450d-8ae8-5e804fb02462","Type":"ContainerStarted","Data":"8c470306814bb12725f75d1b9fb9f7b67f5e09e08303fced858037121b81ee7e"} Jul 01 18:37:39.364107 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.364062 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8588845cbd-6z6dh" podStartSLOduration=1.949512496 podStartE2EDuration="2.364050263s" totalImagesPullingTime="414.537767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:39.36324975 +0000 UTC m=+616.613132855" watchObservedRunningTime="2026-07-01 18:37:39.364050263 +0000 UTC m=+616.613933376" Jul 01 18:37:39.390923 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.390900 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xjq2z"] Jul 01 18:37:39.397664 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.397628 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:37:39.397864 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.397823 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2dd8v" podUID="0a81011d-8d8d-4e99-a08e-58701566dc55" containerName="authorino" containerID="cri-o://b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba" gracePeriod=30 Jul 01 18:37:39.402323 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.401984 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xjq2z"] Jul 01 18:37:39.426404 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.426377 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7548b99c88-hhlb2"] Jul 01 18:37:39.432337 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.432306 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7548b99c88-hhlb2"] Jul 01 18:37:39.651591 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.651570 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:37:39.726458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.726431 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pzww\" (UniqueName: \"kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww\") pod \"0a81011d-8d8d-4e99-a08e-58701566dc55\" (UID: \"0a81011d-8d8d-4e99-a08e-58701566dc55\") " Jul 01 18:37:39.728546 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.728518 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww" (OuterVolumeSpecName: "kube-api-access-5pzww") pod "0a81011d-8d8d-4e99-a08e-58701566dc55" (UID: "0a81011d-8d8d-4e99-a08e-58701566dc55"). InnerVolumeSpecName "kube-api-access-5pzww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:37:39.826989 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:39.826964 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pzww\" (UniqueName: \"kubernetes.io/projected/0a81011d-8d8d-4e99-a08e-58701566dc55-kube-api-access-5pzww\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:37:40.349426 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.349395 2566 generic.go:356] "Generic (PLEG): container finished" podID="0a81011d-8d8d-4e99-a08e-58701566dc55" containerID="b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba" exitCode=0 Jul 01 18:37:40.349887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.349436 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2dd8v" Jul 01 18:37:40.349887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.349488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2dd8v" event={"ID":"0a81011d-8d8d-4e99-a08e-58701566dc55","Type":"ContainerDied","Data":"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba"} Jul 01 18:37:40.349887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.349529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2dd8v" event={"ID":"0a81011d-8d8d-4e99-a08e-58701566dc55","Type":"ContainerDied","Data":"08ce1f57113d9d0ea551adf698e9b6a21b93783a008d965a824fafd04bf23446"} Jul 01 18:37:40.349887 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.349550 2566 scope.go:117] "RemoveContainer" containerID="b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba" Jul 01 18:37:40.359258 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.359239 2566 scope.go:117] "RemoveContainer" containerID="b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba" Jul 01 18:37:40.359495 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:37:40.359477 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba\": container with ID starting with b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba not found: ID does not exist" containerID="b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba" Jul 01 18:37:40.359551 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.359503 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba"} err="failed to get container status \"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba\": rpc error: code = NotFound desc = could not find container \"b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba\": container with ID starting with b0e975fdfa43cb0d0890845e7811ff4fc73eafba46f2356ab133852788a691ba not found: ID does not exist" Jul 01 18:37:40.376793 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.376761 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:37:40.380231 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:40.380211 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2dd8v"] Jul 01 18:37:41.206332 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:41.206300 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a81011d-8d8d-4e99-a08e-58701566dc55" path="/var/lib/kubelet/pods/0a81011d-8d8d-4e99-a08e-58701566dc55/volumes" Jul 01 18:37:41.206608 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:41.206594 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f1876c4-5ff2-437a-9e58-b7a435974d44" path="/var/lib/kubelet/pods/3f1876c4-5ff2-437a-9e58-b7a435974d44/volumes" Jul 01 18:37:41.206817 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:41.206780 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f57996-48f6-4f99-badd-e2e106f04dfe" path="/var/lib/kubelet/pods/42f57996-48f6-4f99-badd-e2e106f04dfe/volumes" Jul 01 18:37:44.121047 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.120960 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69d4dbdc54-kvd5g"] Jul 01 18:37:44.121497 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.121476 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a81011d-8d8d-4e99-a08e-58701566dc55" containerName="authorino" Jul 01 18:37:44.121575 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.121502 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a81011d-8d8d-4e99-a08e-58701566dc55" containerName="authorino" Jul 01 18:37:44.121630 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.121603 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a81011d-8d8d-4e99-a08e-58701566dc55" containerName="authorino" Jul 01 18:37:44.124144 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.124122 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.127145 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.127111 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 18:37:44.127267 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.127116 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-db8w5\"" Jul 01 18:37:44.129022 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.129006 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 18:37:44.135305 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.135281 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d4dbdc54-kvd5g"] Jul 01 18:37:44.162985 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.162962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-webhook-cert\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.163086 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.163005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrqq\" (UniqueName: \"kubernetes.io/projected/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-kube-api-access-wmrqq\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.263426 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.263399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrqq\" (UniqueName: \"kubernetes.io/projected/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-kube-api-access-wmrqq\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.263509 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.263476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-webhook-cert\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.265904 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.265878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-webhook-cert\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.274605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.274584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrqq\" (UniqueName: \"kubernetes.io/projected/c2204ee0-0f03-4f63-8f87-1bf0313fe18d-kube-api-access-wmrqq\") pod \"maas-controller-69d4dbdc54-kvd5g\" (UID: \"c2204ee0-0f03-4f63-8f87-1bf0313fe18d\") " pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.434903 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.434875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:44.568700 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:44.568677 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d4dbdc54-kvd5g"] Jul 01 18:37:44.570404 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:37:44.570380 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2204ee0_0f03_4f63_8f87_1bf0313fe18d.slice/crio-eab4f035d01d25e8a4ed39d9df22e1ecf540a657d78204bf5ee5b7eacbb20e0f WatchSource:0}: Error finding container eab4f035d01d25e8a4ed39d9df22e1ecf540a657d78204bf5ee5b7eacbb20e0f: Status 404 returned error can't find the container with id eab4f035d01d25e8a4ed39d9df22e1ecf540a657d78204bf5ee5b7eacbb20e0f Jul 01 18:37:45.378239 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:45.378201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" event={"ID":"c2204ee0-0f03-4f63-8f87-1bf0313fe18d","Type":"ContainerStarted","Data":"eab4f035d01d25e8a4ed39d9df22e1ecf540a657d78204bf5ee5b7eacbb20e0f"} Jul 01 18:37:47.398285 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:47.398164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" event={"ID":"c2204ee0-0f03-4f63-8f87-1bf0313fe18d","Type":"ContainerStarted","Data":"7112ffb5c2c9470ac11e68d401c50c8d3bfc0b0b8df724459559077114d26cc9"} Jul 01 18:37:47.398715 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:47.398373 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:37:47.431237 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:47.431190 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" podStartSLOduration=1.009603907 podStartE2EDuration="3.431177572s" totalImagesPullingTime="2.421573665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:47.429404983 +0000 UTC m=+624.679288096" watchObservedRunningTime="2026-07-01 18:37:47.431177572 +0000 UTC m=+624.681060684" Jul 01 18:37:58.408469 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:37:58.408442 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69d4dbdc54-kvd5g" Jul 01 18:38:19.804493 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.804459 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-qdqlf"] Jul 01 18:38:19.810821 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.810774 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.829962 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.829935 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 18:38:19.836505 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.836486 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-qdqlf"] Jul 01 18:38:19.849451 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.849431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkn98\" (UniqueName: \"kubernetes.io/projected/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-kube-api-access-nkn98\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.849558 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.849470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.888025 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.887989 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v"] Jul 01 18:38:19.892155 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.892139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:19.896423 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.896405 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8wjhc\"" Jul 01 18:38:19.931360 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.931326 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v"] Jul 01 18:38:19.950697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.950673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkn98\" (UniqueName: \"kubernetes.io/projected/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-kube-api-access-nkn98\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.950844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.950711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:19.950844 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.950746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmvt\" (UniqueName: \"kubernetes.io/projected/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-kube-api-access-ntmvt\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:19.950942 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.950842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.951486 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.951467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:19.963279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:19.963256 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkn98\" (UniqueName: \"kubernetes.io/projected/dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83-kube-api-access-nkn98\") pod \"payload-processing-7bbcb654f4-qdqlf\" (UID: \"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83\") " pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:20.051390 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.051361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:20.051513 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.051405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmvt\" (UniqueName: \"kubernetes.io/projected/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-kube-api-access-ntmvt\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:20.052128 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.052109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:20.062732 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.062672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmvt\" (UniqueName: \"kubernetes.io/projected/a751a43f-0b3c-4dd9-9b49-b75424c5e9f8-kube-api-access-ntmvt\") pod \"payload-pre-processing-59f49fd4f6-hkk9v\" (UID: \"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:20.120987 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.120959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:20.202145 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.202112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:20.278021 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.277989 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-qdqlf"] Jul 01 18:38:20.280391 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:38:20.280364 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabe3c50_6d5e_41fc_86c6_f29dcdd7fa83.slice/crio-a26b654d1cc984fe5a10d88b53bad53e9a3f0386dda255a327da24d08887bd32 WatchSource:0}: Error finding container a26b654d1cc984fe5a10d88b53bad53e9a3f0386dda255a327da24d08887bd32: Status 404 returned error can't find the container with id a26b654d1cc984fe5a10d88b53bad53e9a3f0386dda255a327da24d08887bd32 Jul 01 18:38:20.356550 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.356523 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v"] Jul 01 18:38:20.356894 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:38:20.356864 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda751a43f_0b3c_4dd9_9b49_b75424c5e9f8.slice/crio-07d8e58b7ea1dc16444ca633408a19b8011336c924842b399cc339ce8b8eff49 WatchSource:0}: Error finding container 07d8e58b7ea1dc16444ca633408a19b8011336c924842b399cc339ce8b8eff49: Status 404 returned error can't find the container with id 07d8e58b7ea1dc16444ca633408a19b8011336c924842b399cc339ce8b8eff49 Jul 01 18:38:20.569926 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.569892 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" event={"ID":"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8","Type":"ContainerStarted","Data":"07d8e58b7ea1dc16444ca633408a19b8011336c924842b399cc339ce8b8eff49"} Jul 01 18:38:20.571097 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:20.571074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerStarted","Data":"a26b654d1cc984fe5a10d88b53bad53e9a3f0386dda255a327da24d08887bd32"} Jul 01 18:38:23.592457 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.592371 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" event={"ID":"a751a43f-0b3c-4dd9-9b49-b75424c5e9f8","Type":"ContainerStarted","Data":"d93a9675bc120195b9ada9bf2e9014fe202c6a37760681df212ce3f96d984f15"} Jul 01 18:38:23.592858 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.592491 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:23.594007 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.593980 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerStarted","Data":"02e5151621efc26c01bdbe8847f623d5ef6ad84a5462be3fea095f6a573b05fc"} Jul 01 18:38:23.594107 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.594024 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:23.612296 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.612250 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" podStartSLOduration=2.194071123 podStartE2EDuration="4.612236857s" totalImagesPullingTime="2.418165734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:23.610542427 +0000 UTC m=+660.860425543" watchObservedRunningTime="2026-07-01 18:38:23.612236857 +0000 UTC m=+660.862119970" Jul 01 18:38:23.631189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:23.631150 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" podStartSLOduration=2.142401431 podStartE2EDuration="4.631132177s" totalImagesPullingTime="2.488730746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:23.629886052 +0000 UTC m=+660.879769220" watchObservedRunningTime="2026-07-01 18:38:23.631132177 +0000 UTC m=+660.881015291" Jul 01 18:38:30.642542 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:30.642508 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:30.643008 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:30.642695 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" containerID="cri-o://f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b" gracePeriod=30 Jul 01 18:38:32.191143 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.191117 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.243026 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.243002 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7gbc\" (UniqueName: \"kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc\") pod \"13f186f3-2d2e-4b3e-9dc6-63de28393be3\" (UID: \"13f186f3-2d2e-4b3e-9dc6-63de28393be3\") " Jul 01 18:38:32.245360 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.245331 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc" (OuterVolumeSpecName: "kube-api-access-l7gbc") pod "13f186f3-2d2e-4b3e-9dc6-63de28393be3" (UID: "13f186f3-2d2e-4b3e-9dc6-63de28393be3"). InnerVolumeSpecName "kube-api-access-l7gbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:38:32.343899 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.343841 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7gbc\" (UniqueName: \"kubernetes.io/projected/13f186f3-2d2e-4b3e-9dc6-63de28393be3-kube-api-access-l7gbc\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:38:32.643074 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.642979 2566 generic.go:356] "Generic (PLEG): container finished" podID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerID="f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b" exitCode=143 Jul 01 18:38:32.643074 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.643042 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.643274 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.643078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13f186f3-2d2e-4b3e-9dc6-63de28393be3","Type":"ContainerDied","Data":"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b"} Jul 01 18:38:32.643274 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.643134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13f186f3-2d2e-4b3e-9dc6-63de28393be3","Type":"ContainerDied","Data":"8c9959e8e40e87a7a77810216c80059b327ac7d7a29a3a2dc370910c31a9c134"} Jul 01 18:38:32.643274 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.643157 2566 scope.go:117] "RemoveContainer" containerID="f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b" Jul 01 18:38:32.653176 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.653157 2566 scope.go:117] "RemoveContainer" containerID="f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b" Jul 01 18:38:32.653452 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:38:32.653432 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b\": container with ID starting with f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b not found: ID does not exist" containerID="f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b" Jul 01 18:38:32.653506 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.653461 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b"} err="failed to get container status \"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b\": rpc error: code = NotFound desc = could not find container \"f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b\": container with ID starting with f568256828dbcb428e940ad2376486360e6bfafd0b62b57903f114bde8623d6b not found: ID does not exist" Jul 01 18:38:32.670344 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.670322 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:32.674528 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.674510 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:32.711560 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.711537 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:32.711891 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.711878 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" Jul 01 18:38:32.711945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.711893 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" Jul 01 18:38:32.711981 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.711951 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" containerName="keycloak" Jul 01 18:38:32.716312 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.716297 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.720215 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.720199 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 18:38:32.720336 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.720318 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 18:38:32.720506 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.720482 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 18:38:32.720610 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.720560 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-q7tcb\"" Jul 01 18:38:32.720772 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.720754 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 18:38:32.732238 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.732213 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:32.747301 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.747276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8l9\" (UniqueName: \"kubernetes.io/projected/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-kube-api-access-gn8l9\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.747382 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.747338 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-test-realms\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.848539 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.848519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-test-realms\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.848645 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.848567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8l9\" (UniqueName: \"kubernetes.io/projected/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-kube-api-access-gn8l9\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.849179 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.849162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-test-realms\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:32.859161 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:32.859141 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8l9\" (UniqueName: \"kubernetes.io/projected/a589a094-4ce3-4111-b9f7-58f07bf1ffe3-kube-api-access-gn8l9\") pod \"maas-keycloak-0\" (UID: \"a589a094-4ce3-4111-b9f7-58f07bf1ffe3\") " pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:33.026217 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:33.026193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:33.164536 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:33.164508 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 18:38:33.167883 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:38:33.167857 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda589a094_4ce3_4111_b9f7_58f07bf1ffe3.slice/crio-2b56aa57eff7582778c4c9d241cd0446ae21b5a19ea557252f629c871b7e8478 WatchSource:0}: Error finding container 2b56aa57eff7582778c4c9d241cd0446ae21b5a19ea557252f629c871b7e8478: Status 404 returned error can't find the container with id 2b56aa57eff7582778c4c9d241cd0446ae21b5a19ea557252f629c871b7e8478 Jul 01 18:38:33.206605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:33.206578 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13f186f3-2d2e-4b3e-9dc6-63de28393be3" path="/var/lib/kubelet/pods/13f186f3-2d2e-4b3e-9dc6-63de28393be3/volumes" Jul 01 18:38:33.650619 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:33.650581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a589a094-4ce3-4111-b9f7-58f07bf1ffe3","Type":"ContainerStarted","Data":"2b56aa57eff7582778c4c9d241cd0446ae21b5a19ea557252f629c871b7e8478"} Jul 01 18:38:34.602214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:34.602184 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-hkk9v" Jul 01 18:38:34.602677 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:34.602261 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:38:34.665121 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:34.665087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a589a094-4ce3-4111-b9f7-58f07bf1ffe3","Type":"ContainerStarted","Data":"946d4e74725e16709a8df4800b17b035490c0ee55c2145642205cb40a0d28ba6"} Jul 01 18:38:34.695184 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:34.695122 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.207629347 podStartE2EDuration="2.695098993s" totalImagesPullingTime="487.469646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:34.690903217 +0000 UTC m=+671.940786342" watchObservedRunningTime="2026-07-01 18:38:34.695098993 +0000 UTC m=+671.944982107" Jul 01 18:38:35.026607 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:35.026556 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:35.028392 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:35.028360 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:36.026810 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:36.026739 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:37.027489 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:37.027438 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:38.027522 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:38.027472 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:39.027181 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:39.027132 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:40.027006 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:40.026958 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:41.026742 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:41.026695 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:42.027164 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:42.027112 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:43.027209 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:43.027167 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:43.027698 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:43.027525 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:44.027325 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:44.027267 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:45.027591 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:45.027539 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:46.027350 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:46.027302 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 18:38:47.140710 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:47.140665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 18:38:47.158630 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:47.158526 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a589a094-4ce3-4111-b9f7-58f07bf1ffe3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:38:57.148288 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:38:57.148258 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 18:39:07.993040 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:07.993002 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:39:07.998032 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:07.998008 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.001631 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.001610 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 18:39:08.014353 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.014332 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:39:08.175324 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.175292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.175487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.175329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.175487 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.175401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4229\" (UniqueName: \"kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.276352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.276268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.276352 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.276336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4229\" (UniqueName: \"kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.276574 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.276428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.277092 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.277066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.279090 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.279064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.289494 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.289461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4229\" (UniqueName: \"kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229\") pod \"authorino-68594f558-66zfp\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.307188 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.307167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:39:08.445618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.445594 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:39:08.447225 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:39:08.447201 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5be65ca_ff08_4e06_a4ab_146bf048f517.slice/crio-3bc853894547ce3ecf5c48f9d125dd223fbb771d8a410bec7dcb4942379aa847 WatchSource:0}: Error finding container 3bc853894547ce3ecf5c48f9d125dd223fbb771d8a410bec7dcb4942379aa847: Status 404 returned error can't find the container with id 3bc853894547ce3ecf5c48f9d125dd223fbb771d8a410bec7dcb4942379aa847 Jul 01 18:39:08.886164 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:08.886130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68594f558-66zfp" event={"ID":"f5be65ca-ff08-4e06-a4ab-146bf048f517","Type":"ContainerStarted","Data":"3bc853894547ce3ecf5c48f9d125dd223fbb771d8a410bec7dcb4942379aa847"} Jul 01 18:39:09.893447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:09.893407 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68594f558-66zfp" event={"ID":"f5be65ca-ff08-4e06-a4ab-146bf048f517","Type":"ContainerStarted","Data":"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac"} Jul 01 18:39:09.934000 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:09.933952 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68594f558-66zfp" podStartSLOduration=2.450500457 podStartE2EDuration="2.933935619s" totalImagesPullingTime="483.435162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:09.924157261 +0000 UTC m=+707.174040373" watchObservedRunningTime="2026-07-01 18:39:09.933935619 +0000 UTC m=+707.183818791" Jul 01 18:39:09.997115 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:09.997083 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:39:09.997279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:09.997255 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8588845cbd-6z6dh" podUID="f6d9fff3-5046-450d-8ae8-5e804fb02462" containerName="authorino" containerID="cri-o://7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9" gracePeriod=30 Jul 01 18:39:10.245018 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.244991 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:39:10.394745 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.394719 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert\") pod \"f6d9fff3-5046-450d-8ae8-5e804fb02462\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " Jul 01 18:39:10.394945 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.394763 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9fr4\" (UniqueName: \"kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4\") pod \"f6d9fff3-5046-450d-8ae8-5e804fb02462\" (UID: \"f6d9fff3-5046-450d-8ae8-5e804fb02462\") " Jul 01 18:39:10.396944 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.396919 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4" (OuterVolumeSpecName: "kube-api-access-r9fr4") pod "f6d9fff3-5046-450d-8ae8-5e804fb02462" (UID: "f6d9fff3-5046-450d-8ae8-5e804fb02462"). InnerVolumeSpecName "kube-api-access-r9fr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:39:10.405064 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.405041 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f6d9fff3-5046-450d-8ae8-5e804fb02462" (UID: "f6d9fff3-5046-450d-8ae8-5e804fb02462"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:39:10.495600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.495515 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f6d9fff3-5046-450d-8ae8-5e804fb02462-tls-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:39:10.495600 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.495546 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9fr4\" (UniqueName: \"kubernetes.io/projected/f6d9fff3-5046-450d-8ae8-5e804fb02462-kube-api-access-r9fr4\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:39:10.899683 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.899598 2566 generic.go:356] "Generic (PLEG): container finished" podID="f6d9fff3-5046-450d-8ae8-5e804fb02462" containerID="7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9" exitCode=0 Jul 01 18:39:10.899683 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.899640 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8588845cbd-6z6dh" Jul 01 18:39:10.900189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.899687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8588845cbd-6z6dh" event={"ID":"f6d9fff3-5046-450d-8ae8-5e804fb02462","Type":"ContainerDied","Data":"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9"} Jul 01 18:39:10.900189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.899736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8588845cbd-6z6dh" event={"ID":"f6d9fff3-5046-450d-8ae8-5e804fb02462","Type":"ContainerDied","Data":"8c470306814bb12725f75d1b9fb9f7b67f5e09e08303fced858037121b81ee7e"} Jul 01 18:39:10.900189 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.899759 2566 scope.go:117] "RemoveContainer" containerID="7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9" Jul 01 18:39:10.910201 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.910182 2566 scope.go:117] "RemoveContainer" containerID="7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9" Jul 01 18:39:10.910474 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:39:10.910457 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9\": container with ID starting with 7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9 not found: ID does not exist" containerID="7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9" Jul 01 18:39:10.910527 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.910483 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9"} err="failed to get container status \"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9\": rpc error: code = NotFound desc = could not find container \"7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9\": container with ID starting with 7772517809e3ae8e7b79474735838eddc4a53b0928ca0b646c5039d56c26b3b9 not found: ID does not exist" Jul 01 18:39:10.930576 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.930542 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:39:10.951830 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:10.951779 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8588845cbd-6z6dh"] Jul 01 18:39:11.209203 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:11.209172 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d9fff3-5046-450d-8ae8-5e804fb02462" path="/var/lib/kubelet/pods/f6d9fff3-5046-450d-8ae8-5e804fb02462/volumes" Jul 01 18:39:18.848376 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.848306 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs"] Jul 01 18:39:18.848727 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.848680 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d9fff3-5046-450d-8ae8-5e804fb02462" containerName="authorino" Jul 01 18:39:18.848727 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.848694 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d9fff3-5046-450d-8ae8-5e804fb02462" containerName="authorino" Jul 01 18:39:18.848823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.848765 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d9fff3-5046-450d-8ae8-5e804fb02462" containerName="authorino" Jul 01 18:39:18.851856 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.851841 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:18.857234 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.857210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7tk72\"" Jul 01 18:39:18.857377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.857249 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 18:39:18.857377 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.857210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 18:39:18.857914 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.857892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 18:39:18.864835 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.864814 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs"] Jul 01 18:39:18.962318 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.962293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:18.962485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.962332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:18.962485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.962359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:18.962485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.962430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vk2v\" (UniqueName: \"kubernetes.io/projected/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-kube-api-access-4vk2v\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:18.962485 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:18.962467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063038 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vk2v\" (UniqueName: \"kubernetes.io/projected/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-kube-api-access-4vk2v\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063170 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063170 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063170 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063282 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063543 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.063625 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.063553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.065441 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.065413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.065619 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.065604 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.075606 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.075587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vk2v\" (UniqueName: \"kubernetes.io/projected/b8e5940d-50fe-4ce8-8cf2-094f152f75e5-kube-api-access-4vk2v\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-sqfhs\" (UID: \"b8e5940d-50fe-4ce8-8cf2-094f152f75e5\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.161823 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.161750 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:19.322499 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.322470 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs"] Jul 01 18:39:19.323421 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:39:19.323396 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e5940d_50fe_4ce8_8cf2_094f152f75e5.slice/crio-12caff317b909643e51f94f486aa92d5b768de1eab119f21d0170c2c0a3c427e WatchSource:0}: Error finding container 12caff317b909643e51f94f486aa92d5b768de1eab119f21d0170c2c0a3c427e: Status 404 returned error can't find the container with id 12caff317b909643e51f94f486aa92d5b768de1eab119f21d0170c2c0a3c427e Jul 01 18:39:19.954004 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:19.953962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" event={"ID":"b8e5940d-50fe-4ce8-8cf2-094f152f75e5","Type":"ContainerStarted","Data":"12caff317b909643e51f94f486aa92d5b768de1eab119f21d0170c2c0a3c427e"} Jul 01 18:39:20.961235 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:20.961197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" event={"ID":"b8e5940d-50fe-4ce8-8cf2-094f152f75e5","Type":"ContainerStarted","Data":"38caf71c3c6deb2404a416227f15b68b77de1083be4993308fa8c70edd240d55"} Jul 01 18:39:20.983433 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:20.983388 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" podStartSLOduration=1.8758709759999999 podStartE2EDuration="2.983373809s" totalImagesPullingTime="1.107502833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:20.981966563 +0000 UTC m=+718.231849676" watchObservedRunningTime="2026-07-01 18:39:20.983373809 +0000 UTC m=+718.233256924" Jul 01 18:39:29.162164 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:29.162117 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:29.162642 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:29.162213 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:29.174652 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:29.174625 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:30.019997 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:30.019962 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-sqfhs" Jul 01 18:39:47.727631 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.727599 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c"] Jul 01 18:39:47.731198 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.731175 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.734274 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.734255 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 18:39:47.742902 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.742880 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c"] Jul 01 18:39:47.774213 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.774189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.774326 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.774219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259qw\" (UniqueName: \"kubernetes.io/projected/ae25f4b5-e4d3-4b39-9105-36fc649810d9-kube-api-access-259qw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.774326 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.774308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.774399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.774343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae25f4b5-e4d3-4b39-9105-36fc649810d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.774399 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.774360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875073 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875073 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae25f4b5-e4d3-4b39-9105-36fc649810d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875279 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875528 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875528 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875517 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.875761 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.875730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-259qw\" (UniqueName: \"kubernetes.io/projected/ae25f4b5-e4d3-4b39-9105-36fc649810d9-kube-api-access-259qw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.877349 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.877324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae25f4b5-e4d3-4b39-9105-36fc649810d9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.877666 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.877648 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae25f4b5-e4d3-4b39-9105-36fc649810d9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:47.885601 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:47.885577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-259qw\" (UniqueName: \"kubernetes.io/projected/ae25f4b5-e4d3-4b39-9105-36fc649810d9-kube-api-access-259qw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c\" (UID: \"ae25f4b5-e4d3-4b39-9105-36fc649810d9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:48.042314 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:48.042252 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:48.182455 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:48.182428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c"] Jul 01 18:39:48.185009 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:39:48.184983 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae25f4b5_e4d3_4b39_9105_36fc649810d9.slice/crio-9d6d85f57e02ab4fd370816c3cdaf163a8fe5eec01846b0ec6364c4a75029894 WatchSource:0}: Error finding container 9d6d85f57e02ab4fd370816c3cdaf163a8fe5eec01846b0ec6364c4a75029894: Status 404 returned error can't find the container with id 9d6d85f57e02ab4fd370816c3cdaf163a8fe5eec01846b0ec6364c4a75029894 Jul 01 18:39:49.121501 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:49.121468 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" event={"ID":"ae25f4b5-e4d3-4b39-9105-36fc649810d9","Type":"ContainerStarted","Data":"b3d9fcba6e6b83da38b87afc9f29cae326efc63701fe52ad414ae2c2207c741e"} Jul 01 18:39:49.121901 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:49.121521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" event={"ID":"ae25f4b5-e4d3-4b39-9105-36fc649810d9","Type":"ContainerStarted","Data":"9d6d85f57e02ab4fd370816c3cdaf163a8fe5eec01846b0ec6364c4a75029894"} Jul 01 18:39:49.142732 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:49.142683 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" podStartSLOduration=1.942068699 podStartE2EDuration="2.142669358s" totalImagesPullingTime="200.600659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:49.140479865 +0000 UTC m=+746.390362979" watchObservedRunningTime="2026-07-01 18:39:49.142669358 +0000 UTC m=+746.392552471" Jul 01 18:39:58.042536 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:58.042497 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:58.042965 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:58.042558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:58.054919 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:58.054894 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:39:58.179119 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:39:58.179095 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c" Jul 01 18:41:45.402674 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.402644 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7596b5bfc9-v68jw"] Jul 01 18:41:45.406134 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.406116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.421373 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.421348 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7596b5bfc9-v68jw"] Jul 01 18:41:45.436904 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.436878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8dc29a78-cd78-4497-a065-4c408966fbd9-oidc-ca\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.437043 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.436937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8hk\" (UniqueName: \"kubernetes.io/projected/8dc29a78-cd78-4497-a065-4c408966fbd9-kube-api-access-9x8hk\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.437043 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.437026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8dc29a78-cd78-4497-a065-4c408966fbd9-tls-cert\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.538214 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.538190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8dc29a78-cd78-4497-a065-4c408966fbd9-tls-cert\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.538336 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.538247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8dc29a78-cd78-4497-a065-4c408966fbd9-oidc-ca\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.538336 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.538278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8hk\" (UniqueName: \"kubernetes.io/projected/8dc29a78-cd78-4497-a065-4c408966fbd9-kube-api-access-9x8hk\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.539029 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.538965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8dc29a78-cd78-4497-a065-4c408966fbd9-oidc-ca\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.540775 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.540752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8dc29a78-cd78-4497-a065-4c408966fbd9-tls-cert\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.546930 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.546905 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8hk\" (UniqueName: \"kubernetes.io/projected/8dc29a78-cd78-4497-a065-4c408966fbd9-kube-api-access-9x8hk\") pod \"authorino-7596b5bfc9-v68jw\" (UID: \"8dc29a78-cd78-4497-a065-4c408966fbd9\") " pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.715642 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.715616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7596b5bfc9-v68jw" Jul 01 18:41:45.850230 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:45.850207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7596b5bfc9-v68jw"] Jul 01 18:41:45.852305 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:41:45.852280 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dc29a78_cd78_4497_a065_4c408966fbd9.slice/crio-a10bf9b38f793febf408fee429ac44c8c469f6d604abd40979acc93849d976d8 WatchSource:0}: Error finding container a10bf9b38f793febf408fee429ac44c8c469f6d604abd40979acc93849d976d8: Status 404 returned error can't find the container with id a10bf9b38f793febf408fee429ac44c8c469f6d604abd40979acc93849d976d8 Jul 01 18:41:46.756459 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:46.756418 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7596b5bfc9-v68jw" event={"ID":"8dc29a78-cd78-4497-a065-4c408966fbd9","Type":"ContainerStarted","Data":"17130495de3588c7667363151bc186c26cc541defb4c5cc4752d20334904bf15"} Jul 01 18:41:46.756947 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:46.756471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7596b5bfc9-v68jw" event={"ID":"8dc29a78-cd78-4497-a065-4c408966fbd9","Type":"ContainerStarted","Data":"a10bf9b38f793febf408fee429ac44c8c469f6d604abd40979acc93849d976d8"} Jul 01 18:41:46.778721 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:46.778654 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7596b5bfc9-v68jw" podStartSLOduration=1.264575669 podStartE2EDuration="1.778633313s" totalImagesPullingTime="514.057644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:41:46.776861601 +0000 UTC m=+864.026744715" watchObservedRunningTime="2026-07-01 18:41:46.778633313 +0000 UTC m=+864.028516427" Jul 01 18:41:46.819690 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:46.819659 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:41:46.819927 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:46.819891 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68594f558-66zfp" podUID="f5be65ca-ff08-4e06-a4ab-146bf048f517" containerName="authorino" containerID="cri-o://7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac" gracePeriod=30 Jul 01 18:41:47.097898 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.097873 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:41:47.153419 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.153390 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert\") pod \"f5be65ca-ff08-4e06-a4ab-146bf048f517\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " Jul 01 18:41:47.153605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.153458 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4229\" (UniqueName: \"kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229\") pod \"f5be65ca-ff08-4e06-a4ab-146bf048f517\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " Jul 01 18:41:47.153605 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.153546 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca\") pod \"f5be65ca-ff08-4e06-a4ab-146bf048f517\" (UID: \"f5be65ca-ff08-4e06-a4ab-146bf048f517\") " Jul 01 18:41:47.155876 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.155848 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229" (OuterVolumeSpecName: "kube-api-access-c4229") pod "f5be65ca-ff08-4e06-a4ab-146bf048f517" (UID: "f5be65ca-ff08-4e06-a4ab-146bf048f517"). InnerVolumeSpecName "kube-api-access-c4229". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:41:47.160235 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.160205 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "f5be65ca-ff08-4e06-a4ab-146bf048f517" (UID: "f5be65ca-ff08-4e06-a4ab-146bf048f517"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:41:47.165001 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.164978 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f5be65ca-ff08-4e06-a4ab-146bf048f517" (UID: "f5be65ca-ff08-4e06-a4ab-146bf048f517"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:41:47.254458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.254423 2566 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f5be65ca-ff08-4e06-a4ab-146bf048f517-oidc-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:41:47.254458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.254452 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5be65ca-ff08-4e06-a4ab-146bf048f517-tls-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:41:47.254458 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.254466 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4229\" (UniqueName: \"kubernetes.io/projected/f5be65ca-ff08-4e06-a4ab-146bf048f517-kube-api-access-c4229\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\"" Jul 01 18:41:47.764299 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.764263 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5be65ca-ff08-4e06-a4ab-146bf048f517" containerID="7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac" exitCode=0 Jul 01 18:41:47.764723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.764323 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68594f558-66zfp" Jul 01 18:41:47.764723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.764347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68594f558-66zfp" event={"ID":"f5be65ca-ff08-4e06-a4ab-146bf048f517","Type":"ContainerDied","Data":"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac"} Jul 01 18:41:47.764723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.764391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68594f558-66zfp" event={"ID":"f5be65ca-ff08-4e06-a4ab-146bf048f517","Type":"ContainerDied","Data":"3bc853894547ce3ecf5c48f9d125dd223fbb771d8a410bec7dcb4942379aa847"} Jul 01 18:41:47.764723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.764409 2566 scope.go:117] "RemoveContainer" containerID="7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac" Jul 01 18:41:47.773915 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.773898 2566 scope.go:117] "RemoveContainer" containerID="7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac" Jul 01 18:41:47.774194 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:41:47.774168 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac\": container with ID starting with 7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac not found: ID does not exist" containerID="7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac" Jul 01 18:41:47.774299 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.774204 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac"} err="failed to get container status \"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac\": rpc error: code = NotFound desc = could not find container \"7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac\": container with ID starting with 7a384c6503452e3ad6c3b594f978d644ea429c3c8c895ac09393e7b151c4d7ac not found: ID does not exist" Jul 01 18:41:47.785318 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.785282 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:41:47.789341 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:47.789320 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68594f558-66zfp"] Jul 01 18:41:49.208937 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:49.208894 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5be65ca-ff08-4e06-a4ab-146bf048f517" path="/var/lib/kubelet/pods/f5be65ca-ff08-4e06-a4ab-146bf048f517/volumes" Jul 01 18:41:52.800277 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:52.800246 2566 generic.go:356] "Generic (PLEG): container finished" podID="dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83" containerID="02e5151621efc26c01bdbe8847f623d5ef6ad84a5462be3fea095f6a573b05fc" exitCode=2 Jul 01 18:41:52.800632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:52.800319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerDied","Data":"02e5151621efc26c01bdbe8847f623d5ef6ad84a5462be3fea095f6a573b05fc"} Jul 01 18:41:52.800632 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:52.800623 2566 scope.go:117] "RemoveContainer" containerID="02e5151621efc26c01bdbe8847f623d5ef6ad84a5462be3fea095f6a573b05fc" Jul 01 18:41:53.807340 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:53.807305 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerStarted","Data":"cf5a59f1b31005fa5b940a991ae4a740dd2cb4fd35687fc6cb74d3d118a5f40c"} Jul 01 18:41:53.807730 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:41:53.807515 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:42:04.814797 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:04.814763 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:42:23.243502 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:23.243431 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:42:23.244504 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:23.244484 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:42:24.812696 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:24.812655 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" podUID="dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.49:9004: connect: connection refused" Jul 01 18:42:24.975387 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:24.975352 2566 generic.go:356] "Generic (PLEG): container finished" podID="dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83" containerID="cf5a59f1b31005fa5b940a991ae4a740dd2cb4fd35687fc6cb74d3d118a5f40c" exitCode=2 Jul 01 18:42:24.975535 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:24.975393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerDied","Data":"cf5a59f1b31005fa5b940a991ae4a740dd2cb4fd35687fc6cb74d3d118a5f40c"} Jul 01 18:42:24.975535 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:24.975468 2566 scope.go:117] "RemoveContainer" containerID="02e5151621efc26c01bdbe8847f623d5ef6ad84a5462be3fea095f6a573b05fc" Jul 01 18:42:24.975881 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:24.975861 2566 scope.go:117] "RemoveContainer" containerID="cf5a59f1b31005fa5b940a991ae4a740dd2cb4fd35687fc6cb74d3d118a5f40c" Jul 01 18:42:24.976076 ip-10-0-135-235 kubenswrapper[2566]: E0701 18:42:24.976050 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-qdqlf_openshift-ingress(dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" podUID="dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83" Jul 01 18:42:25.223027 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:25.222995 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7596b5bfc9-v68jw_8dc29a78-cd78-4497-a065-4c408966fbd9/authorino/0.log" Jul 01 18:42:30.564354 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:30.564312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69d4dbdc54-kvd5g_c2204ee0-0f03-4f63-8f87-1bf0313fe18d/manager/0.log" Jul 01 18:42:30.929898 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:30.929869 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-7mjfb_9892caa7-b44e-4752-8cc7-fa15432a47cc/copy-manifests/0.log" Jul 01 18:42:30.947438 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:30.947411 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-7mjfb_9892caa7-b44e-4752-8cc7-fa15432a47cc/manager/0.log" Jul 01 18:42:31.294424 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:31.294324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-897js_8aee9d58-ffcc-4107-9a5c-2d219f69702e/postgres/0.log" Jul 01 18:42:32.054776 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.054741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/util/0.log" Jul 01 18:42:32.063306 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.063273 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/pull/0.log" Jul 01 18:42:32.076312 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.076260 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/extract/0.log" Jul 01 18:42:32.187903 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.187877 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/util/0.log" Jul 01 18:42:32.195307 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.195285 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/pull/0.log" Jul 01 18:42:32.202655 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.202629 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/extract/0.log" Jul 01 18:42:32.310052 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.309991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/util/0.log" Jul 01 18:42:32.317770 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.317733 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/pull/0.log" Jul 01 18:42:32.325027 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.325009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/extract/0.log" Jul 01 18:42:32.440575 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.440554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/util/0.log" Jul 01 18:42:32.452686 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.452665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/pull/0.log" Jul 01 18:42:32.463878 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.463843 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/extract/0.log" Jul 01 18:42:32.583618 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.583539 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7596b5bfc9-v68jw_8dc29a78-cd78-4497-a065-4c408966fbd9/authorino/0.log" Jul 01 18:42:32.930614 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:32.930589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h8cng_b80d0cbe-d888-410b-bb63-728e85924b0b/kuadrant-console-plugin/0.log" Jul 01 18:42:34.129126 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.129081 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-zx2mw_fc5bb339-9f04-443b-87e2-87abfbf8ad0a/kube-auth-proxy/0.log" Jul 01 18:42:34.360227 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.360183 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-hkk9v_a751a43f-0b3c-4dd9-9b49-b75424c5e9f8/payload-pre-processing/0.log" Jul 01 18:42:34.476681 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.476652 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/1.log" Jul 01 18:42:34.591239 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.591204 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7847669bd5-k84r8_45ad114e-5a80-40e7-9f0b-b6b16a094f1a/router/0.log" Jul 01 18:42:34.813200 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.813140 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:42:34.813447 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.813434 2566 scope.go:117] "RemoveContainer" containerID="cf5a59f1b31005fa5b940a991ae4a740dd2cb4fd35687fc6cb74d3d118a5f40c" Jul 01 18:42:34.924681 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:34.924645 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-sqfhs_b8e5940d-50fe-4ce8-8cf2-094f152f75e5/main/0.log" Jul 01 18:42:35.038130 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:35.038097 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" event={"ID":"dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83","Type":"ContainerStarted","Data":"5d1e0a6eaa9a61a2918920ef7073da6b433fff929c70950aaeacdaef989ac17c"} Jul 01 18:42:35.038317 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:35.038301 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:42:35.254276 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:35.254252 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649p8g9c_ae25f4b5-e4d3-4b39-9105-36fc649810d9/main/0.log" Jul 01 18:42:42.351842 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:42.351772 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkhbg_09ccbf9c-12aa-4a97-a41a-398bfeaef7a3/global-pull-secret-syncer/0.log" Jul 01 18:42:42.614415 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:42.614338 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p8df6_3c25280f-7541-49f2-868c-f016beda8087/konnectivity-agent/0.log" Jul 01 18:42:42.740007 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:42.739976 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-235.ec2.internal_1ba0a29899ef0b7c5ebc60f477e47a02/haproxy/0.log" Jul 01 18:42:46.046166 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:46.046135 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-qdqlf" Jul 01 18:42:46.929718 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:46.929680 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/extract/0.log" Jul 01 18:42:46.962771 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:46.962745 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/util/0.log" Jul 01 18:42:46.994333 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:46.994311 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dmp7b_5592e4d7-4cf1-488e-94e0-ed557a853275/pull/0.log" Jul 01 18:42:47.034645 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.034589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/extract/0.log" Jul 01 18:42:47.058723 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.058705 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/util/0.log" Jul 01 18:42:47.082955 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.082935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gc9lp_d5d07612-dd15-4f2f-ab87-b1ebbece457a/pull/0.log" Jul 01 18:42:47.118251 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.118233 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/extract/0.log" Jul 01 18:42:47.144163 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.144145 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/util/0.log" Jul 01 18:42:47.175862 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.175844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x5l7v_68272c7d-b9a9-4da1-bcbc-ea64a416e177/pull/0.log" Jul 01 18:42:47.205535 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.205517 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/extract/0.log" Jul 01 18:42:47.233168 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.233152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/util/0.log" Jul 01 18:42:47.255732 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.255715 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zw7sx_b8174cbe-d436-4af0-8147-3a889d02896d/pull/0.log" Jul 01 18:42:47.289361 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.289312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7596b5bfc9-v68jw_8dc29a78-cd78-4497-a065-4c408966fbd9/authorino/0.log" Jul 01 18:42:47.379416 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:47.379397 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h8cng_b80d0cbe-d888-410b-bb63-728e85924b0b/kuadrant-console-plugin/0.log" Jul 01 18:42:49.320310 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:49.320279 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-grlgc_e6735daa-1c29-4191-a937-0759b7ec87ff/cluster-monitoring-operator/0.log" Jul 01 18:42:49.538805 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:49.538760 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8c55k_f83be1d9-329e-4a13-acf0-b29852e980bd/node-exporter/0.log" Jul 01 18:42:49.563771 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:49.563750 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8c55k_f83be1d9-329e-4a13-acf0-b29852e980bd/kube-rbac-proxy/0.log" Jul 01 18:42:49.588916 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:49.588863 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8c55k_f83be1d9-329e-4a13-acf0-b29852e980bd/init-textfile/0.log" Jul 01 18:42:50.134287 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.134255 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-545d9_3935ec08-a5ac-4032-b92e-ced1680d5e53/prometheus-operator/0.log" Jul 01 18:42:50.156610 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.156584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-545d9_3935ec08-a5ac-4032-b92e-ced1680d5e53/kube-rbac-proxy/0.log" Jul 01 18:42:50.219594 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.219560 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbc6c74cd-x6x9f_9e4841b2-ed9e-4c83-a468-e9b6c4d29990/telemeter-client/0.log" Jul 01 18:42:50.244617 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.244598 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbc6c74cd-x6x9f_9e4841b2-ed9e-4c83-a468-e9b6c4d29990/reload/0.log" Jul 01 18:42:50.267730 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.267707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbc6c74cd-x6x9f_9e4841b2-ed9e-4c83-a468-e9b6c4d29990/kube-rbac-proxy/0.log" Jul 01 18:42:50.305420 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.305392 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/thanos-query/0.log" Jul 01 18:42:50.329167 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.329142 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/kube-rbac-proxy-web/0.log" Jul 01 18:42:50.355382 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.355358 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/kube-rbac-proxy/0.log" Jul 01 18:42:50.377937 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.377915 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/prom-label-proxy/0.log" Jul 01 18:42:50.401879 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.401823 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/kube-rbac-proxy-rules/0.log" Jul 01 18:42:50.428932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:50.428909 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b978d8b78-nfh8g_3e2b74ba-5614-4b52-afa5-06b8870f5ce6/kube-rbac-proxy-metrics/0.log" Jul 01 18:42:52.256491 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.256461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/1.log" Jul 01 18:42:52.260450 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.260430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-45vts_9fe4ec4f-5a55-42fd-ae71-799f2025247e/console-operator/2.log" Jul 01 18:42:52.588152 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.588059 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22"] Jul 01 18:42:52.588595 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.588570 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5be65ca-ff08-4e06-a4ab-146bf048f517" containerName="authorino" Jul 01 18:42:52.588697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.588598 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5be65ca-ff08-4e06-a4ab-146bf048f517" containerName="authorino" Jul 01 18:42:52.588697 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.588688 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5be65ca-ff08-4e06-a4ab-146bf048f517" containerName="authorino" Jul 01 18:42:52.591897 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.591870 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.601518 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.601498 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"kube-root-ca.crt\"" Jul 01 18:42:52.601636 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.601607 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"openshift-service-ca.crt\"" Jul 01 18:42:52.602963 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.602949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ljr9\"/\"default-dockercfg-4r7cl\"" Jul 01 18:42:52.608707 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.608688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22"] Jul 01 18:42:52.682606 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.682581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-podres\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.682706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.682619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-lib-modules\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.682706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.682652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-sys\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.682706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.682682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbjjw\" (UniqueName: \"kubernetes.io/projected/fb0a7021-dded-42df-9d69-c74a01665264-kube-api-access-vbjjw\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.682706 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.682702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-proc\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783509 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-podres\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783609 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-lib-modules\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783609 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-sys\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783609 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbjjw\" (UniqueName: \"kubernetes.io/projected/fb0a7021-dded-42df-9d69-c74a01665264-kube-api-access-vbjjw\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-proc\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-podres\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-lib-modules\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-sys\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.783714 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.783695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb0a7021-dded-42df-9d69-c74a01665264-proc\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.793778 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.793740 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbjjw\" (UniqueName: \"kubernetes.io/projected/fb0a7021-dded-42df-9d69-c74a01665264-kube-api-access-vbjjw\") pod \"perf-node-gather-daemonset-5cb22\" (UID: \"fb0a7021-dded-42df-9d69-c74a01665264\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.901646 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.901583 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:52.936529 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:52.936509 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59d7d58575-2cq6p_1d6a46a4-83fb-4fc0-b1e8-300d97fcb655/console/0.log" Jul 01 18:42:53.038434 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.038408 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22"] Jul 01 18:42:53.041065 ip-10-0-135-235 kubenswrapper[2566]: W0701 18:42:53.041037 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb0a7021_dded_42df_9d69_c74a01665264.slice/crio-7c80ab85ed88c590aabca31d3e67b3d290b9ce137b0fef6be4e545cc39da942b WatchSource:0}: Error finding container 7c80ab85ed88c590aabca31d3e67b3d290b9ce137b0fef6be4e545cc39da942b: Status 404 returned error can't find the container with id 7c80ab85ed88c590aabca31d3e67b3d290b9ce137b0fef6be4e545cc39da942b Jul 01 18:42:53.133595 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.133565 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" event={"ID":"fb0a7021-dded-42df-9d69-c74a01665264","Type":"ContainerStarted","Data":"96917a35a9c04873e2bbf8d1bc36861588df1bed11f7d89db3d6ab5cc9918be1"} Jul 01 18:42:53.133730 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.133631 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" event={"ID":"fb0a7021-dded-42df-9d69-c74a01665264","Type":"ContainerStarted","Data":"7c80ab85ed88c590aabca31d3e67b3d290b9ce137b0fef6be4e545cc39da942b"} Jul 01 18:42:53.133730 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.133676 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:42:53.152459 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.152372 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" podStartSLOduration=1.15235634 podStartE2EDuration="1.15235634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:53.151872263 +0000 UTC m=+930.401755377" watchObservedRunningTime="2026-07-01 18:42:53.15235634 +0000 UTC m=+930.402239454" Jul 01 18:42:53.589976 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:53.589948 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-k7x6d_9af05f9b-b163-4457-a9a2-d9b2bb6aa67a/volume-data-source-validator/0.log" Jul 01 18:42:54.700198 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:54.700170 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmpvf_1130b76b-a750-407f-8bd5-823ef4464179/dns/0.log" Jul 01 18:42:54.725696 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:54.725674 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmpvf_1130b76b-a750-407f-8bd5-823ef4464179/kube-rbac-proxy/0.log" Jul 01 18:42:54.808825 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:54.808778 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xvvtc_7f58e5e2-fbdb-46ca-8588-4da4d639ff3c/dns-node-resolver/0.log" Jul 01 18:42:55.416977 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:55.416946 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wjqw8_b355b77e-da6d-49db-bd9e-bffef89d7165/node-ca/0.log" Jul 01 18:42:56.474471 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:56.474441 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-zx2mw_fc5bb339-9f04-443b-87e2-87abfbf8ad0a/kube-auth-proxy/0.log" Jul 01 18:42:56.528908 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:56.528848 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-hkk9v_a751a43f-0b3c-4dd9-9b49-b75424c5e9f8/payload-pre-processing/0.log" Jul 01 18:42:56.553407 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:56.553380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/2.log" Jul 01 18:42:56.553848 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:56.553830 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/1.log" Jul 01 18:42:56.576658 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:56.576635 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7847669bd5-k84r8_45ad114e-5a80-40e7-9f0b-b6b16a094f1a/router/0.log" Jul 01 18:42:57.194178 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.194149 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cdvf2_1cdae818-292a-432c-95b2-429d0f2d54ed/serve-healthcheck-canary/0.log" Jul 01 18:42:57.728492 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.728460 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-7j6kn_b2b476ee-36a3-4b0e-93d5-aef49d9d82ef/insights-operator/0.log" Jul 01 18:42:57.728903 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.728679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-7j6kn_b2b476ee-36a3-4b0e-93d5-aef49d9d82ef/insights-operator/1.log" Jul 01 18:42:57.820066 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.820033 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n92v5_1e5d4b77-430e-4741-af57-6d0fad415845/kube-rbac-proxy/0.log" Jul 01 18:42:57.841794 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.841767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n92v5_1e5d4b77-430e-4741-af57-6d0fad415845/exporter/0.log" Jul 01 18:42:57.863568 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:57.863542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n92v5_1e5d4b77-430e-4741-af57-6d0fad415845/extractor/0.log" Jul 01 18:42:59.150668 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:42:59.150640 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-5cb22" Jul 01 18:43:00.253563 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:00.253521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69d4dbdc54-kvd5g_c2204ee0-0f03-4f63-8f87-1bf0313fe18d/manager/0.log" Jul 01 18:43:00.391932 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:00.391898 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-7mjfb_9892caa7-b44e-4752-8cc7-fa15432a47cc/manager/0.log" Jul 01 18:43:00.408623 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:00.408601 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-7mjfb_9892caa7-b44e-4752-8cc7-fa15432a47cc/copy-manifests/0.log" Jul 01 18:43:00.536307 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:00.536240 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-897js_8aee9d58-ffcc-4107-9a5c-2d219f69702e/postgres/0.log" Jul 01 18:43:02.153762 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.153736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56879d7496-nbb62_a6417479-f3a4-4c78-8d01-ea332a427bf5/manager/0.log" Jul 01 18:43:02.752155 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.752132 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-zx2mw_fc5bb339-9f04-443b-87e2-87abfbf8ad0a/kube-auth-proxy/0.log" Jul 01 18:43:02.784220 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.784195 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-hkk9v_a751a43f-0b3c-4dd9-9b49-b75424c5e9f8/payload-pre-processing/0.log" Jul 01 18:43:02.799877 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.799844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/2.log" Jul 01 18:43:02.800418 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.800399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/1.log" Jul 01 18:43:02.812847 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:02.812827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7847669bd5-k84r8_45ad114e-5a80-40e7-9f0b-b6b16a094f1a/router/0.log" Jul 01 18:43:03.944240 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:03.944211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf5845d-zx2mw_fc5bb339-9f04-443b-87e2-87abfbf8ad0a/kube-auth-proxy/0.log" Jul 01 18:43:03.991271 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:03.991245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-hkk9v_a751a43f-0b3c-4dd9-9b49-b75424c5e9f8/payload-pre-processing/0.log" Jul 01 18:43:04.009315 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:04.009296 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/2.log" Jul 01 18:43:04.009896 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:04.009884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-qdqlf_dabe3c50-6d5e-41fc-86c6-f29dcdd7fa83/payload-processing/1.log" Jul 01 18:43:04.027511 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:04.027460 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7847669bd5-k84r8_45ad114e-5a80-40e7-9f0b-b6b16a094f1a/router/0.log" Jul 01 18:43:08.763532 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:08.763506 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2dbpb_6133928e-c4d9-459e-9dd9-26c6a0ae0708/kube-multus/0.log" Jul 01 18:43:09.000081 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.000052 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/kube-multus-additional-cni-plugins/0.log" Jul 01 18:43:09.021123 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.021102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/egress-router-binary-copy/0.log" Jul 01 18:43:09.042082 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.042065 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/cni-plugins/0.log" Jul 01 18:43:09.064158 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.064139 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/bond-cni-plugin/0.log" Jul 01 18:43:09.092543 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.092520 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/routeoverride-cni/0.log" Jul 01 18:43:09.114885 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.114866 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/whereabouts-cni-bincopy/0.log" Jul 01 18:43:09.137659 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.137638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlz2z_540758a6-32b9-47b3-8967-f57fd6dfad7d/whereabouts-cni/0.log" Jul 01 18:43:09.472056 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.472034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kvf8h_5b67e645-9631-4417-874d-4be91078ecbd/network-metrics-daemon/0.log" Jul 01 18:43:09.494013 ip-10-0-135-235 kubenswrapper[2566]: I0701 18:43:09.493995 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kvf8h_5b67e645-9631-4417-874d-4be91078ecbd/kube-rbac-proxy/0.log"